-- Logs begin at Wed 2022-08-31 03:54:08 UTC, end at Wed 2022-08-31 05:00:48 UTC. -- Aug 31 04:23:38.253068 dv-cinder-855307-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 04:23:38.263667 dv-cinder-855307-1-smb devstack@keystone.service[81635]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 04:23:38.265595 dv-cinder-855307-1-smb devstack@keystone.service[81635]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 04:23:38 2022] *** Aug 31 04:23:38.265595 dv-cinder-855307-1-smb devstack@keystone.service[81635]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 04:23:38.265595 dv-cinder-855307-1-smb devstack@keystone.service[81635]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 04:23:38.265595 dv-cinder-855307-1-smb devstack@keystone.service[81635]: nodename: dv-cinder-855307-1-smb Aug 31 04:23:38.265595 dv-cinder-855307-1-smb devstack@keystone.service[81635]: machine: x86_64 Aug 31 04:23:38.265595 dv-cinder-855307-1-smb devstack@keystone.service[81635]: clock source: unix Aug 31 04:23:38.265595 dv-cinder-855307-1-smb devstack@keystone.service[81635]: pcre jit disabled Aug 31 04:23:38.265595 dv-cinder-855307-1-smb devstack@keystone.service[81635]: detected number of CPU cores: 4 Aug 31 04:23:38.265595 dv-cinder-855307-1-smb devstack@keystone.service[81635]: current working directory: / Aug 31 04:23:38.265595 dv-cinder-855307-1-smb devstack@keystone.service[81635]: detected binary path: /usr/bin/uwsgi-core Aug 31 04:23:38.266141 dv-cinder-855307-1-smb devstack@keystone.service[81635]: your processes number limit is 47680 Aug 31 04:23:38.266141 dv-cinder-855307-1-smb devstack@keystone.service[81635]: your memory page size is 4096 bytes Aug 31 04:23:38.266141 dv-cinder-855307-1-smb devstack@keystone.service[81635]: detected max file descriptor number: 2048 Aug 31 04:23:38.266141 dv-cinder-855307-1-smb devstack@keystone.service[81635]: lock engine: pthread robust mutexes Aug 31 04:23:38.266141 dv-cinder-855307-1-smb devstack@keystone.service[81635]: thunder lock: enabled Aug 31 04:23:38.266141 dv-cinder-855307-1-smb devstack@keystone.service[81635]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 04:23:38.266141 dv-cinder-855307-1-smb devstack@keystone.service[81635]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 04:23:38.306075 dv-cinder-855307-1-smb devstack@keystone.service[81635]: Python main interpreter initialized at 0x563df43519c0 Aug 31 04:23:38.306075 dv-cinder-855307-1-smb devstack@keystone.service[81635]: python threads support enabled Aug 31 04:23:38.306075 dv-cinder-855307-1-smb devstack@keystone.service[81635]: your server socket listen backlog is limited to 100 connections Aug 31 04:23:38.306075 dv-cinder-855307-1-smb devstack@keystone.service[81635]: your mercy for graceful operations on workers is 90 seconds Aug 31 04:23:38.306393 dv-cinder-855307-1-smb devstack@keystone.service[81635]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 04:23:38.306469 dv-cinder-855307-1-smb devstack@keystone.service[81635]: *** Operational MODE: preforking *** Aug 31 04:23:38.306715 dv-cinder-855307-1-smb devstack@keystone.service[81635]: *** uWSGI is running in multiple interpreter mode *** Aug 31 04:23:38.306715 dv-cinder-855307-1-smb devstack@keystone.service[81635]: spawned uWSGI master process (pid: 81635) Aug 31 04:23:38.306892 dv-cinder-855307-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 04:23:38.308103 dv-cinder-855307-1-smb devstack@keystone.service[81635]: spawned uWSGI worker 1 (pid: 81644, cores: 1) Aug 31 04:23:38.308103 dv-cinder-855307-1-smb devstack@keystone.service[81635]: spawned uWSGI worker 2 (pid: 81645, cores: 1) Aug 31 04:23:38.308103 dv-cinder-855307-1-smb devstack@keystone.service[81635]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 04:23:42.640467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:23:42.640467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: from cryptography.utils import int_from_bytes Aug 31 04:23:42.641285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:23:42.641285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: from cryptography.utils import int_from_bytes Aug 31 04:23:42.647352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:23:42.647352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: from cryptography.utils import int_from_bytes Aug 31 04:23:42.647831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 04:23:42.647831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: from cryptography.utils import int_from_bytes Aug 31 04:23:42.691863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 04:23:42.692051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 04:23:42.692229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] command line args: [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 04:23:42.692502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 04:23:42.692680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ================================================================================ {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 04:23:42.692935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] admin_token = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.693182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] config_dir = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.693401 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.693584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] config_source = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.693764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] debug = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.693962 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.694445 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.694564 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.694742 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.694991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.695343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] list_limit = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.695452 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] log_config_append = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.695570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.695734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] log_dir = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.695905 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] log_file = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.696137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.696401 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.696634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.696882 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.697061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.697261 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.697511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.697758 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.697992 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.698225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.698452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 04:23:42.698537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.698689 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 04:23:42.698777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.698842 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] command line args: [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 04:23:42.698901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.699089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 04:23:42.699179 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.699247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ================================================================================ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 04:23:42.699410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.699493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] admin_token = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.699731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] config_dir = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.699903 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.699993 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.700086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] config_source = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.700204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] publish_errors = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.700280 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] debug = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.700363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.700464 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.700569 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.700698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.700776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.700855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.700947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.701107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.701187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.701381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.701460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] standard_threads = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.705384 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.705476 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.705546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] log_config_append = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.705611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.705670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.705733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.705802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] log_dir = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.705862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] use_journal = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.705925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] log_file = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.705983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] use_json = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.705983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] use_stderr = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.706092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.706156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] use_syslog = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.706215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.706277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.706335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.706397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.706460 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.706530 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.706589 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.706652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.706715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.706786 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.707426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.707498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.707558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.707615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.707810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.707810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.707934 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.708003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.708108 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.708187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.708263 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.708343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.708415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.708484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.708553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.708627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.708706 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.708706 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.708841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.708911 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.708991 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] publish_errors = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.709068 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.709145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.709242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.709364 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.709451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.709605 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.709680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.709680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.709819 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.709895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.709971 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.710049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.710126 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] standard_threads = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.710197 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.710271 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.710347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.710427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.710554 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.710630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.710630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] use_journal = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.710755 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.710824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] use_json = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.710898 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.710977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] use_stderr = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.711049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.711124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] use_syslog = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.711194 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.711263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 04:23:42.711332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.711412 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.711488 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.711559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.711634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.711709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.711780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.711856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.711927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.712001 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.712076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.712152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.712226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.712304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.712380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.712456 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.712526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.712595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.712663 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.712740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.712810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.712879 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.712954 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.713025 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.713151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.713331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.713408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.713485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.713643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.713751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.713877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.713965 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.714114 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.714194 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.714364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.714449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.714598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.714683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.714837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.714915 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.715071 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.715149 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.715309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.715399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.715546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.715625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.715797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.715875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.716031 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.716111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.716271 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.716356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.716511 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.716593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.716744 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.716823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.716979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.717055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.717234 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.717354 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.717473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.717585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.717684 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.717778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.717919 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.718024 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.718168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.718274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.718400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.718513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.718634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.718709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.718874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.718970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.719119 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.719214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.719330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.719452 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.719567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.719646 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.719794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.719880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.720024 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.720146 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.720255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.720334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.720485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.720566 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.720721 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.720804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.720967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.721099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.721183 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.721319 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.721444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.721567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.721674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.721770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.721909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.721988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.722225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.722317 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.722548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.723147 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.723230 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.723464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.723701 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.723847 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.723953 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.724088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.724212 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.724328 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.724409 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.724567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.724647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.724837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.724956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.725176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.725327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.725402 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.725474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.725590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.725672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.725831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.725910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.726073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.726232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.726318 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.726391 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.726536 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.726616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.726775 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.726855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.727008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.727102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.727241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.727322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.727473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.727552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.727708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.727787 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.727940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.728063 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.728194 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.728321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.728447 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.728535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.728650 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.728729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.728885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.728995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.729131 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.729237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.734067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.734200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.734278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.734349 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.734420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.734491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] auth.external = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.734576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.734650 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.734721 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.734792 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.734863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.734945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.735026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.735098 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] auth.password = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.735175 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.735247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] auth.token = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.735317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.735395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.735467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.735537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.735607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.735682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.735754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.735832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.735904 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.736022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.736095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.736170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.736242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.736320 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.736398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.736469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] credential.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.736596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.736701 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.736815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.736896 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.736969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.737052 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.737125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.737220 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.737309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.737384 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.737456 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.737539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.737613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.737684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.737755 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.737829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.737900 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.737979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.738087 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.738226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.738329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.738405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.738476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.738556 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.738635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.738707 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.738778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.738849 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.738919 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.738997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.external = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.739141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.739213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.739283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.739352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.739435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.739515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.739588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.739658 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.password = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.739729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.739799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] auth.token = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.739877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.739951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.740022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.740093 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.740163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.740163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.740308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.740388 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.740462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.740538 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.740610 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.740687 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.740835 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.740916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.740989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.741060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.741131 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.741232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.741321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.741396 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.741468 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.741539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.741677 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.741758 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.741839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.741912 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.741983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.742130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.742208 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.742279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.742359 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.742432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.742503 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.742574 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.742644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.742715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.742794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.742867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.742937 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.743008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.743078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.743148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.743226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.743299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.743402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.743485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.743659 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.743744 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.743894 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.743976 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.744134 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.744213 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.744377 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.744464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.744620 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.744701 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.744847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.744924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.745082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.745170 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.745341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.745422 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.745587 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.745665 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.745822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.745913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.746072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.746152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.746307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.746386 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.746551 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.746636 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.746788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.746868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.747023 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.747102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.747269 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.747356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.747505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.747585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.747785 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.747912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.747995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.748066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.748192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.748274 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.748432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.748511 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.748671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.748763 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.748918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.748999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.749158 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.749293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.749413 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.749506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.749645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.749725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.749890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.749971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.750121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.750209 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.750355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.750436 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.750605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.750685 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.750849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.750938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.751085 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.751165 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.751323 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.751402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.751562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.751651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.751792 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.751870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.752032 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.752153 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.752290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.752379 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.752524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.752605 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.752774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.752858 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.753024 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.753114 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.753305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.753391 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.753546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.753693 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.753834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.753982 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.754096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.754275 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.754514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.754598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.754746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.754835 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.754995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.755076 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.755244 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.755324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.755494 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.755575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.755739 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.755819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.755972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.756051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.756206 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.756285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.756443 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.756527 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.756682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.756761 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.756920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.757000 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.757157 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.757292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.757418 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.757498 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.757666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.757748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.757897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.757975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.758128 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.758210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.758377 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.758459 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.758608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.758687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.758868 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.758999 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.759087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.759160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.759309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.759390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.759538 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.759617 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.759779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.759895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.760036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.760143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.760268 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.760379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.760515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.760617 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.760762 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.760862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.761008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.761115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.761264 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.761390 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.761495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.761635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.761715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.761890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.762715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.762829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.762911 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.762983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.763058 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.763128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.763274 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.763350 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.763422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.763493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.763563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.763633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] role.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.763702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.763774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] role.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.763845 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.763915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.763986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.764057 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.764135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.764208 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.764302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.764450 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.764530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.764701 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.764790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.764953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.765033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.765293 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.765389 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.765464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.765551 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.765713 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.765794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.765949 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.766029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.766200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.766289 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.766441 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.766519 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.766677 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.766757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.766912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.767001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.767148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.767315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.767395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.767557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.767646 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.767813 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.767895 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.768056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.768135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.768297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.768385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.768545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.768626 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.768780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.768859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.769013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.769100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.769809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.769903 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.770070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.770309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.770545 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.770679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.770803 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.770886 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.771037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.771162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.771294 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.771407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.771543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.771650 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.771782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.771890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] role.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.772019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.772140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] role.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.772255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.772374 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.772493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.772623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.772733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.772870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.772982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.773120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.773239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.773392 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.773472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.773639 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.773722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.773898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.773980 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.774136 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.774216 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.774385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.774470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.774618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.774697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.774865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.774945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.775110 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.775190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.775349 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.775435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.775592 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.775671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.775874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.775987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.776109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.776266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.776397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.776513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.776594 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.776764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.776849 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.connection = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.777012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.777092 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.777284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.777369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.777522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.777605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.777774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.777853 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.778025 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.778105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.778267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.778347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.778498 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.778576 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.778731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.778810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.778963 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.779045 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.779203 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.779283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.779451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.779531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.779689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.779771 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.779923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.780001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.780159 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.780245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.780391 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.780472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.780621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.780699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.780855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.780938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.781089 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.781170 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.781284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 04:23:42.781360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.781597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.781845 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.782082 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.782326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.782568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.782814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.783049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.783285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.783526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.783770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.784043 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.784274 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.784517 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.784780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.785605 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.785871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.786126 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.786367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.786611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.786848 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.787086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.787324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.787560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.787805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.788043 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.788288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.788524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.788773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.789009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.789282 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.789516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.789757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.789993 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 04:23:42.790163 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 04:23:42.812173 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.812406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.812635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.817455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.817841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.818226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.830594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.830721 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.857744 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.857970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.858125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.858362 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.912673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.912818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.961475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.961701 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.962563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:42.962801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.117897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.118122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.118324 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.118604 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.118758 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.118966 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.122830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.123065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.123291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.123515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.123736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.123955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.142579 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.142805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.142949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.143037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.143187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.143291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.143417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.143502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.143629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.143712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.143840 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.143923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.144053 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.144273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.155900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.156491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.168726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.168888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.169104 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.169189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.169346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.169447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.169560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.169643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.169771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.169853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.169982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81645) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.170067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.170269 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.170487 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81644) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 04:23:43.186694 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.186900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 04:23:43.187143 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.187228 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.187340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 04:23:43.187423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 04:23:43.187682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.187773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.187883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 04:23:43.187964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.188162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.188244 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.188418 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.188499 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.188934 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.189223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.198516 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.198793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.199062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.199189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.199343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.199470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.199749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.200035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.206315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.207678 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.209758 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.210038 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.210316 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.210594 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.210675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.210873 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.210955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.211132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.211222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.211398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.211480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.211666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.211745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.211931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.212012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.212199 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.212280 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.212460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.212549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.212841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.213122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.213422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.235745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.236913 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.237213 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.237502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.238967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.239253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.242778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.243058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.243339 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.243945 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.244230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.244515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.249812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.250094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.250927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.251214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.254290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.254582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.254866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.255153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.255416 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.255501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.255712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.255998 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.256342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.256634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.256927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.257235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.257359 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.257499 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.257659 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.257941 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.273991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.274269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.275000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.275284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.278129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.279189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.281235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.281534 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.282426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.282726 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.286500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.287516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.289621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.290690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.292719 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.293017 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.293326 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.293612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.293890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.293973 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.294266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.294350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.294696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.294989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.295281 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.295562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.310212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.310495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.310762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.311031 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.311519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.311807 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.312079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.312348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.317793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.319435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.319617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.320969 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.321167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.321267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.322713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.322992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.323857 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.324139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.324428 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.324714 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.324996 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.325646 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.325949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.326340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.326628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.326926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.337101 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.337407 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.337684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.337962 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.338241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.338513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.338802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.338998 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.339285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.339669 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.339954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.340237 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.340516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.340804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.354304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.356935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.357614 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.360765 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.361765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.362470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.364565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.364844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.365132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.365341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.366795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.368394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.368688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.368974 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.372893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.374378 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.375665 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.377155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.377255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.377525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.377805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.378075 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.380746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.381036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.381357 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.381648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.386605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.386892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.387171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.389516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.389817 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.390099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.394107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81645) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.394675 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.394957 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.395232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.395502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.395771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.396044 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.396320 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.396601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.396874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.397143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.397425 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.397688 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.397784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81644) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 04:23:43.397970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81645) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.398051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.398251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.398531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.398821 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.399110 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.399399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.399672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.399962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.400240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.400514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.400777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.401046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.401344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81644) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 04:23:43.432323 dv-cinder-855307-1-smb devstack@keystone.service[81645]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563df43519c0 pid: 81645 (default app) Aug 31 04:23:43.435887 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783746d9-206d-40e9-9b49-accb1573f5b7 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:43.436176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783746d9-206d-40e9-9b49-accb1573f5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:43.436258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563df43519c0 pid: 81644 (default app) Aug 31 04:23:43.436447 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783746d9-206d-40e9-9b49-accb1573f5b7 None None] PATH_INFO: `/v3` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:43.440589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Wed Aug 31 04:23:43 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:23:50.984907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fe53b-ebda-4e57-b5a9-109f7363df40 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:50.985463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fe53b-ebda-4e57-b5a9-109f7363df40 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:50.985463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fe53b-ebda-4e57-b5a9-109f7363df40 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:50.990528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:23:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:23:50.995939 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623397-2dbc-46f0-a30a-8699fa171e5d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:50.996375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623397-2dbc-46f0-a30a-8699fa171e5d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:50.996496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623397-2dbc-46f0-a30a-8699fa171e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:51.067677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: INFO dbcounter [None req-98623397-2dbc-46f0-a30a-8699fa171e5d None None] Registered counter for database keystone Aug 31 04:23:51.087327 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG oslo_db.sqlalchemy.engines [None req-98623397-2dbc-46f0-a30a-8699fa171e5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:23:51.093738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writer thread running {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:23:51.279093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG passlib.handlers.bcrypt [None req-98623397-2dbc-46f0-a30a-8699fa171e5d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81645) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 04:23:51.279409 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG passlib.handlers.bcrypt [None req-98623397-2dbc-46f0-a30a-8699fa171e5d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81645) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 04:23:51.339127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-98623397-2dbc-46f0-a30a-8699fa171e5d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:23:51.340715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-98623397-2dbc-46f0-a30a-8699fa171e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:23:51.473788 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:23:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 31 04:23:51.961529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fe53b-ebda-4e57-b5a9-109f7363df40 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:23:52.036319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: INFO dbcounter [None req-109fe53b-ebda-4e57-b5a9-109f7363df40 None None] Registered counter for database keystone Aug 31 04:23:52.058032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG oslo_db.sqlalchemy.engines [None req-109fe53b-ebda-4e57-b5a9-109f7363df40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 04:23:52.064220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writer thread running {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 04:23:52.187044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fe53b-ebda-4e57-b5a9-109f7363df40 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:23:52.191456 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f83f26-48f8-4095-a657-ad5627e9c818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:23:52.192198 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f83f26-48f8-4095-a657-ad5627e9c818 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:52.192478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f83f26-48f8-4095-a657-ad5627e9c818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:52.192748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f83f26-48f8-4095-a657-ad5627e9c818 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:52.200688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f83f26-48f8-4095-a657-ad5627e9c818 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:23:52.253133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: WARNING keystone.common.rbac_enforcer.enforcer [None req-10f83f26-48f8-4095-a657-ad5627e9c818 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 04:23:52.253438 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f83f26-48f8-4095-a657-ad5627e9c818 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:23:52.263436 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Wed Aug 31 04:23:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:23:52.270193 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623397-2dbc-46f0-a30a-8699fa171e5d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:23:52.285120 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623397-2dbc-46f0-a30a-8699fa171e5d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:23:52.289476 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de1d5b-3960-484e-bf4d-c556f252e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:23:52.290565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de1d5b-3960-484e-bf4d-c556f252e592 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:52.290847 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de1d5b-3960-484e-bf4d-c556f252e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:52.291128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de1d5b-3960-484e-bf4d-c556f252e592 admin admin] PATH_INFO: `/v3/projects/c036297280a949b589ef447a76452691` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:52.292693 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de1d5b-3960-484e-bf4d-c556f252e592 admin admin] RBAC: Authorizing `identity:get_project(project_id=c036297280a949b589ef447a76452691)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:23:52.346665 dv-cinder-855307-1-smb devstack@keystone.service[81645]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b0de1d5b-3960-484e-bf4d-c556f252e592 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 04:23:52.347077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de1d5b-3960-484e-bf4d-c556f252e592 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:23:52.351983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Wed Aug 31 04:23:52 2022] GET /identity/v3/projects/c036297280a949b589ef447a76452691 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:23:54.238313 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed71b8b-5e78-4c5c-836a-79615cfd8ed7 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:54.239036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed71b8b-5e78-4c5c-836a-79615cfd8ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:54.239036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed71b8b-5e78-4c5c-836a-79615cfd8ed7 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:54.243264 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:23:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:23:54.248647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55814067-5add-4213-a222-77e29f938dbe None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:54.249024 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55814067-5add-4213-a222-77e29f938dbe None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:54.249275 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55814067-5add-4213-a222-77e29f938dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:54.270054 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-55814067-5add-4213-a222-77e29f938dbe None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:23:54.271548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-55814067-5add-4213-a222-77e29f938dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:23:54.279227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:23:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 31 04:23:54.543276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed71b8b-5e78-4c5c-836a-79615cfd8ed7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:23:54.555994 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed71b8b-5e78-4c5c-836a-79615cfd8ed7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:23:54.560230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89f8dc-6e25-456c-89b7-08bcaf8dbff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:23:54.560830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89f8dc-6e25-456c-89b7-08bcaf8dbff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:54.561113 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89f8dc-6e25-456c-89b7-08bcaf8dbff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:54.561418 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89f8dc-6e25-456c-89b7-08bcaf8dbff7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:54.569014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89f8dc-6e25-456c-89b7-08bcaf8dbff7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:23:54.570812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89f8dc-6e25-456c-89b7-08bcaf8dbff7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:23:54.579391 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Wed Aug 31 04:23:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:23:54.585188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55814067-5add-4213-a222-77e29f938dbe None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:23:54.594145 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55814067-5add-4213-a222-77e29f938dbe None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:23:54.598585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142748e-9def-4e4f-a13c-6c5fc67ada1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:23:54.599200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142748e-9def-4e4f-a13c-6c5fc67ada1a admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:54.599478 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142748e-9def-4e4f-a13c-6c5fc67ada1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:54.599751 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142748e-9def-4e4f-a13c-6c5fc67ada1a admin admin] PATH_INFO: `/v3/users/f8d87aca886c4c2eb2651db46e0ae180` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:54.601066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142748e-9def-4e4f-a13c-6c5fc67ada1a admin admin] RBAC: Authorizing `identity:get_user(user_id=f8d87aca886c4c2eb2651db46e0ae180)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:23:54.602905 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142748e-9def-4e4f-a13c-6c5fc67ada1a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:23:54.604390 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Wed Aug 31 04:23:54 2022] GET /identity/v3/users/f8d87aca886c4c2eb2651db46e0ae180 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:23:56.584725 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736183e-e848-420d-a2b4-7d1855bb494e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:56.585310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736183e-e848-420d-a2b4-7d1855bb494e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:56.585310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736183e-e848-420d-a2b4-7d1855bb494e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:56.586602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:23:56.591577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6219bb-ef8b-4d47-809c-15467a70e22a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:56.591978 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6219bb-ef8b-4d47-809c-15467a70e22a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:56.592241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6219bb-ef8b-4d47-809c-15467a70e22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:56.610621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ff6219bb-ef8b-4d47-809c-15467a70e22a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:23:56.611778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ff6219bb-ef8b-4d47-809c-15467a70e22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:23:56.667011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5d31-fb28-4256-82b6-336e5e40788f None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:56.667299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5d31-fb28-4256-82b6-336e5e40788f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:56.667587 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5d31-fb28-4256-82b6-336e5e40788f None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:56.668900 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:23:56.673936 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360aa8a-9982-4d6c-b29b-e84d36a0d04b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:56.674316 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360aa8a-9982-4d6c-b29b-e84d36a0d04b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:56.674602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360aa8a-9982-4d6c-b29b-e84d36a0d04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:56.692394 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:23:56.717676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG passlib.handlers.bcrypt [None req-f360aa8a-9982-4d6c-b29b-e84d36a0d04b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81644) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 04:23:56.718072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG passlib.handlers.bcrypt [None req-f360aa8a-9982-4d6c-b29b-e84d36a0d04b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81644) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 04:23:56.767478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f360aa8a-9982-4d6c-b29b-e84d36a0d04b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:23:56.769061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f360aa8a-9982-4d6c-b29b-e84d36a0d04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:23:56.870834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:23:56.967488 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6219bb-ef8b-4d47-809c-15467a70e22a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:23:56.992939 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:23:57.077209 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6219bb-ef8b-4d47-809c-15467a70e22a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:23:57.110267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff908924-0d14-468f-8233-9761d2585974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:23:57.110884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff908924-0d14-468f-8233-9761d2585974 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:57.111163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff908924-0d14-468f-8233-9761d2585974 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:57.111435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff908924-0d14-468f-8233-9761d2585974 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:57.122638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff908924-0d14-468f-8233-9761d2585974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-ff908924-0d14-468f-8233-9761d2585974 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:23:57.131016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:23:57.131989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:23:57.132805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:23:57.132805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:23:57.132805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:23:57.132805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:23:57.132805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:23:57.132805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:23:57.132805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:23:57.132805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:23:57.132805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:23:57.132805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:23:57.132805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:23:57.132805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:23:57.132805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:23:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:23:57.137980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360aa8a-9982-4d6c-b29b-e84d36a0d04b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:23:57.151874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff908924-0d14-468f-8233-9761d2585974 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:23:57.233024 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:23:57.241124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360aa8a-9982-4d6c-b29b-e84d36a0d04b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:23:57.243501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:23:57.250835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff908924-0d14-468f-8233-9761d2585974 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:23:57.279117 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6c381-5bde-4ad2-92f9-8400071951e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:23:57.279980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6c381-5bde-4ad2-92f9-8400071951e8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:57.280261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6c381-5bde-4ad2-92f9-8400071951e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:57.280531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6c381-5bde-4ad2-92f9-8400071951e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:57.281462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6c381-5bde-4ad2-92f9-8400071951e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:23:57.281770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6c381-5bde-4ad2-92f9-8400071951e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:23:57.283198 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6c381-5bde-4ad2-92f9-8400071951e8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:23:57.286205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59657f-f380-4c8f-949c-01bdc53db631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:23:57.286816 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59657f-f380-4c8f-949c-01bdc53db631 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:57.287098 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59657f-f380-4c8f-949c-01bdc53db631 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:57.287371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59657f-f380-4c8f-949c-01bdc53db631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:57.295609 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:23:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:23:57.301600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6c381-5bde-4ad2-92f9-8400071951e8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:23:57.356227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59657f-f380-4c8f-949c-01bdc53db631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:23:57.357771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59657f-f380-4c8f-949c-01bdc53db631 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:23:57.401109 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6c381-5bde-4ad2-92f9-8400071951e8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:23:57.435332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0f9a5-4416-4497-8355-e0031483c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:23:57.436178 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f9a5-4416-4497-8355-e0031483c105 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:57.436455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f9a5-4416-4497-8355-e0031483c105 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:57.436728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f9a5-4416-4497-8355-e0031483c105 None admin] PATH_INFO: `/v3/users/f8d87aca886c4c2eb2651db46e0ae180` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:57.438212 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0f9a5-4416-4497-8355-e0031483c105 None admin] RBAC: Authorizing `identity:get_user(user_id=f8d87aca886c4c2eb2651db46e0ae180)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:23:57.438989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:23:57.439642 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0f9a5-4416-4497-8355-e0031483c105 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:23:57.441788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 9/16] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:23:57 2022] GET /identity/v3/users/f8d87aca886c4c2eb2651db46e0ae180 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:23:57.447295 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0f9a5-4416-4497-8355-e0031483c105 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:23:57.458541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 8/17] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:23:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 04:23:57.464161 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59657f-f380-4c8f-949c-01bdc53db631 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:23:57.480975 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:23:57.546004 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0f9a5-4416-4497-8355-e0031483c105 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:23:57.563533 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59657f-f380-4c8f-949c-01bdc53db631 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:23:57.579687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378375ec-5d35-4851-adea-d10c3143f89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:23:57.580318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378375ec-5d35-4851-adea-d10c3143f89a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:57.580599 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378375ec-5d35-4851-adea-d10c3143f89a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:57.580867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378375ec-5d35-4851-adea-d10c3143f89a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:57.582932 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378375ec-5d35-4851-adea-d10c3143f89a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:23:57.584188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378375ec-5d35-4851-adea-d10c3143f89a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:23:57.585774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 10/18] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:23:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:23:57.591712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378375ec-5d35-4851-adea-d10c3143f89a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:23:57.606101 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dfef1-57f7-4989-a47b-20da5845313d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:23:57.606733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dfef1-57f7-4989-a47b-20da5845313d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:57.607139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dfef1-57f7-4989-a47b-20da5845313d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:57.607281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dfef1-57f7-4989-a47b-20da5845313d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:57.617300 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dfef1-57f7-4989-a47b-20da5845313d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:23:57.618832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dfef1-57f7-4989-a47b-20da5845313d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-bb9dfef1-57f7-4989-a47b-20da5845313d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:23:57.635726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:23:57.636585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:23:57.637586 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:23:57.637586 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:23:57.637586 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:23:57.637586 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 9/19] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:23:57.642468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dfef1-57f7-4989-a47b-20da5845313d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:23:57.680491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:23:57.693697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378375ec-5d35-4851-adea-d10c3143f89a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:23:57.695268 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:23:57.727112 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee669aab-2f81-450f-87c5-517ddb17f146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:23:57.727724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee669aab-2f81-450f-87c5-517ddb17f146 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:57.728005 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee669aab-2f81-450f-87c5-517ddb17f146 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:57.728279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee669aab-2f81-450f-87c5-517ddb17f146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:57.728998 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee669aab-2f81-450f-87c5-517ddb17f146 None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.domain.id=default, user.id=f8d87aca886c4c2eb2651db46e0ae180) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:23:57.729333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee669aab-2f81-450f-87c5-517ddb17f146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:23:57.730773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee669aab-2f81-450f-87c5-517ddb17f146 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:23:57.739005 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 11/20] 10.222.0.39 () {56 vars in 1322 bytes} [Wed Aug 31 04:23:57 2022] GET /identity/v3/role_assignments?user.id=f8d87aca886c4c2eb2651db46e0ae180&scope.domain.id=default&role.id=1896db68dc754d5293037ab100ce46d9 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:23:57.746235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dfef1-57f7-4989-a47b-20da5845313d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:23:57.784807 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe1f83-f147-4d1c-bb43-921413bbcce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:23:57.786602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe1f83-f147-4d1c-bb43-921413bbcce3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:23:57.786932 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe1f83-f147-4d1c-bb43-921413bbcce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:23:57.787213 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe1f83-f147-4d1c-bb43-921413bbcce3 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:23:57.787920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe1f83-f147-4d1c-bb43-921413bbcce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:23:57.788226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe1f83-f147-4d1c-bb43-921413bbcce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:23:57.789712 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe1f83-f147-4d1c-bb43-921413bbcce3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:23:57.809566 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 10/21] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:00.042798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592a31a-528a-4473-b92d-ce64a03c1a52 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:00.043721 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592a31a-528a-4473-b92d-ce64a03c1a52 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:00.044198 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592a31a-528a-4473-b92d-ce64a03c1a52 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:00.045927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 12/22] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:00.058908 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf57a94-b939-4724-871a-fd383d052a3d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:00.059662 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf57a94-b939-4724-871a-fd383d052a3d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:00.060083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf57a94-b939-4724-871a-fd383d052a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:00.092241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9cf57a94-b939-4724-871a-fd383d052a3d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:00.093822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9cf57a94-b939-4724-871a-fd383d052a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:00.195564 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 11/23] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:00.236773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96878faf-0e89-43f3-b386-75d9c15219de None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:00.237341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96878faf-0e89-43f3-b386-75d9c15219de None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:00.237768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96878faf-0e89-43f3-b386-75d9c15219de None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:00.239338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:00.255968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216abe31-887c-4479-9298-95bfb50c1c63 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:00.256462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216abe31-887c-4479-9298-95bfb50c1c63 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:00.256881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216abe31-887c-4479-9298-95bfb50c1c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:00.286066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbb568-e76e-4e86-b231-0bfa31b30b2b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:00.286597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbb568-e76e-4e86-b231-0bfa31b30b2b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:00.287024 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbb568-e76e-4e86-b231-0bfa31b30b2b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:00.288479 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 14/25] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:24:00.289473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-216abe31-887c-4479-9298-95bfb50c1c63 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:00.290817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-216abe31-887c-4479-9298-95bfb50c1c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:00.306703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed7f11-ad21-44a6-8d85-61da60dd3e23 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:00.307196 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed7f11-ad21-44a6-8d85-61da60dd3e23 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:00.307606 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed7f11-ad21-44a6-8d85-61da60dd3e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:00.334099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-52ed7f11-ad21-44a6-8d85-61da60dd3e23 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:00.339705 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-52ed7f11-ad21-44a6-8d85-61da60dd3e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:00.340176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:00.446869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 12/26] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:00.482547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 15/27] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:00.559120 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216abe31-887c-4479-9298-95bfb50c1c63 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:00.684810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216abe31-887c-4479-9298-95bfb50c1c63 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:00.733894 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2ce7c-2e9b-4767-8ec8-a9532033bf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:00.734531 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2ce7c-2e9b-4767-8ec8-a9532033bf28 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:00.734805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2ce7c-2e9b-4767-8ec8-a9532033bf28 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:00.735074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2ce7c-2e9b-4767-8ec8-a9532033bf28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:00.750092 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2ce7c-2e9b-4767-8ec8-a9532033bf28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-9ef2ce7c-2e9b-4767-8ec8-a9532033bf28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:00.755582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:00.756486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:00.757303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:00.757303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:00.757303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:00.757303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:00.757303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:00.757303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:00.757303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:00.757303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:00.757303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:00.757303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:00.757303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:00.757303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:00.757303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 13/28] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:24:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:00.763859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed7f11-ad21-44a6-8d85-61da60dd3e23 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:00.846452 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcbefa-213e-4a41-80dc-932b2173da90 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:00.846734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcbefa-213e-4a41-80dc-932b2173da90 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:00.846910 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcbefa-213e-4a41-80dc-932b2173da90 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:00.848300 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 14/29] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:24:00.853709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ca76a-576b-4f2e-b98b-9e86e21e6c4d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:00.853990 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ca76a-576b-4f2e-b98b-9e86e21e6c4d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:00.854264 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ca76a-576b-4f2e-b98b-9e86e21e6c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:00.888444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-341ca76a-576b-4f2e-b98b-9e86e21e6c4d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:00.889688 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-341ca76a-576b-4f2e-b98b-9e86e21e6c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:00.907143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:00.924754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:00.933867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed7f11-ad21-44a6-8d85-61da60dd3e23 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:00.977641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c61879-c9fb-4dcd-b6bf-9aa938cc9eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:00.978269 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c61879-c9fb-4dcd-b6bf-9aa938cc9eea None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:00.978664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c61879-c9fb-4dcd-b6bf-9aa938cc9eea None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:00.978951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c61879-c9fb-4dcd-b6bf-9aa938cc9eea None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:00.979626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c61879-c9fb-4dcd-b6bf-9aa938cc9eea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:00.979948 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c61879-c9fb-4dcd-b6bf-9aa938cc9eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:00.981345 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c61879-c9fb-4dcd-b6bf-9aa938cc9eea None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:00.984522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 15/30] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:00.985640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ca76a-576b-4f2e-b98b-9e86e21e6c4d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:01.000890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 16/31] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:01.001823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c61879-c9fb-4dcd-b6bf-9aa938cc9eea None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:01.140978 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ca76a-576b-4f2e-b98b-9e86e21e6c4d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:01.214992 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7d45a-cb6f-40c2-90b2-1d95f822718b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:01.216875 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7d45a-cb6f-40c2-90b2-1d95f822718b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:01.218432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7d45a-cb6f-40c2-90b2-1d95f822718b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:01.218938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7d45a-cb6f-40c2-90b2-1d95f822718b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:01.221209 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c61879-c9fb-4dcd-b6bf-9aa938cc9eea None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:01.238942 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7d45a-cb6f-40c2-90b2-1d95f822718b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:01.240741 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7d45a-cb6f-40c2-90b2-1d95f822718b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:01.261553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:01.261961 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6158978-36f9-43f6-9e0b-f3c2316538fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:01.262788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6158978-36f9-43f6-9e0b-f3c2316538fc None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:01.263223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6158978-36f9-43f6-9e0b-f3c2316538fc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:01.263658 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6158978-36f9-43f6-9e0b-f3c2316538fc None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:01.264478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6158978-36f9-43f6-9e0b-f3c2316538fc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:01.266135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6158978-36f9-43f6-9e0b-f3c2316538fc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-3fc7d45a-cb6f-40c2-90b2-1d95f822718b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:24:01.272066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:01.273140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:24:01.274223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:24:01.274223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:24:01.274223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:01.277570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 16/32] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:01.278431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7d45a-cb6f-40c2-90b2-1d95f822718b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:01.392935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7d45a-cb6f-40c2-90b2-1d95f822718b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:01.430434 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63424e-4160-4d21-8391-3339d333f95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:01.431114 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63424e-4160-4d21-8391-3339d333f95e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:01.431401 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63424e-4160-4d21-8391-3339d333f95e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:01.431680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63424e-4160-4d21-8391-3339d333f95e None admin] PATH_INFO: `/v3/users/f8d87aca886c4c2eb2651db46e0ae180` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:01.432840 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63424e-4160-4d21-8391-3339d333f95e None admin] RBAC: Authorizing `identity:get_user(user_id=f8d87aca886c4c2eb2651db46e0ae180)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:01.434339 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63424e-4160-4d21-8391-3339d333f95e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:01.440605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 17/33] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:01 2022] GET /identity/v3/users/f8d87aca886c4c2eb2651db46e0ae180 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:01.441626 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63424e-4160-4d21-8391-3339d333f95e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:01.486173 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 17/34] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 31 04:24:01 2022] POST /identity/v3/roles => generated 219 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:24:01.487544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6158978-36f9-43f6-9e0b-f3c2316538fc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:01.529577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:01.531455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:01.615482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63424e-4160-4d21-8391-3339d333f95e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:01.659137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6158978-36f9-43f6-9e0b-f3c2316538fc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:01.665699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dc1fc-1e21-455f-b961-defa81c9dd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:01.666315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dc1fc-1e21-455f-b961-defa81c9dd26 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:01.666590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dc1fc-1e21-455f-b961-defa81c9dd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:01.666858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dc1fc-1e21-455f-b961-defa81c9dd26 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:01.667511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dc1fc-1e21-455f-b961-defa81c9dd26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:01.667808 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dc1fc-1e21-455f-b961-defa81c9dd26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:01.669675 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dc1fc-1e21-455f-b961-defa81c9dd26 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:01.688469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 18/35] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:01.689757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dc1fc-1e21-455f-b961-defa81c9dd26 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:01.709768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb758c-4358-4f2e-8778-a03d6a4bd5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:01.710388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb758c-4358-4f2e-8778-a03d6a4bd5a1 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:01.710674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb758c-4358-4f2e-8778-a03d6a4bd5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:01.710951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb758c-4358-4f2e-8778-a03d6a4bd5a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:01.711631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb758c-4358-4f2e-8778-a03d6a4bd5a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:01.713149 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb758c-4358-4f2e-8778-a03d6a4bd5a1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:01.771251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 18/36] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 31 04:24:01 2022] POST /identity/v3/roles => generated 225 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:24:01.772624 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44af95-81a8-4cd0-a880-f3727b861f2b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:01.772915 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44af95-81a8-4cd0-a880-f3727b861f2b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:01.773190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44af95-81a8-4cd0-a880-f3727b861f2b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:01.774440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 19/37] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:01.775662 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af76480-9188-4ca8-99b2-10b7812489fd None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:01.775946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af76480-9188-4ca8-99b2-10b7812489fd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:01.776218 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af76480-9188-4ca8-99b2-10b7812489fd None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:01.781844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 20/38] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:01.781844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af76480-9188-4ca8-99b2-10b7812489fd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:01.811316 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dc1fc-1e21-455f-b961-defa81c9dd26 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:01.840596 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:01.852647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbaf60-1ee7-4c4a-82fb-c7f7f60074f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:01.853341 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbaf60-1ee7-4c4a-82fb-c7f7f60074f7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:01.853621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbaf60-1ee7-4c4a-82fb-c7f7f60074f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:01.853893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbaf60-1ee7-4c4a-82fb-c7f7f60074f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:01.855266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbaf60-1ee7-4c4a-82fb-c7f7f60074f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:01.856785 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbaf60-1ee7-4c4a-82fb-c7f7f60074f7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:01.863186 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 19/39] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:01.863186 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668c192-d7cd-49a6-851c-0e98e2dffa47 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:01.863186 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668c192-d7cd-49a6-851c-0e98e2dffa47 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:01.863186 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668c192-d7cd-49a6-851c-0e98e2dffa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:01.883603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7668c192-d7cd-49a6-851c-0e98e2dffa47 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:01.884886 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7668c192-d7cd-49a6-851c-0e98e2dffa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:01.889286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:01.915185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af76480-9188-4ca8-99b2-10b7812489fd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:01.959966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ddf8b-6a67-4c7f-b3dc-81b1df915e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:01.960585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ddf8b-6a67-4c7f-b3dc-81b1df915e54 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:01.964064 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ddf8b-6a67-4c7f-b3dc-81b1df915e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:01.964064 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ddf8b-6a67-4c7f-b3dc-81b1df915e54 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:01.964064 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ddf8b-6a67-4c7f-b3dc-81b1df915e54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:01.964064 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ddf8b-6a67-4c7f-b3dc-81b1df915e54 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:01.966292 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 20/40] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:01.967676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7709aaa-901c-42e5-bfea-328d2bcb923e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:01.967974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7709aaa-901c-42e5-bfea-328d2bcb923e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:01.968252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7709aaa-901c-42e5-bfea-328d2bcb923e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:01.990654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a7709aaa-901c-42e5-bfea-328d2bcb923e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:01.991955 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a7709aaa-901c-42e5-bfea-328d2bcb923e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:02.064379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 21/41] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:02.073347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7709aaa-901c-42e5-bfea-328d2bcb923e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:02.088000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 21/42] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 31 04:24:01 2022] POST /identity/v3/projects => generated 301 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:24:02.138812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:02.193945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7709aaa-901c-42e5-bfea-328d2bcb923e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:02.234477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c68ff-0c9a-4c4a-911b-47b81c343128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:02.235514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c68ff-0c9a-4c4a-911b-47b81c343128 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:02.236011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c68ff-0c9a-4c4a-911b-47b81c343128 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:02.236506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c68ff-0c9a-4c4a-911b-47b81c343128 None admin] PATH_INFO: `/v3/domains/default/users/f8d87aca886c4c2eb2651db46e0ae180/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:02.239594 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c68ff-0c9a-4c4a-911b-47b81c343128 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f8d87aca886c4c2eb2651db46e0ae180, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:02.241051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c68ff-0c9a-4c4a-911b-47b81c343128 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:02.250012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ddf8b-6a67-4c7f-b3dc-81b1df915e54 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:02.363876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ddf8b-6a67-4c7f-b3dc-81b1df915e54 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:02.393556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:02.400642 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e442825-d534-4731-b924-c7fedb257548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:02.401289 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e442825-d534-4731-b924-c7fedb257548 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:02.401572 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e442825-d534-4731-b924-c7fedb257548 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:02.401846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e442825-d534-4731-b924-c7fedb257548 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:02.402530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e442825-d534-4731-b924-c7fedb257548 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:02.403950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e442825-d534-4731-b924-c7fedb257548 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:02.481730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 22/43] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 31 04:24:02 2022] POST /identity/v3/roles => generated 223 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:24:02.482500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e442825-d534-4731-b924-c7fedb257548 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:02.561770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 22/44] 10.222.0.39 () {58 vars in 1361 bytes} [Wed Aug 31 04:24:02 2022] PUT /identity/v3/domains/default/users/f8d87aca886c4c2eb2651db46e0ae180/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:24:02.601944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e442825-d534-4731-b924-c7fedb257548 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:02.645088 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94a313-4003-4b87-86da-a2af9d397cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:02.645799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94a313-4003-4b87-86da-a2af9d397cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:02.646170 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94a313-4003-4b87-86da-a2af9d397cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:02.646451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94a313-4003-4b87-86da-a2af9d397cc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:02.647629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94a313-4003-4b87-86da-a2af9d397cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:02.649097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94a313-4003-4b87-86da-a2af9d397cc0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:02.650758 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 23/45] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:02.656993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c68ff-0c9a-4c4a-911b-47b81c343128 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:02.766099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c68ff-0c9a-4c4a-911b-47b81c343128 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:02.780790 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:02.801879 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a2884-04d7-4964-a168-fea617865955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:02.802484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2884-04d7-4964-a168-fea617865955 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:02.802765 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2884-04d7-4964-a168-fea617865955 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:02.803037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2884-04d7-4964-a168-fea617865955 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:02.803700 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a2884-04d7-4964-a168-fea617865955 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:02.805461 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a2884-04d7-4964-a168-fea617865955 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:02.890627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 31 04:24:02 2022] POST /identity/v3/projects => generated 312 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:24:04.481270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68783aef-03aa-46b5-8c79-424568595f84 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:04.481768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68783aef-03aa-46b5-8c79-424568595f84 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:04.481768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68783aef-03aa-46b5-8c79-424568595f84 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:04.483081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 24/47] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:04.489181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b05e49-9cf1-4e81-908e-0b4ac8682b38 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:04.489631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b05e49-9cf1-4e81-908e-0b4ac8682b38 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:04.489825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b05e49-9cf1-4e81-908e-0b4ac8682b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:04.508435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e8b05e49-9cf1-4e81-908e-0b4ac8682b38 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:04.509957 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e8b05e49-9cf1-4e81-908e-0b4ac8682b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:04.575151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 24/48] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:04.797147 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c503753-331a-4d59-a8bf-c2885284c4d7 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:04.803401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c503753-331a-4d59-a8bf-c2885284c4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:04.803401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c503753-331a-4d59-a8bf-c2885284c4d7 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:04.803401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 25/49] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:04.805411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6b5da-f1d6-4f0e-a61e-015007a4cd23 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:04.805704 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6b5da-f1d6-4f0e-a61e-015007a4cd23 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:04.805979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6b5da-f1d6-4f0e-a61e-015007a4cd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:04.824002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bba6b5da-f1d6-4f0e-a61e-015007a4cd23 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:04.825182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bba6b5da-f1d6-4f0e-a61e-015007a4cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:04.843743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c503753-331a-4d59-a8bf-c2885284c4d7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:04.893827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 25/50] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:04.902988 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:04.946177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c503753-331a-4d59-a8bf-c2885284c4d7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:04.980369 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1179b-121f-4b8e-ab5b-595b96a2e6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:04.980997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1179b-121f-4b8e-ab5b-595b96a2e6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:04.981317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1179b-121f-4b8e-ab5b-595b96a2e6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:04.981595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1179b-121f-4b8e-ab5b-595b96a2e6b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:04.992664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1179b-121f-4b8e-ab5b-595b96a2e6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-82e1179b-121f-4b8e-ab5b-595b96a2e6b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:05.001417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:05.002244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:05.002986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:05.002986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:05.002986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:05.002986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:05.002986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:05.002986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:05.002986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:05.002986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:05.002986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:05.002986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:05.002986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:05.002986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:05.002986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 26/51] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:24:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:24:05.009185 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6b5da-f1d6-4f0e-a61e-015007a4cd23 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:05.034699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:05.112141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6b5da-f1d6-4f0e-a61e-015007a4cd23 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:05.147562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17699f-c9d5-41b6-bd8c-39b778621b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:05.148165 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17699f-c9d5-41b6-bd8c-39b778621b63 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:05.148446 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17699f-c9d5-41b6-bd8c-39b778621b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:05.148718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17699f-c9d5-41b6-bd8c-39b778621b63 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:05.149408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17699f-c9d5-41b6-bd8c-39b778621b63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:05.149711 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17699f-c9d5-41b6-bd8c-39b778621b63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:05.151099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17699f-c9d5-41b6-bd8c-39b778621b63 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:05.162743 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 26/52] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:05.166219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1179b-121f-4b8e-ab5b-595b96a2e6b3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:05.167996 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17699f-c9d5-41b6-bd8c-39b778621b63 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:05.257068 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:05.267958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1179b-121f-4b8e-ab5b-595b96a2e6b3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:05.272042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17699f-c9d5-41b6-bd8c-39b778621b63 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:05.286089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:05.303407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b03d3-839a-4a39-95e9-7ba1af480b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:05.304040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b03d3-839a-4a39-95e9-7ba1af480b6a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:05.304325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b03d3-839a-4a39-95e9-7ba1af480b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:05.304664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b03d3-839a-4a39-95e9-7ba1af480b6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:05.305744 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b03d3-839a-4a39-95e9-7ba1af480b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:05.306097 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb15a38-7ad8-45a2-b973-d556a18b601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:05.306734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb15a38-7ad8-45a2-b973-d556a18b601b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:05.307019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb15a38-7ad8-45a2-b973-d556a18b601b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:05.307224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b03d3-839a-4a39-95e9-7ba1af480b6a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:05.307326 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb15a38-7ad8-45a2-b973-d556a18b601b None admin] PATH_INFO: `/v3/users/f8d87aca886c4c2eb2651db46e0ae180` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:05.308509 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb15a38-7ad8-45a2-b973-d556a18b601b None admin] RBAC: Authorizing `identity:get_user(user_id=f8d87aca886c4c2eb2651db46e0ae180)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:05.308796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 27/53] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:05.309993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb15a38-7ad8-45a2-b973-d556a18b601b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:05.316417 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 27/54] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:05 2022] GET /identity/v3/users/f8d87aca886c4c2eb2651db46e0ae180 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:05.316563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b03d3-839a-4a39-95e9-7ba1af480b6a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:05.317336 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb15a38-7ad8-45a2-b973-d556a18b601b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:05.418452 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb15a38-7ad8-45a2-b973-d556a18b601b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:05.421521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b03d3-839a-4a39-95e9-7ba1af480b6a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:05.453330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248c07b-7d1b-4853-b1be-623d3179469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:05.453956 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248c07b-7d1b-4853-b1be-623d3179469c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:05.454241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248c07b-7d1b-4853-b1be-623d3179469c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:05.454513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248c07b-7d1b-4853-b1be-623d3179469c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:05.454743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efdea4-5aad-4e0b-9d39-23f4c0b7334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:05.455356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efdea4-5aad-4e0b-9d39-23f4c0b7334a None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:05.455625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248c07b-7d1b-4853-b1be-623d3179469c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:05.455714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efdea4-5aad-4e0b-9d39-23f4c0b7334a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:05.455903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efdea4-5aad-4e0b-9d39-23f4c0b7334a None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:05.456563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efdea4-5aad-4e0b-9d39-23f4c0b7334a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:05.457643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248c07b-7d1b-4853-b1be-623d3179469c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:05.458027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efdea4-5aad-4e0b-9d39-23f4c0b7334a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:05.459205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 28/55] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:05.464897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248c07b-7d1b-4853-b1be-623d3179469c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:05.489974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:05.544383 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 28/56] 10.222.0.39 () {60 vars in 1140 bytes} [Wed Aug 31 04:24:05 2022] POST /identity/v3/projects => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:24:05.566815 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248c07b-7d1b-4853-b1be-623d3179469c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:05.602760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baced0a-a8e3-4d1f-8d74-4d704bd5a3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:05.603390 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baced0a-a8e3-4d1f-8d74-4d704bd5a3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:05.603664 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baced0a-a8e3-4d1f-8d74-4d704bd5a3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:05.603934 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baced0a-a8e3-4d1f-8d74-4d704bd5a3a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:05.604676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baced0a-a8e3-4d1f-8d74-4d704bd5a3a8 None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.domain.id=default, user.id=f8d87aca886c4c2eb2651db46e0ae180) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:05.604984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baced0a-a8e3-4d1f-8d74-4d704bd5a3a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:05.606497 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baced0a-a8e3-4d1f-8d74-4d704bd5a3a8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:05.614555 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 29/57] 10.222.0.39 () {56 vars in 1322 bytes} [Wed Aug 31 04:24:05 2022] GET /identity/v3/role_assignments?user.id=f8d87aca886c4c2eb2651db46e0ae180&scope.domain.id=default&role.id=1896db68dc754d5293037ab100ce46d9 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:07.498610 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc38b2-99c3-438a-b7bb-27f4c8f95731 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:07.499102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc38b2-99c3-438a-b7bb-27f4c8f95731 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:07.499102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc38b2-99c3-438a-b7bb-27f4c8f95731 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:07.500424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 29/58] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:07.506464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75613601-3305-491e-ad5c-5f5330f98445 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:07.506881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75613601-3305-491e-ad5c-5f5330f98445 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:07.507030 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75613601-3305-491e-ad5c-5f5330f98445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:07.525166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-75613601-3305-491e-ad5c-5f5330f98445 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:07.526379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-75613601-3305-491e-ad5c-5f5330f98445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:07.590698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 30/59] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:07.868903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc38b2-99c3-438a-b7bb-27f4c8f95731 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:07.912041 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:08.078710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc38b2-99c3-438a-b7bb-27f4c8f95731 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:08.113603 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc658635-6f16-4431-b927-e66f73924def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:08.114228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc658635-6f16-4431-b927-e66f73924def None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:08.114511 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc658635-6f16-4431-b927-e66f73924def None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:08.114789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc658635-6f16-4431-b927-e66f73924def None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:08.115910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc658635-6f16-4431-b927-e66f73924def None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:08.117441 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc658635-6f16-4431-b927-e66f73924def None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:08.119063 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 30/60] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:08.124527 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75613601-3305-491e-ad5c-5f5330f98445 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:08.141821 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:08.224342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75613601-3305-491e-ad5c-5f5330f98445 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:08.256846 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ebab4-32f3-4cd8-857c-afc9285ffc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:08.257476 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ebab4-32f3-4cd8-857c-afc9285ffc6f None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:08.257767 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ebab4-32f3-4cd8-857c-afc9285ffc6f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:08.258046 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ebab4-32f3-4cd8-857c-afc9285ffc6f None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:08.258709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ebab4-32f3-4cd8-857c-afc9285ffc6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:08.260148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ebab4-32f3-4cd8-857c-afc9285ffc6f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:08.354967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 31/61] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:24:08 2022] POST /identity/v3/users => generated 275 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:24:11.176105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69efd5-de36-43ea-a67c-d4c7616bb088 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:11.176617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69efd5-de36-43ea-a67c-d4c7616bb088 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:11.176722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69efd5-de36-43ea-a67c-d4c7616bb088 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:11.178062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 31/62] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:11.183565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fc2e9-2dab-429b-ab68-57175ef4d654 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:11.183964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fc2e9-2dab-429b-ab68-57175ef4d654 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:11.184144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fc2e9-2dab-429b-ab68-57175ef4d654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:11.215326 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ee9fc2e9-2dab-429b-ab68-57175ef4d654 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:11.216546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ee9fc2e9-2dab-429b-ab68-57175ef4d654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:11.309906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 32/63] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:11.624298 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69efd5-de36-43ea-a67c-d4c7616bb088 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:11.662099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dccd4c-6cbd-45d6-a2fc-d6d1cbf67e09 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:11.662715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dccd4c-6cbd-45d6-a2fc-d6d1cbf67e09 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:11.663207 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dccd4c-6cbd-45d6-a2fc-d6d1cbf67e09 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:11.665000 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 33/64] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:11.685027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf16cfb-530e-4fb5-b9e2-c0fdf35892d7 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:11.685666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf16cfb-530e-4fb5-b9e2-c0fdf35892d7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:11.686153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf16cfb-530e-4fb5-b9e2-c0fdf35892d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:11.719802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-faf16cfb-530e-4fb5-b9e2-c0fdf35892d7 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:11.721021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-faf16cfb-530e-4fb5-b9e2-c0fdf35892d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:11.724229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:11.786869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69efd5-de36-43ea-a67c-d4c7616bb088 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:11.794642 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:11.818658 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 34/65] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:11.820275 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36234921-d150-445a-8d4e-4bf2376d4963 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:11.820567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36234921-d150-445a-8d4e-4bf2376d4963 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:11.820845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36234921-d150-445a-8d4e-4bf2376d4963 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:11.822117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 35/66] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:11.823384 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d571d-2906-473f-9a80-12e8de26f496 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:11.823881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d571d-2906-473f-9a80-12e8de26f496 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:11.824354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d571d-2906-473f-9a80-12e8de26f496 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:11.829841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 36/67] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:11.830545 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e540-79d9-41fa-b895-3ae03f420e78 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:11.830835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e540-79d9-41fa-b895-3ae03f420e78 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:11.831110 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e540-79d9-41fa-b895-3ae03f420e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:11.836293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e9eaf-9b9b-437b-b33b-6e9be8b96206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:11.837188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e9eaf-9b9b-437b-b33b-6e9be8b96206 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:11.837688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e9eaf-9b9b-437b-b33b-6e9be8b96206 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:11.838154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e9eaf-9b9b-437b-b33b-6e9be8b96206 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:11.849665 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e9eaf-9b9b-437b-b33b-6e9be8b96206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:11.854294 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6225e540-79d9-41fa-b895-3ae03f420e78 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6d9e9eaf-9b9b-437b-b33b-6e9be8b96206 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:11.854952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:11.855779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:11.856529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:11.856529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:11.856529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:11.856529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:11.856529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:11.856529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:11.856529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:11.856529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:11.856529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:11.856529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:11.856529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:11.856529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:11.857117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6225e540-79d9-41fa-b895-3ae03f420e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:11.858898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 32/68] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:11.860811 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477437-8f5b-423a-9784-0d9c3e81c84e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:11.861344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477437-8f5b-423a-9784-0d9c3e81c84e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:11.861826 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477437-8f5b-423a-9784-0d9c3e81c84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:11.881359 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-41477437-8f5b-423a-9784-0d9c3e81c84e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:11.882623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-41477437-8f5b-423a-9784-0d9c3e81c84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:11.945349 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 37/69] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:11.946608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225e540-79d9-41fa-b895-3ae03f420e78 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:11.970901 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 33/70] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:12.048287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:12.100371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41477437-8f5b-423a-9784-0d9c3e81c84e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:12.120416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225e540-79d9-41fa-b895-3ae03f420e78 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:12.163707 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ff20b-6fa5-4bbe-b4c6-8188b0f472e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:12.164258 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff20b-6fa5-4bbe-b4c6-8188b0f472e1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:12.164537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff20b-6fa5-4bbe-b4c6-8188b0f472e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:12.164806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff20b-6fa5-4bbe-b4c6-8188b0f472e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:12.165505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ff20b-6fa5-4bbe-b4c6-8188b0f472e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:12.165982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ff20b-6fa5-4bbe-b4c6-8188b0f472e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:12.167559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ff20b-6fa5-4bbe-b4c6-8188b0f472e1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:12.176359 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 38/71] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:12.177888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95c07a-d897-4a40-9fbf-c1c59f14a8cb None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:12.178333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95c07a-d897-4a40-9fbf-c1c59f14a8cb None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:12.178755 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95c07a-d897-4a40-9fbf-c1c59f14a8cb None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:12.180090 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 39/72] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:12.186288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95c07a-d897-4a40-9fbf-c1c59f14a8cb None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:12.232101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:12.239827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41477437-8f5b-423a-9784-0d9c3e81c84e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:12.282588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033d202-d1d8-4d0a-be4a-56e0afc07d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:12.283232 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033d202-d1d8-4d0a-be4a-56e0afc07d19 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:12.283513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033d202-d1d8-4d0a-be4a-56e0afc07d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:12.283789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033d202-d1d8-4d0a-be4a-56e0afc07d19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:12.297812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033d202-d1d8-4d0a-be4a-56e0afc07d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:12.298253 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95c07a-d897-4a40-9fbf-c1c59f14a8cb None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4033d202-d1d8-4d0a-be4a-56e0afc07d19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:12.303852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:12.304702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:12.305493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:12.305493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:12.305493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:12.305493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:12.305493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:12.305493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:12.305493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:12.305493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:12.305493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:12.305493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:12.305493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:12.305493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:12.305493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 34/73] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:24:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:24:12.306127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f1d1-8ec9-4fa6-a960-a555b006c4d3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:12.307302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f1d1-8ec9-4fa6-a960-a555b006c4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:12.307302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f1d1-8ec9-4fa6-a960-a555b006c4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:12.324856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f444f1d1-8ec9-4fa6-a960-a555b006c4d3 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:12.326080 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f444f1d1-8ec9-4fa6-a960-a555b006c4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:12.328056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:12.339263 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800335a-047f-4e1d-9451-213555b19a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:12.339892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800335a-047f-4e1d-9451-213555b19a48 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:12.340172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800335a-047f-4e1d-9451-213555b19a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:12.340444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800335a-047f-4e1d-9451-213555b19a48 None admin] PATH_INFO: `/v3/users/d2e3112275334ef6a07084887adb4bfc` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:12.356344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800335a-047f-4e1d-9451-213555b19a48 None admin] RBAC: Authorizing `identity:get_user(user_id=d2e3112275334ef6a07084887adb4bfc)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:12.357953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800335a-047f-4e1d-9451-213555b19a48 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:12.359588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 40/74] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:12 2022] GET /identity/v3/users/d2e3112275334ef6a07084887adb4bfc => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:12.360347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800335a-047f-4e1d-9451-213555b19a48 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:12.396451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 35/75] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:12.397345 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444f1d1-8ec9-4fa6-a960-a555b006c4d3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:12.463486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800335a-047f-4e1d-9451-213555b19a48 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:12.492864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:12.500871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63973631-643e-4b49-9a61-99c0d1c3e93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:12.501552 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63973631-643e-4b49-9a61-99c0d1c3e93f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:12.501838 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63973631-643e-4b49-9a61-99c0d1c3e93f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:12.506761 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63973631-643e-4b49-9a61-99c0d1c3e93f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:12.512304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444f1d1-8ec9-4fa6-a960-a555b006c4d3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:12.512493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63973631-643e-4b49-9a61-99c0d1c3e93f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-63973631-643e-4b49-9a61-99c0d1c3e93f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:12.517377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:12.518221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:12.519047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:12.519047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:12.519047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:12.519047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:12.519047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:12.519047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:12.519047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:12.519047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:12.519047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:12.519047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:12.519047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:12.519047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:12.519047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 41/76] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:24:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:12.519771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63973631-643e-4b49-9a61-99c0d1c3e93f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:12.553775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37474c-7cd1-4e60-bcca-ea2367a837ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:12.554397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37474c-7cd1-4e60-bcca-ea2367a837ad None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:12.554670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37474c-7cd1-4e60-bcca-ea2367a837ad None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:12.554947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37474c-7cd1-4e60-bcca-ea2367a837ad None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:12.555615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37474c-7cd1-4e60-bcca-ea2367a837ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:12.555921 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37474c-7cd1-4e60-bcca-ea2367a837ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:12.557317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37474c-7cd1-4e60-bcca-ea2367a837ad None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:12.569254 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 36/77] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:24:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:12.569254 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37474c-7cd1-4e60-bcca-ea2367a837ad None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:12.572209 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:12.634906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63973631-643e-4b49-9a61-99c0d1c3e93f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:12.672657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d537d61-ed6a-4d84-9dbb-c4a8377ab8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:12.672975 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37474c-7cd1-4e60-bcca-ea2367a837ad None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:12.673322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537d61-ed6a-4d84-9dbb-c4a8377ab8bb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:12.673609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537d61-ed6a-4d84-9dbb-c4a8377ab8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:12.673888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537d61-ed6a-4d84-9dbb-c4a8377ab8bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:12.684719 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d537d61-ed6a-4d84-9dbb-c4a8377ab8bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-9d537d61-ed6a-4d84-9dbb-c4a8377ab8bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:12.689734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:12.690584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:12.691381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:12.691381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:12.691381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:12.691381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:12.691381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:12.691381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:12.691381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:12.691381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:12.691381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:12.691381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:12.691381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:12.691381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:12.691381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 42/78] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:12.692006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d537d61-ed6a-4d84-9dbb-c4a8377ab8bb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:12.708318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5584d-4d5c-4902-8b2f-6f0c6275ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:12.708931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5584d-4d5c-4902-8b2f-6f0c6275ad93 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:12.709225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5584d-4d5c-4902-8b2f-6f0c6275ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:12.709519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5584d-4d5c-4902-8b2f-6f0c6275ad93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:12.727664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:12.777224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5584d-4d5c-4902-8b2f-6f0c6275ad93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:12.778680 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5584d-4d5c-4902-8b2f-6f0c6275ad93 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:12.793536 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d537d61-ed6a-4d84-9dbb-c4a8377ab8bb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:12.795165 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:12.827791 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7e2a4-4730-41ac-b54a-cc31e26a75a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:12.828412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7e2a4-4730-41ac-b54a-cc31e26a75a1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:12.828912 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7e2a4-4730-41ac-b54a-cc31e26a75a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:12.829218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7e2a4-4730-41ac-b54a-cc31e26a75a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:12.830202 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7e2a4-4730-41ac-b54a-cc31e26a75a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:12.830512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7e2a4-4730-41ac-b54a-cc31e26a75a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:12.832545 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7e2a4-4730-41ac-b54a-cc31e26a75a1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:12.840455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 43/79] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:12.841267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7e2a4-4730-41ac-b54a-cc31e26a75a1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:12.876233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 37/80] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:12.877070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5584d-4d5c-4902-8b2f-6f0c6275ad93 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:12.925157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:12.948477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7e2a4-4730-41ac-b54a-cc31e26a75a1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:12.975164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5584d-4d5c-4902-8b2f-6f0c6275ad93 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:12.981312 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dba587-5d46-43d0-ba50-ed078b5e18e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:12.981863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dba587-5d46-43d0-ba50-ed078b5e18e7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:12.982140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dba587-5d46-43d0-ba50-ed078b5e18e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:12.982421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dba587-5d46-43d0-ba50-ed078b5e18e7 None admin] PATH_INFO: `/v3/users/d2e3112275334ef6a07084887adb4bfc` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:12.983539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dba587-5d46-43d0-ba50-ed078b5e18e7 None admin] RBAC: Authorizing `identity:get_user(user_id=d2e3112275334ef6a07084887adb4bfc)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:12.984991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dba587-5d46-43d0-ba50-ed078b5e18e7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:12.986590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 44/81] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:12 2022] GET /identity/v3/users/d2e3112275334ef6a07084887adb4bfc => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:12.987423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dba587-5d46-43d0-ba50-ed078b5e18e7 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:13.011332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5eac4-3ae2-4e2e-a01e-7e63c82346a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:13.011957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5eac4-3ae2-4e2e-a01e-7e63c82346a0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:13.012238 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5eac4-3ae2-4e2e-a01e-7e63c82346a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:13.012508 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5eac4-3ae2-4e2e-a01e-7e63c82346a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:13.013641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5eac4-3ae2-4e2e-a01e-7e63c82346a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:13.015065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5eac4-3ae2-4e2e-a01e-7e63c82346a0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:13.016640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 38/82] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:13.017406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5eac4-3ae2-4e2e-a01e-7e63c82346a0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:13.019493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:13.089659 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dba587-5d46-43d0-ba50-ed078b5e18e7 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:13.118389 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5eac4-3ae2-4e2e-a01e-7e63c82346a0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:13.123529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20172d80-17c9-433b-893d-06484d3d639d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:13.124126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20172d80-17c9-433b-893d-06484d3d639d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:13.124404 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20172d80-17c9-433b-893d-06484d3d639d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:13.124676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20172d80-17c9-433b-893d-06484d3d639d None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:13.125366 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20172d80-17c9-433b-893d-06484d3d639d None admin] RBAC: Adding query filter params (name=member) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:13.125668 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20172d80-17c9-433b-893d-06484d3d639d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:13.127053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20172d80-17c9-433b-893d-06484d3d639d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:13.134830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:13.135570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 45/83] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:13.136348 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20172d80-17c9-433b-893d-06484d3d639d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:13.157390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb19f66-f96f-4718-991d-8c8e1ddfc8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:13.158019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb19f66-f96f-4718-991d-8c8e1ddfc8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:13.158402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb19f66-f96f-4718-991d-8c8e1ddfc8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:13.158625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb19f66-f96f-4718-991d-8c8e1ddfc8e3 None admin] PATH_INFO: `/v3/users/f8d87aca886c4c2eb2651db46e0ae180` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:13.160242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb19f66-f96f-4718-991d-8c8e1ddfc8e3 None admin] RBAC: Authorizing `identity:get_user(user_id=f8d87aca886c4c2eb2651db46e0ae180)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:13.161863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb19f66-f96f-4718-991d-8c8e1ddfc8e3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:13.163435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 39/84] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:13 2022] GET /identity/v3/users/f8d87aca886c4c2eb2651db46e0ae180 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:13.164191 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb19f66-f96f-4718-991d-8c8e1ddfc8e3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:13.230107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:13.236414 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20172d80-17c9-433b-893d-06484d3d639d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:13.263780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb19f66-f96f-4718-991d-8c8e1ddfc8e3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:13.270699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf1c62-d29a-4733-9445-8019b73f1760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:13.271319 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf1c62-d29a-4733-9445-8019b73f1760 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:13.271595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf1c62-d29a-4733-9445-8019b73f1760 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:13.271868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf1c62-d29a-4733-9445-8019b73f1760 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:13.272979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf1c62-d29a-4733-9445-8019b73f1760 None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:13.274461 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf1c62-d29a-4733-9445-8019b73f1760 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:13.276083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 46/85] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:13 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:13.276815 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf1c62-d29a-4733-9445-8019b73f1760 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:13.298830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df967704-ce5b-471f-ba64-647966616c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:13.299439 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df967704-ce5b-471f-ba64-647966616c2f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:13.299719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df967704-ce5b-471f-ba64-647966616c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:13.299992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df967704-ce5b-471f-ba64-647966616c2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:13.351767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:13.368137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df967704-ce5b-471f-ba64-647966616c2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:13.369635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df967704-ce5b-471f-ba64-647966616c2f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:13.375045 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf1c62-d29a-4733-9445-8019b73f1760 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:13.410530 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373c896-dc1e-42c4-b56e-8f518cbd5d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:13.411130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373c896-dc1e-42c4-b56e-8f518cbd5d14 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:13.411414 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373c896-dc1e-42c4-b56e-8f518cbd5d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:13.411692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373c896-dc1e-42c4-b56e-8f518cbd5d14 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:13.412344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373c896-dc1e-42c4-b56e-8f518cbd5d14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:13.413845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373c896-dc1e-42c4-b56e-8f518cbd5d14 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:13.467445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 40/86] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:13.468368 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df967704-ce5b-471f-ba64-647966616c2f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:13.525314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 47/87] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:24:13 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:24:13.525314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373c896-dc1e-42c4-b56e-8f518cbd5d14 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:13.540651 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:13.556542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:13.575424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df967704-ce5b-471f-ba64-647966616c2f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:13.616730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473d1e8-0f82-43f2-9c35-ebb7912dd407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:13.617605 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473d1e8-0f82-43f2-9c35-ebb7912dd407 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:13.618709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473d1e8-0f82-43f2-9c35-ebb7912dd407 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:13.619226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473d1e8-0f82-43f2-9c35-ebb7912dd407 None admin] PATH_INFO: `/v3/users/d2e3112275334ef6a07084887adb4bfc` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:13.620916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473d1e8-0f82-43f2-9c35-ebb7912dd407 None admin] RBAC: Authorizing `identity:get_user(user_id=d2e3112275334ef6a07084887adb4bfc)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:13.622445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473d1e8-0f82-43f2-9c35-ebb7912dd407 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:13.624146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 41/88] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:13 2022] GET /identity/v3/users/d2e3112275334ef6a07084887adb4bfc => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:13.624936 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473d1e8-0f82-43f2-9c35-ebb7912dd407 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:13.631989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373c896-dc1e-42c4-b56e-8f518cbd5d14 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:13.672972 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3caae6-61d0-4ef9-942e-91d5bde8a47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:13.673890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3caae6-61d0-4ef9-942e-91d5bde8a47b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:13.674178 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3caae6-61d0-4ef9-942e-91d5bde8a47b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:13.674461 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3caae6-61d0-4ef9-942e-91d5bde8a47b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:13.754955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473d1e8-0f82-43f2-9c35-ebb7912dd407 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:13.759741 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3caae6-61d0-4ef9-942e-91d5bde8a47b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:13.764456 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3caae6-61d0-4ef9-942e-91d5bde8a47b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:13.783108 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:13.801634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1483f-2ea3-4c01-982b-41849706ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:13.802276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1483f-2ea3-4c01-982b-41849706ced1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:13.802553 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1483f-2ea3-4c01-982b-41849706ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:13.802829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1483f-2ea3-4c01-982b-41849706ced1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:13.803576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1483f-2ea3-4c01-982b-41849706ced1 None admin] RBAC: Adding query filter params (role.id=64f2951b9ce444bcad20c61347224196, scope.project.id=caf2c8ab542845ae9205702525b855e2, user.id=d2e3112275334ef6a07084887adb4bfc) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:13.803906 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1483f-2ea3-4c01-982b-41849706ced1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:13.808764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1483f-2ea3-4c01-982b-41849706ced1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:13.814892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 42/89] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:13 2022] GET /identity/v3/role_assignments?user.id=d2e3112275334ef6a07084887adb4bfc&scope.project.id=caf2c8ab542845ae9205702525b855e2&role.id=64f2951b9ce444bcad20c61347224196 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:13.815709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1483f-2ea3-4c01-982b-41849706ced1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:13.851983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:13.896156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 48/90] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:13.902575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3caae6-61d0-4ef9-942e-91d5bde8a47b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:13.986500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1483f-2ea3-4c01-982b-41849706ced1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:14.037644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73329d31-ebf7-4d28-ad41-a8a27eb79d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:14.038290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73329d31-ebf7-4d28-ad41-a8a27eb79d19 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:14.038648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73329d31-ebf7-4d28-ad41-a8a27eb79d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:14.038998 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73329d31-ebf7-4d28-ad41-a8a27eb79d19 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:14.040243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73329d31-ebf7-4d28-ad41-a8a27eb79d19 None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:14.041901 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73329d31-ebf7-4d28-ad41-a8a27eb79d19 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:14.044021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 43/91] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:13 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:14.045061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73329d31-ebf7-4d28-ad41-a8a27eb79d19 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:14.063871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3caae6-61d0-4ef9-942e-91d5bde8a47b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:14.088705 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:14.123249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba5ab3-a8cf-4d3a-82e8-f2e99e0e6921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:14.123874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba5ab3-a8cf-4d3a-82e8-f2e99e0e6921 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:14.124153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba5ab3-a8cf-4d3a-82e8-f2e99e0e6921 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:14.124427 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba5ab3-a8cf-4d3a-82e8-f2e99e0e6921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:14.195528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:14.204317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73329d31-ebf7-4d28-ad41-a8a27eb79d19 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:14.242533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37263b32-de1d-4e79-ba67-777e46b242ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:14.244215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37263b32-de1d-4e79-ba67-777e46b242ca None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:14.244500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37263b32-de1d-4e79-ba67-777e46b242ca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:14.244773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37263b32-de1d-4e79-ba67-777e46b242ca None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:14.246593 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37263b32-de1d-4e79-ba67-777e46b242ca None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:14.248029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37263b32-de1d-4e79-ba67-777e46b242ca None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:14.251323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 44/92] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:14 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:14.251922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37263b32-de1d-4e79-ba67-777e46b242ca None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:14.272040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba5ab3-a8cf-4d3a-82e8-f2e99e0e6921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:14.274076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba5ab3-a8cf-4d3a-82e8-f2e99e0e6921 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:14.420618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37263b32-de1d-4e79-ba67-777e46b242ca None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:14.455972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d419ae-426c-4a9d-a243-f436c6b6156e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:14.457164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d419ae-426c-4a9d-a243-f436c6b6156e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:14.457478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d419ae-426c-4a9d-a243-f436c6b6156e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:14.457754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d419ae-426c-4a9d-a243-f436c6b6156e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:14.458912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d419ae-426c-4a9d-a243-f436c6b6156e None admin] RBAC: Adding query filter params (role.id=0c9ebbeca1134eb4914025ef4cf80f5c, scope.project.id=caf2c8ab542845ae9205702525b855e2, user.id=d2e3112275334ef6a07084887adb4bfc) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:14.459229 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d419ae-426c-4a9d-a243-f436c6b6156e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:14.460662 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d419ae-426c-4a9d-a243-f436c6b6156e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:14.466690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 45/93] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:14 2022] GET /identity/v3/role_assignments?user.id=d2e3112275334ef6a07084887adb4bfc&scope.project.id=caf2c8ab542845ae9205702525b855e2&role.id=0c9ebbeca1134eb4914025ef4cf80f5c => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:14.467308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d419ae-426c-4a9d-a243-f436c6b6156e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:14.489586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:14.532212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 49/94] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:14.538880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba5ab3-a8cf-4d3a-82e8-f2e99e0e6921 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:14.583190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d419ae-426c-4a9d-a243-f436c6b6156e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:14.588112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:14.622016 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43167f3-55b5-4a3a-8eb5-493952e9c469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:14.622641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43167f3-55b5-4a3a-8eb5-493952e9c469 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:14.622922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43167f3-55b5-4a3a-8eb5-493952e9c469 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:14.623196 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43167f3-55b5-4a3a-8eb5-493952e9c469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:14.623943 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43167f3-55b5-4a3a-8eb5-493952e9c469 None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=caf2c8ab542845ae9205702525b855e2, user.id=f8d87aca886c4c2eb2651db46e0ae180) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:14.624255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43167f3-55b5-4a3a-8eb5-493952e9c469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:14.625772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43167f3-55b5-4a3a-8eb5-493952e9c469 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:14.632575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 46/95] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:14 2022] GET /identity/v3/role_assignments?user.id=f8d87aca886c4c2eb2651db46e0ae180&scope.project.id=caf2c8ab542845ae9205702525b855e2&role.id=1896db68dc754d5293037ab100ce46d9 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:14.745008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba5ab3-a8cf-4d3a-82e8-f2e99e0e6921 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:14.809486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fcce5-8608-4e12-b87c-de1bcbb284ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:14.810153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fcce5-8608-4e12-b87c-de1bcbb284ec None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:14.810431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fcce5-8608-4e12-b87c-de1bcbb284ec None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:14.810704 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fcce5-8608-4e12-b87c-de1bcbb284ec None admin] PATH_INFO: `/v3/projects/983ff0ca118a4df98dccb931b0dcf86b` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:14.811881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fcce5-8608-4e12-b87c-de1bcbb284ec None admin] RBAC: Authorizing `identity:get_project(project_id=983ff0ca118a4df98dccb931b0dcf86b)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:14.813376 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fcce5-8608-4e12-b87c-de1bcbb284ec None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:14.815205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 50/96] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:14 2022] GET /identity/v3/projects/983ff0ca118a4df98dccb931b0dcf86b => generated 312 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:14.821289 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43167f3-55b5-4a3a-8eb5-493952e9c469 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:14.929553 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:14.953235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43167f3-55b5-4a3a-8eb5-493952e9c469 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:14.989849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22154a8-1961-45f0-8bec-1c60f1e7e4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:14.990518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22154a8-1961-45f0-8bec-1c60f1e7e4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:14.990800 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22154a8-1961-45f0-8bec-1c60f1e7e4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:14.991073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22154a8-1961-45f0-8bec-1c60f1e7e4d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:14.991808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22154a8-1961-45f0-8bec-1c60f1e7e4d0 None admin] RBAC: Adding query filter params (role.id=64f2951b9ce444bcad20c61347224196, scope.project.id=983ff0ca118a4df98dccb931b0dcf86b, user.id=d2e3112275334ef6a07084887adb4bfc) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:14.992116 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22154a8-1961-45f0-8bec-1c60f1e7e4d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:14.993569 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22154a8-1961-45f0-8bec-1c60f1e7e4d0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:14.999561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 47/97] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:14 2022] GET /identity/v3/role_assignments?user.id=d2e3112275334ef6a07084887adb4bfc&scope.project.id=983ff0ca118a4df98dccb931b0dcf86b&role.id=64f2951b9ce444bcad20c61347224196 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:16.220103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01792-1a20-4d06-9633-bdd4f30f2415 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:16.220647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01792-1a20-4d06-9633-bdd4f30f2415 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:16.220647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01792-1a20-4d06-9633-bdd4f30f2415 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:16.222762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 51/98] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:16.228008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3949e5-6f41-44df-8fb9-7e4a76c022dd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:16.228404 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3949e5-6f41-44df-8fb9-7e4a76c022dd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:16.228580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3949e5-6f41-44df-8fb9-7e4a76c022dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:16.254996 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6a3949e5-6f41-44df-8fb9-7e4a76c022dd None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:16.256200 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6a3949e5-6f41-44df-8fb9-7e4a76c022dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:16.340664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 48/99] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:16.686354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b01792-1a20-4d06-9633-bdd4f30f2415 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:16.791736 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:16.818771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b01792-1a20-4d06-9633-bdd4f30f2415 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:16.892297 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc9021-b7ef-4e0c-9dd5-fef8796f22ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:16.892940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc9021-b7ef-4e0c-9dd5-fef8796f22ea None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:16.893237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc9021-b7ef-4e0c-9dd5-fef8796f22ea None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:16.893521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc9021-b7ef-4e0c-9dd5-fef8796f22ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:16.895633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc9021-b7ef-4e0c-9dd5-fef8796f22ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:16.897087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc9021-b7ef-4e0c-9dd5-fef8796f22ea None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:16.898863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 52/100] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:16.904562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3949e5-6f41-44df-8fb9-7e4a76c022dd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:16.963379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2bb51-3e7c-40d9-9593-a0ab1b16b10e None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:16.963566 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2bb51-3e7c-40d9-9593-a0ab1b16b10e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:16.963853 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2bb51-3e7c-40d9-9593-a0ab1b16b10e None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:16.965347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 53/101] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:16.970474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc425e-6b3e-486e-b2f4-7d8813c091cd None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:16.970764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc425e-6b3e-486e-b2f4-7d8813c091cd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:16.971047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc425e-6b3e-486e-b2f4-7d8813c091cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:17.010289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-68fc425e-6b3e-486e-b2f4-7d8813c091cd None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:17.011592 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-68fc425e-6b3e-486e-b2f4-7d8813c091cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:17.030325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3949e5-6f41-44df-8fb9-7e4a76c022dd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:17.045231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:17.087916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b42fc-ddab-4841-a63f-04896f1da187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:17.088550 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b42fc-ddab-4841-a63f-04896f1da187 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:17.088831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b42fc-ddab-4841-a63f-04896f1da187 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:17.089104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b42fc-ddab-4841-a63f-04896f1da187 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:17.089846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b42fc-ddab-4841-a63f-04896f1da187 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:17.091452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b42fc-ddab-4841-a63f-04896f1da187 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:17.149655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 54/102] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:17.151273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4e5b4-918f-45c7-a7b3-265326cbd113 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:17.151777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4e5b4-918f-45c7-a7b3-265326cbd113 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:17.152251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4e5b4-918f-45c7-a7b3-265326cbd113 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:17.158688 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 55/103] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:17.166523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741702f-5f29-4116-9cc5-ea3481192041 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:17.169820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741702f-5f29-4116-9cc5-ea3481192041 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:17.169820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741702f-5f29-4116-9cc5-ea3481192041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:17.197002 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 49/104] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 31 04:24:16 2022] POST /identity/v3/projects => generated 302 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:24:17.198586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1b861-dac9-4820-9b90-e58311d0fef1 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:17.198586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1b861-dac9-4820-9b90-e58311d0fef1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:17.198859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1b861-dac9-4820-9b90-e58311d0fef1 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:17.199722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5741702f-5f29-4116-9cc5-ea3481192041 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:17.200939 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5741702f-5f29-4116-9cc5-ea3481192041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:17.202506 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 50/105] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:17.208632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee5406-3c54-4a71-8b48-f7090ede4aab None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:17.208938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee5406-3c54-4a71-8b48-f7090ede4aab None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:17.209183 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee5406-3c54-4a71-8b48-f7090ede4aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:17.247472 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-aaee5406-3c54-4a71-8b48-f7090ede4aab None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:17.249917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-aaee5406-3c54-4a71-8b48-f7090ede4aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:17.302025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 56/106] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:17.304274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadd2d7-ed05-4e2e-910d-2a7135c9a76e None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:17.304566 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadd2d7-ed05-4e2e-910d-2a7135c9a76e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:17.304845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadd2d7-ed05-4e2e-910d-2a7135c9a76e None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:17.306173 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 57/107] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:17.312300 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05f844-fbab-4370-941c-abcf1cd61d82 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:17.312620 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05f844-fbab-4370-941c-abcf1cd61d82 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:17.312865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05f844-fbab-4370-941c-abcf1cd61d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:17.333744 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fa05f844-fbab-4370-941c-abcf1cd61d82 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:17.334230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 51/108] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:17.335077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fa05f844-fbab-4370-941c-abcf1cd61d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:17.348135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:17.430774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 58/109] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:17.466302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee5406-3c54-4a71-8b48-f7090ede4aab None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:17.526514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:17.577613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee5406-3c54-4a71-8b48-f7090ede4aab None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:17.622988 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43a3c6-2f8d-4081-9ebb-d03a499dc181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:17.623623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a3c6-2f8d-4081-9ebb-d03a499dc181 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:17.623903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a3c6-2f8d-4081-9ebb-d03a499dc181 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:17.624172 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a3c6-2f8d-4081-9ebb-d03a499dc181 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:17.639702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43a3c6-2f8d-4081-9ebb-d03a499dc181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-af43a3c6-2f8d-4081-9ebb-d03a499dc181 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:17.644568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:17.645820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:17.647203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:17.647203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:17.647203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:17.647203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:17.647203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:17.647203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:17.647203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:17.647203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:17.647203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:17.647203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:17.647203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:17.647203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:17.647203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 52/110] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:17.651708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05f844-fbab-4370-941c-abcf1cd61d82 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:17.732892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43a3c6-2f8d-4081-9ebb-d03a499dc181 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:17.803087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05f844-fbab-4370-941c-abcf1cd61d82 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:17.851316 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b74903-eb09-48b9-b9e7-0ceb726edf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:17.852567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b74903-eb09-48b9-b9e7-0ceb726edf47 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:17.853012 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b74903-eb09-48b9-b9e7-0ceb726edf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:17.853559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b74903-eb09-48b9-b9e7-0ceb726edf47 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:17.854406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b74903-eb09-48b9-b9e7-0ceb726edf47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:17.854784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b74903-eb09-48b9-b9e7-0ceb726edf47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:17.857038 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b74903-eb09-48b9-b9e7-0ceb726edf47 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:17.869869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 59/111] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:17.871151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b74903-eb09-48b9-b9e7-0ceb726edf47 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:17.873508 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43a3c6-2f8d-4081-9ebb-d03a499dc181 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:17.883624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:17.894939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:17.914124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7155689-c3d6-41c0-b1f8-207d8de36c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:17.914753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7155689-c3d6-41c0-b1f8-207d8de36c49 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:17.915040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7155689-c3d6-41c0-b1f8-207d8de36c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:17.915314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7155689-c3d6-41c0-b1f8-207d8de36c49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:17.928125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7155689-c3d6-41c0-b1f8-207d8de36c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e7155689-c3d6-41c0-b1f8-207d8de36c49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:17.933925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:17.934784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:17.935552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:17.935552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:17.935552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:17.935552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:17.935552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:17.935552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:17.935552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:17.935552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:17.935552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:17.935552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:17.935552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:17.935552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:17.936745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 53/112] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:24:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:17.937071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7155689-c3d6-41c0-b1f8-207d8de36c49 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:17.989296 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b74903-eb09-48b9-b9e7-0ceb726edf47 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:18.025323 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cf87d-3a70-4c95-8d88-66b0c11aaca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:18.026120 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf87d-3a70-4c95-8d88-66b0c11aaca1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:18.026413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf87d-3a70-4c95-8d88-66b0c11aaca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:18.026692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf87d-3a70-4c95-8d88-66b0c11aaca1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:18.038278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cf87d-3a70-4c95-8d88-66b0c11aaca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-6e5cf87d-3a70-4c95-8d88-66b0c11aaca1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:18.043565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:18.044444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:18.045938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:18.045938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:18.045938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:18.045938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:18.045938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:18.045938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:18.045938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:18.045938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:18.045938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:18.045938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:18.045938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:18.045938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:18.045938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 60/113] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:18.046599 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7155689-c3d6-41c0-b1f8-207d8de36c49 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:18.050677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cf87d-3a70-4c95-8d88-66b0c11aaca1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:18.087985 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af827dc1-ad57-446b-b08c-1bf6e950f8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:18.088745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af827dc1-ad57-446b-b08c-1bf6e950f8fa None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:18.089033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af827dc1-ad57-446b-b08c-1bf6e950f8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:18.089341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af827dc1-ad57-446b-b08c-1bf6e950f8fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:18.101686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af827dc1-ad57-446b-b08c-1bf6e950f8fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-af827dc1-ad57-446b-b08c-1bf6e950f8fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:18.106834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:18.107741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:18.108513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:18.108513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:18.108513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:18.108513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:18.108513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:18.108513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:18.108513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:18.108513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:18.108513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:18.108513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:18.108513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:18.108513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:18.108513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 54/114] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:18.111734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d2306-b555-4de4-bf31-2923c9d2e970 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:18.112207 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d2306-b555-4de4-bf31-2923c9d2e970 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:18.112983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d2306-b555-4de4-bf31-2923c9d2e970 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:18.114747 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 55/115] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:18.118056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d2306-b555-4de4-bf31-2923c9d2e970 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:18.126008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:18.162856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:18.165108 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cf87d-3a70-4c95-8d88-66b0c11aaca1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:18.203861 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87dada1-4802-42a5-9ba8-370f114fe414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:18.205258 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dada1-4802-42a5-9ba8-370f114fe414 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:18.205726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dada1-4802-42a5-9ba8-370f114fe414 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:18.206724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dada1-4802-42a5-9ba8-370f114fe414 None admin] PATH_INFO: `/v3/users/b255b863112f4c9fb7dc042284b0979a` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:18.221813 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87dada1-4802-42a5-9ba8-370f114fe414 None admin] RBAC: Authorizing `identity:get_user(user_id=b255b863112f4c9fb7dc042284b0979a)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:18.223861 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87dada1-4802-42a5-9ba8-370f114fe414 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:18.230198 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 61/116] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:18 2022] GET /identity/v3/users/b255b863112f4c9fb7dc042284b0979a => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:18.230198 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87dada1-4802-42a5-9ba8-370f114fe414 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:18.240634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d2306-b555-4de4-bf31-2923c9d2e970 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:18.277331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4b7f1-38c6-474c-a838-cd3e50c5e264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:18.277981 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4b7f1-38c6-474c-a838-cd3e50c5e264 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:18.278215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4b7f1-38c6-474c-a838-cd3e50c5e264 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:18.278490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4b7f1-38c6-474c-a838-cd3e50c5e264 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:18.279150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4b7f1-38c6-474c-a838-cd3e50c5e264 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:18.279452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4b7f1-38c6-474c-a838-cd3e50c5e264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:18.280816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4b7f1-38c6-474c-a838-cd3e50c5e264 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:18.289462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 56/117] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:24:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:18.290255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4b7f1-38c6-474c-a838-cd3e50c5e264 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:18.341866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87dada1-4802-42a5-9ba8-370f114fe414 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:18.365662 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:18.376619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad54421-a5eb-4ab7-979e-f742c652dda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:18.377723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad54421-a5eb-4ab7-979e-f742c652dda1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:18.378005 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad54421-a5eb-4ab7-979e-f742c652dda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:18.378860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad54421-a5eb-4ab7-979e-f742c652dda1 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:18.379560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad54421-a5eb-4ab7-979e-f742c652dda1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:18.379882 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad54421-a5eb-4ab7-979e-f742c652dda1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:18.381299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad54421-a5eb-4ab7-979e-f742c652dda1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:18.390412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 62/118] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:18.391697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519d8d-d066-4876-b790-828edcad69ab None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:18.392089 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519d8d-d066-4876-b790-828edcad69ab None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:18.392469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519d8d-d066-4876-b790-828edcad69ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:18.405546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:18.410187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4b7f1-38c6-474c-a838-cd3e50c5e264 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:18.412858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-8d519d8d-d066-4876-b790-828edcad69ab None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:18.414192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8d519d8d-d066-4876-b790-828edcad69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:18.448483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476b909-934f-48f5-9db0-bdf21637cae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:18.449250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b909-934f-48f5-9db0-bdf21637cae4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:18.449606 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b909-934f-48f5-9db0-bdf21637cae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:18.449954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476b909-934f-48f5-9db0-bdf21637cae4 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:18.450695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476b909-934f-48f5-9db0-bdf21637cae4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:18.451238 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476b909-934f-48f5-9db0-bdf21637cae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:18.452917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476b909-934f-48f5-9db0-bdf21637cae4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:18.462725 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 57/119] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:18.468009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476b909-934f-48f5-9db0-bdf21637cae4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:18.484465 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 63/120] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:18.489360 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519d8d-d066-4876-b790-828edcad69ab None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:18.591164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476b909-934f-48f5-9db0-bdf21637cae4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:18.629885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519d8d-d066-4876-b790-828edcad69ab None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:18.634160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f5f02-61f5-462b-8b85-518280e01dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:18.634876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f5f02-61f5-462b-8b85-518280e01dbb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:18.635287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f5f02-61f5-462b-8b85-518280e01dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:18.635643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f5f02-61f5-462b-8b85-518280e01dbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:18.650941 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:18.672534 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:18.675486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b67c6-1efc-404c-a167-0cd9f254fa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:18.676614 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b67c6-1efc-404c-a167-0cd9f254fa2f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:18.677430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b67c6-1efc-404c-a167-0cd9f254fa2f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:18.677879 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b67c6-1efc-404c-a167-0cd9f254fa2f None admin] PATH_INFO: `/v3/users/d2e3112275334ef6a07084887adb4bfc` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:18.679232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b67c6-1efc-404c-a167-0cd9f254fa2f None admin] RBAC: Authorizing `identity:get_user(user_id=d2e3112275334ef6a07084887adb4bfc)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:18.682099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b67c6-1efc-404c-a167-0cd9f254fa2f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:18.684139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 64/121] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:18 2022] GET /identity/v3/users/d2e3112275334ef6a07084887adb4bfc => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:18.690311 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b67c6-1efc-404c-a167-0cd9f254fa2f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:18.729657 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f5f02-61f5-462b-8b85-518280e01dbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:18.731634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f5f02-61f5-462b-8b85-518280e01dbb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:18.835763 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b67c6-1efc-404c-a167-0cd9f254fa2f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:18.852586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 58/122] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:18.852586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f5f02-61f5-462b-8b85-518280e01dbb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:18.877507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2d52d-edd3-4874-b37f-c40495f539e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:18.878331 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2d52d-edd3-4874-b37f-c40495f539e2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:18.878802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2d52d-edd3-4874-b37f-c40495f539e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:18.879195 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2d52d-edd3-4874-b37f-c40495f539e2 None admin] PATH_INFO: `/v3/users/f8d87aca886c4c2eb2651db46e0ae180` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:18.880413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2d52d-edd3-4874-b37f-c40495f539e2 None admin] RBAC: Authorizing `identity:get_user(user_id=f8d87aca886c4c2eb2651db46e0ae180)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:18.881858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2d52d-edd3-4874-b37f-c40495f539e2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:18.883415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 65/123] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:18 2022] GET /identity/v3/users/f8d87aca886c4c2eb2651db46e0ae180 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:18.884170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2d52d-edd3-4874-b37f-c40495f539e2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:18.922185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:18.949057 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:18.968272 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f5f02-61f5-462b-8b85-518280e01dbb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:18.998415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2d52d-edd3-4874-b37f-c40495f539e2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:19.002935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bb4de-465e-4031-96d0-a57ccb3b8cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:19.004205 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bb4de-465e-4031-96d0-a57ccb3b8cfd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:19.004609 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bb4de-465e-4031-96d0-a57ccb3b8cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:19.004956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bb4de-465e-4031-96d0-a57ccb3b8cfd None admin] PATH_INFO: `/v3/users/d2e3112275334ef6a07084887adb4bfc` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:19.006218 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bb4de-465e-4031-96d0-a57ccb3b8cfd None admin] RBAC: Authorizing `identity:get_user(user_id=d2e3112275334ef6a07084887adb4bfc)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:19.007730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bb4de-465e-4031-96d0-a57ccb3b8cfd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:19.009613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 59/124] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:18 2022] GET /identity/v3/users/d2e3112275334ef6a07084887adb4bfc => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:19.010209 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bb4de-465e-4031-96d0-a57ccb3b8cfd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:19.040403 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3835775-04c4-4f2b-92f0-4a95eeeabbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:19.041030 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3835775-04c4-4f2b-92f0-4a95eeeabbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:19.041340 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3835775-04c4-4f2b-92f0-4a95eeeabbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:19.041616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3835775-04c4-4f2b-92f0-4a95eeeabbf3 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:19.042735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3835775-04c4-4f2b-92f0-4a95eeeabbf3 None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:19.044172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3835775-04c4-4f2b-92f0-4a95eeeabbf3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:19.051092 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 66/125] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:18 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:19.051092 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3835775-04c4-4f2b-92f0-4a95eeeabbf3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:19.122004 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bb4de-465e-4031-96d0-a57ccb3b8cfd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:19.152264 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:19.160309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc902e2-753c-4b3f-b323-a2eb5d9bad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:19.166426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc902e2-753c-4b3f-b323-a2eb5d9bad1b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:19.166426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc902e2-753c-4b3f-b323-a2eb5d9bad1b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:19.166426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc902e2-753c-4b3f-b323-a2eb5d9bad1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:19.166663 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3835775-04c4-4f2b-92f0-4a95eeeabbf3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:19.172656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc902e2-753c-4b3f-b323-a2eb5d9bad1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1bc902e2-753c-4b3f-b323-a2eb5d9bad1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:19.177752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:19.178631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:19.179501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:19.179501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:19.179501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:19.179501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:19.179501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:19.179501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:19.179501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:19.179501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:19.179501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:19.179501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:19.179501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:19.179501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:19.179501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 60/126] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:19.182441 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc902e2-753c-4b3f-b323-a2eb5d9bad1b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:19.188623 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:19.204220 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78d1a7-8706-4caa-8506-1f4d6bf9f01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:19.204863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78d1a7-8706-4caa-8506-1f4d6bf9f01f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:19.205146 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78d1a7-8706-4caa-8506-1f4d6bf9f01f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:19.205456 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78d1a7-8706-4caa-8506-1f4d6bf9f01f None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:19.207217 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78d1a7-8706-4caa-8506-1f4d6bf9f01f None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:19.208771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78d1a7-8706-4caa-8506-1f4d6bf9f01f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:19.210690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 67/127] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:19 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:19.214715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78d1a7-8706-4caa-8506-1f4d6bf9f01f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:19.293568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc902e2-753c-4b3f-b323-a2eb5d9bad1b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:19.321848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78d1a7-8706-4caa-8506-1f4d6bf9f01f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:19.332055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15b948-489a-4895-8133-b6f65a5d0008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:19.332860 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15b948-489a-4895-8133-b6f65a5d0008 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:19.333474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15b948-489a-4895-8133-b6f65a5d0008 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:19.333764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15b948-489a-4895-8133-b6f65a5d0008 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:19.335177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15b948-489a-4895-8133-b6f65a5d0008 None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:19.337283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15b948-489a-4895-8133-b6f65a5d0008 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:19.339559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 61/128] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:19 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:19.340150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15b948-489a-4895-8133-b6f65a5d0008 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:19.363400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4e021-cc71-42d7-85fc-b2886225cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:19.364416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4e021-cc71-42d7-85fc-b2886225cafd None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:19.364416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4e021-cc71-42d7-85fc-b2886225cafd None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:19.364698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4e021-cc71-42d7-85fc-b2886225cafd None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:19.365808 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4e021-cc71-42d7-85fc-b2886225cafd None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:19.367241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4e021-cc71-42d7-85fc-b2886225cafd None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:19.369007 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 68/129] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:19 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:19.374954 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4e021-cc71-42d7-85fc-b2886225cafd None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:19.399548 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:19.441576 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:19.442720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15b948-489a-4895-8133-b6f65a5d0008 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:19.479599 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29090dc3-bce5-4f28-8906-9f775b65826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:19.480598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29090dc3-bce5-4f28-8906-9f775b65826e None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:19.480889 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29090dc3-bce5-4f28-8906-9f775b65826e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:19.481182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29090dc3-bce5-4f28-8906-9f775b65826e None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2/users/d2e3112275334ef6a07084887adb4bfc/roles/0c9ebbeca1134eb4914025ef4cf80f5c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:19.483454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29090dc3-bce5-4f28-8906-9f775b65826e None admin] RBAC: Authorizing `identity:create_grant(project_id=caf2c8ab542845ae9205702525b855e2, user_id=d2e3112275334ef6a07084887adb4bfc, role_id=0c9ebbeca1134eb4914025ef4cf80f5c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:19.484906 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29090dc3-bce5-4f28-8906-9f775b65826e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:19.489948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4e021-cc71-42d7-85fc-b2886225cafd None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:19.524084 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eba20e-ea95-47e8-a9f9-d3b3ebc708aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:19.524729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eba20e-ea95-47e8-a9f9-d3b3ebc708aa None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:19.525061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eba20e-ea95-47e8-a9f9-d3b3ebc708aa None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:19.525366 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eba20e-ea95-47e8-a9f9-d3b3ebc708aa None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:19.526031 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eba20e-ea95-47e8-a9f9-d3b3ebc708aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:19.526332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eba20e-ea95-47e8-a9f9-d3b3ebc708aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:19.527709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eba20e-ea95-47e8-a9f9-d3b3ebc708aa None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:19.536592 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 69/130] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:19.537413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eba20e-ea95-47e8-a9f9-d3b3ebc708aa None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:19.570689 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 62/131] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:24:19 2022] PUT /identity/v3/projects/caf2c8ab542845ae9205702525b855e2/users/d2e3112275334ef6a07084887adb4bfc/roles/0c9ebbeca1134eb4914025ef4cf80f5c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:24:19.571540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29090dc3-bce5-4f28-8906-9f775b65826e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:19.647650 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eba20e-ea95-47e8-a9f9-d3b3ebc708aa None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:19.669575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:19.686029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29090dc3-bce5-4f28-8906-9f775b65826e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:19.692084 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ff93e-15da-4cf8-b015-eec4291a3744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:19.693032 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff93e-15da-4cf8-b015-eec4291a3744 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:19.693556 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff93e-15da-4cf8-b015-eec4291a3744 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:19.694578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ff93e-15da-4cf8-b015-eec4291a3744 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:19.695566 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ff93e-15da-4cf8-b015-eec4291a3744 None admin] RBAC: Adding query filter params (role.id=1d182987dff1438492d3b48c532573c0, scope.project.id=caf2c8ab542845ae9205702525b855e2, user.id=b255b863112f4c9fb7dc042284b0979a) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:19.696455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ff93e-15da-4cf8-b015-eec4291a3744 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:19.698956 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ff93e-15da-4cf8-b015-eec4291a3744 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:19.705335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:19.713637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 70/132] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:19 2022] GET /identity/v3/role_assignments?user.id=b255b863112f4c9fb7dc042284b0979a&scope.project.id=caf2c8ab542845ae9205702525b855e2&role.id=1d182987dff1438492d3b48c532573c0 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:19.713637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ff93e-15da-4cf8-b015-eec4291a3744 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:19.741561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cfc5f-0d77-4508-9cd3-aa3d1b850543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:19.742479 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cfc5f-0d77-4508-9cd3-aa3d1b850543 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:19.743168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cfc5f-0d77-4508-9cd3-aa3d1b850543 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:19.743763 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cfc5f-0d77-4508-9cd3-aa3d1b850543 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2/users/f8d87aca886c4c2eb2651db46e0ae180/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:19.749078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cfc5f-0d77-4508-9cd3-aa3d1b850543 None admin] RBAC: Authorizing `identity:create_grant(project_id=caf2c8ab542845ae9205702525b855e2, user_id=f8d87aca886c4c2eb2651db46e0ae180, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:19.751645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cfc5f-0d77-4508-9cd3-aa3d1b850543 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:19.851531 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ff93e-15da-4cf8-b015-eec4291a3744 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:19.876450 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 63/133] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:24:19 2022] PUT /identity/v3/projects/caf2c8ab542845ae9205702525b855e2/users/f8d87aca886c4c2eb2651db46e0ae180/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:24:19.877735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc586a-407e-4427-9ce8-5bfa1a7d7ce3 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:19.878029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc586a-407e-4427-9ce8-5bfa1a7d7ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:19.878472 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc586a-407e-4427-9ce8-5bfa1a7d7ce3 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:19.882746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 64/134] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:19.884600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc586a-407e-4427-9ce8-5bfa1a7d7ce3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:19.899380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9c5eb-0fc0-4242-b60c-36c2f5eb8bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:19.900321 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9c5eb-0fc0-4242-b60c-36c2f5eb8bb3 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:19.900680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9c5eb-0fc0-4242-b60c-36c2f5eb8bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:19.901109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9c5eb-0fc0-4242-b60c-36c2f5eb8bb3 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2/users/d2e3112275334ef6a07084887adb4bfc/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:19.903441 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9c5eb-0fc0-4242-b60c-36c2f5eb8bb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=caf2c8ab542845ae9205702525b855e2, user_id=d2e3112275334ef6a07084887adb4bfc, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:19.905044 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9c5eb-0fc0-4242-b60c-36c2f5eb8bb3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:19.992751 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 71/135] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:24:19 2022] PUT /identity/v3/projects/caf2c8ab542845ae9205702525b855e2/users/d2e3112275334ef6a07084887adb4bfc/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:24:19.994165 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e04b34-96c0-447d-a210-a8b533579781 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:19.994583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e04b34-96c0-447d-a210-a8b533579781 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:19.994962 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e04b34-96c0-447d-a210-a8b533579781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:20.031698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d3e04b34-96c0-447d-a210-a8b533579781 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:20.033091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d3e04b34-96c0-447d-a210-a8b533579781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:20.043381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc586a-407e-4427-9ce8-5bfa1a7d7ce3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:20.082858 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3c58b-0b9e-480a-938d-bb9aea5d58ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:20.082858 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3c58b-0b9e-480a-938d-bb9aea5d58ae None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:20.083169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3c58b-0b9e-480a-938d-bb9aea5d58ae None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:20.083455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3c58b-0b9e-480a-938d-bb9aea5d58ae None admin] PATH_INFO: `/v3/users/d2e3112275334ef6a07084887adb4bfc` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:20.084713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3c58b-0b9e-480a-938d-bb9aea5d58ae None admin] RBAC: Authorizing `identity:get_user(user_id=d2e3112275334ef6a07084887adb4bfc)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:20.086258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3c58b-0b9e-480a-938d-bb9aea5d58ae None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:20.086682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:20.087981 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 65/136] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:19 2022] GET /identity/v3/users/d2e3112275334ef6a07084887adb4bfc => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:20.093742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3c58b-0b9e-480a-938d-bb9aea5d58ae None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:20.138262 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 72/137] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:20.149655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:20.210060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3c58b-0b9e-480a-938d-bb9aea5d58ae None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:20.247687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe35c0-ae6b-47e1-ad15-0e856e9c1a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:20.248605 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe35c0-ae6b-47e1-ad15-0e856e9c1a71 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:20.249066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe35c0-ae6b-47e1-ad15-0e856e9c1a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:20.249550 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe35c0-ae6b-47e1-ad15-0e856e9c1a71 None admin] PATH_INFO: `/v3/projects/983ff0ca118a4df98dccb931b0dcf86b` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:20.250895 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe35c0-ae6b-47e1-ad15-0e856e9c1a71 None admin] RBAC: Authorizing `identity:get_project(project_id=983ff0ca118a4df98dccb931b0dcf86b)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:20.252601 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe35c0-ae6b-47e1-ad15-0e856e9c1a71 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:20.255366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 66/138] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:20 2022] GET /identity/v3/projects/983ff0ca118a4df98dccb931b0dcf86b => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:20.261128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e04b34-96c0-447d-a210-a8b533579781 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:20.375099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e04b34-96c0-447d-a210-a8b533579781 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:20.415866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecce2d8-bc01-4777-a961-c6f845dc2a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:20.416848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecce2d8-bc01-4777-a961-c6f845dc2a61 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:20.417329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecce2d8-bc01-4777-a961-c6f845dc2a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:20.417779 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecce2d8-bc01-4777-a961-c6f845dc2a61 None admin] PATH_INFO: `/v3/projects/983ff0ca118a4df98dccb931b0dcf86b/users/d2e3112275334ef6a07084887adb4bfc/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:20.419953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecce2d8-bc01-4777-a961-c6f845dc2a61 None admin] RBAC: Authorizing `identity:create_grant(project_id=983ff0ca118a4df98dccb931b0dcf86b, user_id=d2e3112275334ef6a07084887adb4bfc, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:20.421605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecce2d8-bc01-4777-a961-c6f845dc2a61 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:20.516588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe35c0-ae6b-47e1-ad15-0e856e9c1a71 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:20.544923 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 73/139] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:24:20 2022] PUT /identity/v3/projects/983ff0ca118a4df98dccb931b0dcf86b/users/d2e3112275334ef6a07084887adb4bfc/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:24:20.672300 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe35c0-ae6b-47e1-ad15-0e856e9c1a71 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:20.692304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:20.720488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e364c5-7b87-4b9a-8990-f309258df796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:20.721251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e364c5-7b87-4b9a-8990-f309258df796 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:20.721538 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e364c5-7b87-4b9a-8990-f309258df796 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:20.721814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e364c5-7b87-4b9a-8990-f309258df796 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:20.723984 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e364c5-7b87-4b9a-8990-f309258df796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:20.725583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e364c5-7b87-4b9a-8990-f309258df796 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:20.727780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 67/140] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:20.734053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecce2d8-bc01-4777-a961-c6f845dc2a61 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:20.780260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:20.864171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecce2d8-bc01-4777-a961-c6f845dc2a61 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:20.900973 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49f1b0-e0bb-4e89-91a3-b863a4284bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:20.901617 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49f1b0-e0bb-4e89-91a3-b863a4284bc7 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:20.901898 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49f1b0-e0bb-4e89-91a3-b863a4284bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:20.902172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49f1b0-e0bb-4e89-91a3-b863a4284bc7 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:20.902836 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49f1b0-e0bb-4e89-91a3-b863a4284bc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:20.904291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49f1b0-e0bb-4e89-91a3-b863a4284bc7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:21.012675 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 74/141] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:24:20 2022] POST /identity/v3/users => generated 283 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:24:22.353150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7dbd2-df0c-426f-957d-934def4a7b32 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:22.353150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7dbd2-df0c-426f-957d-934def4a7b32 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:22.353150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7dbd2-df0c-426f-957d-934def4a7b32 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:22.353150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 68/142] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:22.358378 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387ccae-dd28-41ca-aa79-5c7dfb6e4aba None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:22.359158 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387ccae-dd28-41ca-aa79-5c7dfb6e4aba None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:22.359773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387ccae-dd28-41ca-aa79-5c7dfb6e4aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:22.388717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b387ccae-dd28-41ca-aa79-5c7dfb6e4aba None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:22.390269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b387ccae-dd28-41ca-aa79-5c7dfb6e4aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:22.489094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 75/143] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:22.615281 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859fac-5165-4b72-a4e9-86beb9bebedb None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:22.615905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859fac-5165-4b72-a4e9-86beb9bebedb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:22.616393 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859fac-5165-4b72-a4e9-86beb9bebedb None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:22.618065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 69/144] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:22.627624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbea1e-9fdc-4a3e-93cd-7cd81018afb4 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:22.627978 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbea1e-9fdc-4a3e-93cd-7cd81018afb4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:22.628568 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbea1e-9fdc-4a3e-93cd-7cd81018afb4 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:22.630102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 76/145] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:22.632276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437b716-a73f-4ed8-b9fe-973792e46d0f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:22.632563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437b716-a73f-4ed8-b9fe-973792e46d0f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:22.632838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437b716-a73f-4ed8-b9fe-973792e46d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:22.639867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ae3d-ae44-49f6-951c-392be5e67f28 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:22.640140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ae3d-ae44-49f6-951c-392be5e67f28 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:22.640407 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ae3d-ae44-49f6-951c-392be5e67f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:22.661293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6437b716-a73f-4ed8-b9fe-973792e46d0f None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:22.662482 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6437b716-a73f-4ed8-b9fe-973792e46d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:22.684079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b120ae3d-ae44-49f6-951c-392be5e67f28 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:22.685296 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b120ae3d-ae44-49f6-951c-392be5e67f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:22.717104 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:22.804719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 70/146] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:22.823679 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 77/147] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:22.885313 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437b716-a73f-4ed8-b9fe-973792e46d0f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:23.001002 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437b716-a73f-4ed8-b9fe-973792e46d0f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:23.013187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:23.043813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef5ad-9ff8-4738-b6fe-da07f4c9768f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:23.044459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef5ad-9ff8-4738-b6fe-da07f4c9768f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:23.044737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef5ad-9ff8-4738-b6fe-da07f4c9768f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:23.045066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef5ad-9ff8-4738-b6fe-da07f4c9768f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:23.066131 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efef5ad-9ff8-4738-b6fe-da07f4c9768f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-9efef5ad-9ff8-4738-b6fe-da07f4c9768f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:23.076146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:23.077044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:23.078258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:23.078258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:23.078258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:23.078258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:23.078258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:23.078258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:23.078258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:23.078258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:23.078258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:23.078258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:23.078258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:23.078258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:23.078258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 71/148] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:24:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:23.085613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ae3d-ae44-49f6-951c-392be5e67f28 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:23.225577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ae3d-ae44-49f6-951c-392be5e67f28 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:23.241485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef5ad-9ff8-4738-b6fe-da07f4c9768f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:23.265864 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac8737-5bfb-4c93-9b38-22737890bce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:23.266630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac8737-5bfb-4c93-9b38-22737890bce1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:23.266915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac8737-5bfb-4c93-9b38-22737890bce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:23.267328 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac8737-5bfb-4c93-9b38-22737890bce1 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:23.268008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac8737-5bfb-4c93-9b38-22737890bce1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:23.268314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac8737-5bfb-4c93-9b38-22737890bce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:23.270716 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac8737-5bfb-4c93-9b38-22737890bce1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:23.287507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 78/149] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:24:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:23.293962 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac8737-5bfb-4c93-9b38-22737890bce1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:23.312453 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:23.433302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef5ad-9ff8-4738-b6fe-da07f4c9768f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:23.475066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac8737-5bfb-4c93-9b38-22737890bce1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:23.501781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ca3d5-430f-4300-a7e8-f60df752eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:23.502348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca3d5-430f-4300-a7e8-f60df752eab1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:23.502635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca3d5-430f-4300-a7e8-f60df752eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:23.502915 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca3d5-430f-4300-a7e8-f60df752eab1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:23.524642 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ca3d5-430f-4300-a7e8-f60df752eab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-ba9ca3d5-430f-4300-a7e8-f60df752eab1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:23.529562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:23.532014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:23.533944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:23.533944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:23.533944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:23.533944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:23.533944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:23.533944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:23.533944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:23.533944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:23.533944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:23.533944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:23.533944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:23.533944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:23.533944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 72/150] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:24:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:24:23.533944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ca3d5-430f-4300-a7e8-f60df752eab1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:23.542438 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7a3b1-7bcd-42b4-97ba-9991d037431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:23.543087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7a3b1-7bcd-42b4-97ba-9991d037431b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:23.543369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7a3b1-7bcd-42b4-97ba-9991d037431b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:23.543643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7a3b1-7bcd-42b4-97ba-9991d037431b None admin] PATH_INFO: `/v3/users/d2e3112275334ef6a07084887adb4bfc` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:23.547006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7a3b1-7bcd-42b4-97ba-9991d037431b None admin] RBAC: Authorizing `identity:get_user(user_id=d2e3112275334ef6a07084887adb4bfc)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:23.548467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7a3b1-7bcd-42b4-97ba-9991d037431b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:23.554383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 79/151] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:23 2022] GET /identity/v3/users/d2e3112275334ef6a07084887adb4bfc => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:23.555230 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7a3b1-7bcd-42b4-97ba-9991d037431b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:23.601568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:23.709559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:23.736482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7a3b1-7bcd-42b4-97ba-9991d037431b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:23.787584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ca3d5-430f-4300-a7e8-f60df752eab1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:23.802214 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63a925-a603-4741-b765-8f34a3127ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:23.802840 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63a925-a603-4741-b765-8f34a3127ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:23.803126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63a925-a603-4741-b765-8f34a3127ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:23.803414 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63a925-a603-4741-b765-8f34a3127ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:23.804096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63a925-a603-4741-b765-8f34a3127ca8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:23.804408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63a925-a603-4741-b765-8f34a3127ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:23.805844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63a925-a603-4741-b765-8f34a3127ca8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:23.829465 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 80/152] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:23.830171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63a925-a603-4741-b765-8f34a3127ca8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:23.908216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e8920-5ae5-457f-8ca0-8e8330c1db2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:23.908880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e8920-5ae5-457f-8ca0-8e8330c1db2c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:23.909159 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e8920-5ae5-457f-8ca0-8e8330c1db2c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:23.909593 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e8920-5ae5-457f-8ca0-8e8330c1db2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:23.938651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e8920-5ae5-457f-8ca0-8e8330c1db2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-ae7e8920-5ae5-457f-8ca0-8e8330c1db2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:23.946420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:23.947461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:23.948304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:23.948304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:23.948304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:23.948304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:23.948304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:23.948304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:23.948304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:23.948304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:23.948304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:23.948304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:23.948304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:23.948304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:23.954623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 73/153] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:23.955929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5e668-bf8c-42b0-a64a-ea07b46426e9 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:23.956853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5e668-bf8c-42b0-a64a-ea07b46426e9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:23.957115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5e668-bf8c-42b0-a64a-ea07b46426e9 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:23.958516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 74/154] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:23.966138 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5e668-bf8c-42b0-a64a-ea07b46426e9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:24.063548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63a925-a603-4741-b765-8f34a3127ca8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:24.126712 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221ccce-26a6-493f-aa06-4abd11376a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:24.127322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221ccce-26a6-493f-aa06-4abd11376a8b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:24.128633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221ccce-26a6-493f-aa06-4abd11376a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:24.128917 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221ccce-26a6-493f-aa06-4abd11376a8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:24.150757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:24.165258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:24.185164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5e668-bf8c-42b0-a64a-ea07b46426e9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:24.240449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c0b7-3125-4c77-a0a5-b8b48a4449d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:24.241148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c0b7-3125-4c77-a0a5-b8b48a4449d1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:24.241458 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c0b7-3125-4c77-a0a5-b8b48a4449d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:24.241732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c0b7-3125-4c77-a0a5-b8b48a4449d1 None admin] PATH_INFO: `/v3/users/f8d87aca886c4c2eb2651db46e0ae180` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:24.245219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33c0b7-3125-4c77-a0a5-b8b48a4449d1 None admin] RBAC: Authorizing `identity:get_user(user_id=f8d87aca886c4c2eb2651db46e0ae180)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:24.245219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33c0b7-3125-4c77-a0a5-b8b48a4449d1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:24.246596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 75/155] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:23 2022] GET /identity/v3/users/f8d87aca886c4c2eb2651db46e0ae180 => generated 247 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:24.247411 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c0b7-3125-4c77-a0a5-b8b48a4449d1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:24.310060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221ccce-26a6-493f-aa06-4abd11376a8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:24.311809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221ccce-26a6-493f-aa06-4abd11376a8b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:24.356791 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c0b7-3125-4c77-a0a5-b8b48a4449d1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:24.393560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a209107-3ccc-497e-9490-7e0ba01b9ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:24.394294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a209107-3ccc-497e-9490-7e0ba01b9ebf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:24.394978 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a209107-3ccc-497e-9490-7e0ba01b9ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:24.395523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a209107-3ccc-497e-9490-7e0ba01b9ebf None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:24.396198 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a209107-3ccc-497e-9490-7e0ba01b9ebf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:24.396651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a209107-3ccc-497e-9490-7e0ba01b9ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:24.398278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a209107-3ccc-497e-9490-7e0ba01b9ebf None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:24.407648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 76/156] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:24.408986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36223303-ad1a-4b9f-bdb4-6f217cd082c6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:24.409336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36223303-ad1a-4b9f-bdb4-6f217cd082c6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:24.410430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36223303-ad1a-4b9f-bdb4-6f217cd082c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:24.431072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-36223303-ad1a-4b9f-bdb4-6f217cd082c6 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:24.432344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-36223303-ad1a-4b9f-bdb4-6f217cd082c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:24.481225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:24.506052 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 77/157] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:24.507467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c743881-d2ca-4347-80c4-10cdaea2505b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:24.507756 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c743881-d2ca-4347-80c4-10cdaea2505b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:24.508030 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c743881-d2ca-4347-80c4-10cdaea2505b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:24.509384 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 78/158] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:24.510144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c743881-d2ca-4347-80c4-10cdaea2505b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:24.563493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 81/159] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:24.565047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221ccce-26a6-493f-aa06-4abd11376a8b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:24.630110 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c743881-d2ca-4347-80c4-10cdaea2505b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:24.673831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff8549-5bbc-47b1-ac1e-bccae6cc3bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:24.674565 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff8549-5bbc-47b1-ac1e-bccae6cc3bff None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:24.674851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff8549-5bbc-47b1-ac1e-bccae6cc3bff None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:24.675719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff8549-5bbc-47b1-ac1e-bccae6cc3bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:24.711640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:24.730798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:24.836863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221ccce-26a6-493f-aa06-4abd11376a8b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:24.853154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff8549-5bbc-47b1-ac1e-bccae6cc3bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:24.854760 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff8549-5bbc-47b1-ac1e-bccae6cc3bff None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:24.878512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7ab16-555f-483d-be96-f5c1296cff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:24.879950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ab16-555f-483d-be96-f5c1296cff7c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:24.880496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ab16-555f-483d-be96-f5c1296cff7c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:24.880969 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ab16-555f-483d-be96-f5c1296cff7c None admin] PATH_INFO: `/v3/users/b255b863112f4c9fb7dc042284b0979a` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:24.882379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7ab16-555f-483d-be96-f5c1296cff7c None admin] RBAC: Authorizing `identity:get_user(user_id=b255b863112f4c9fb7dc042284b0979a)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:24.884037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7ab16-555f-483d-be96-f5c1296cff7c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:24.886000 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 82/160] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:24 2022] GET /identity/v3/users/b255b863112f4c9fb7dc042284b0979a => generated 289 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:24.887482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987271b2-5e90-41cf-972c-6930c43e1752 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:24.888014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987271b2-5e90-41cf-972c-6930c43e1752 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:24.888648 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987271b2-5e90-41cf-972c-6930c43e1752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:24.911425 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-987271b2-5e90-41cf-972c-6930c43e1752 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:24.913416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-987271b2-5e90-41cf-972c-6930c43e1752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:24.983243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 79/161] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:24.983883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff8549-5bbc-47b1-ac1e-bccae6cc3bff None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:24.996787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 83/162] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:24.998487 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf95e7-89cc-4532-888d-8c2705e2df03 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:24.998973 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf95e7-89cc-4532-888d-8c2705e2df03 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:24.999454 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf95e7-89cc-4532-888d-8c2705e2df03 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:25.000910 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 84/163] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:25.001871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf95e7-89cc-4532-888d-8c2705e2df03 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:25.053586 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:25.107534 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:25.118884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf95e7-89cc-4532-888d-8c2705e2df03 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:25.160056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e80315-4dee-44d6-a54d-5c577fab39d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:25.160866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e80315-4dee-44d6-a54d-5c577fab39d0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:25.161292 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e80315-4dee-44d6-a54d-5c577fab39d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:25.161751 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e80315-4dee-44d6-a54d-5c577fab39d0 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:25.163029 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e80315-4dee-44d6-a54d-5c577fab39d0 None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:25.164586 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e80315-4dee-44d6-a54d-5c577fab39d0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:25.173281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 85/164] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:25 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:25.173281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e80315-4dee-44d6-a54d-5c577fab39d0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:25.220580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff8549-5bbc-47b1-ac1e-bccae6cc3bff None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:25.283009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e80315-4dee-44d6-a54d-5c577fab39d0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:25.292182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:25.320975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83510d49-45ad-4d80-b3e7-f55dd1747e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:25.321795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83510d49-45ad-4d80-b3e7-f55dd1747e8c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:25.322170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83510d49-45ad-4d80-b3e7-f55dd1747e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:25.322543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83510d49-45ad-4d80-b3e7-f55dd1747e8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:25.333916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8b69-c890-42d9-b206-c7dfff48db83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:25.334616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83510d49-45ad-4d80-b3e7-f55dd1747e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:25.334744 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8b69-c890-42d9-b206-c7dfff48db83 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:25.335017 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8b69-c890-42d9-b206-c7dfff48db83 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:25.335294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8b69-c890-42d9-b206-c7dfff48db83 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-83510d49-45ad-4d80-b3e7-f55dd1747e8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:25.339918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:25.340830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:25.341630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:25.341630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:25.341630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:25.341630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:25.341630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:25.341630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:25.341630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:25.341630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:25.341630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:25.341630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:25.341630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:25.341630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:25.341630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 86/165] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:25.342461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b8b69-c890-42d9-b206-c7dfff48db83 None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:25.342536 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83510d49-45ad-4d80-b3e7-f55dd1747e8c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:25.343319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b8b69-c890-42d9-b206-c7dfff48db83 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:25.345041 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 80/166] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:24 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:25.346068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03779e41-736a-4214-b4b1-80975e42117d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:25.346346 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03779e41-736a-4214-b4b1-80975e42117d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:25.346615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03779e41-736a-4214-b4b1-80975e42117d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:25.389514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-03779e41-736a-4214-b4b1-80975e42117d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:25.391905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-03779e41-736a-4214-b4b1-80975e42117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:25.474963 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 81/167] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:25.476343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03779e41-736a-4214-b4b1-80975e42117d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:25.495387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83510d49-45ad-4d80-b3e7-f55dd1747e8c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:25.530150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:25.539885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73b570-82e5-4399-98f7-cd4072921133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:25.540513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73b570-82e5-4399-98f7-cd4072921133 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:25.540787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73b570-82e5-4399-98f7-cd4072921133 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:25.541877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73b570-82e5-4399-98f7-cd4072921133 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:25.543536 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73b570-82e5-4399-98f7-cd4072921133 None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:25.544973 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73b570-82e5-4399-98f7-cd4072921133 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:25.546659 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 87/168] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:25 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:25.547376 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73b570-82e5-4399-98f7-cd4072921133 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:25.590625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:25.595574 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03779e41-736a-4214-b4b1-80975e42117d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:25.633251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad9ac1-4baf-4e5a-b279-01f7c1814680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:25.634326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad9ac1-4baf-4e5a-b279-01f7c1814680 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:25.634804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad9ac1-4baf-4e5a-b279-01f7c1814680 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:25.635291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad9ac1-4baf-4e5a-b279-01f7c1814680 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2/users/b255b863112f4c9fb7dc042284b0979a/roles/1d182987dff1438492d3b48c532573c0` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:25.637667 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad9ac1-4baf-4e5a-b279-01f7c1814680 None admin] RBAC: Authorizing `identity:create_grant(project_id=caf2c8ab542845ae9205702525b855e2, user_id=b255b863112f4c9fb7dc042284b0979a, role_id=1d182987dff1438492d3b48c532573c0)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:25.639447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad9ac1-4baf-4e5a-b279-01f7c1814680 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:25.663696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73b570-82e5-4399-98f7-cd4072921133 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:25.697699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ab045-5bb4-40f1-9b0e-b1998a1dc227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:25.698304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ab045-5bb4-40f1-9b0e-b1998a1dc227 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:25.698570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ab045-5bb4-40f1-9b0e-b1998a1dc227 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:25.698906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ab045-5bb4-40f1-9b0e-b1998a1dc227 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:25.699563 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ab045-5bb4-40f1-9b0e-b1998a1dc227 None admin] RBAC: Adding query filter params (name=member) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:25.699860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ab045-5bb4-40f1-9b0e-b1998a1dc227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:25.701246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ab045-5bb4-40f1-9b0e-b1998a1dc227 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:25.710637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 88/169] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:25.711319 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ab045-5bb4-40f1-9b0e-b1998a1dc227 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:25.724401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 82/170] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:24:25 2022] PUT /identity/v3/projects/caf2c8ab542845ae9205702525b855e2/users/b255b863112f4c9fb7dc042284b0979a/roles/1d182987dff1438492d3b48c532573c0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:24:25.731445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad9ac1-4baf-4e5a-b279-01f7c1814680 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:25.862068 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:25.868556 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ab045-5bb4-40f1-9b0e-b1998a1dc227 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:25.881225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad9ac1-4baf-4e5a-b279-01f7c1814680 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:25.890807 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:25.912182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29ac89-228e-4bdd-ab4f-70806990782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:25.912792 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ac89-228e-4bdd-ab4f-70806990782b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:25.913074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ac89-228e-4bdd-ab4f-70806990782b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:25.913403 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ac89-228e-4bdd-ab4f-70806990782b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:25.914229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29ac89-228e-4bdd-ab4f-70806990782b None admin] RBAC: Adding query filter params (role.id=0c9ebbeca1134eb4914025ef4cf80f5c, scope.project.id=caf2c8ab542845ae9205702525b855e2, user.id=d2e3112275334ef6a07084887adb4bfc) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:25.914477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29ac89-228e-4bdd-ab4f-70806990782b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:25.915917 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29ac89-228e-4bdd-ab4f-70806990782b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:25.921148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60315b-2c51-4307-aaf9-6a7e8761e967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:25.922198 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 89/171] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:25 2022] GET /identity/v3/role_assignments?user.id=d2e3112275334ef6a07084887adb4bfc&scope.project.id=caf2c8ab542845ae9205702525b855e2&role.id=0c9ebbeca1134eb4914025ef4cf80f5c => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:25.922390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60315b-2c51-4307-aaf9-6a7e8761e967 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:25.923007 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60315b-2c51-4307-aaf9-6a7e8761e967 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:25.923637 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60315b-2c51-4307-aaf9-6a7e8761e967 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:25.932084 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29ac89-228e-4bdd-ab4f-70806990782b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:25.942429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60315b-2c51-4307-aaf9-6a7e8761e967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1e60315b-2c51-4307-aaf9-6a7e8761e967 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:25.950352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:25.951490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:25.952516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:25.952516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:25.952516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:25.952516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:25.952516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:25.952516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:25.952516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:25.952516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:25.952516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:25.952516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:25.952516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:25.952516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:25.955740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 83/172] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:25.958432 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3edb63-ba40-4370-a27b-e205bdd95f42 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:25.958885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3edb63-ba40-4370-a27b-e205bdd95f42 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:25.959293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3edb63-ba40-4370-a27b-e205bdd95f42 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:25.961403 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 84/173] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:25.962843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3edb63-ba40-4370-a27b-e205bdd95f42 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:26.068210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29ac89-228e-4bdd-ab4f-70806990782b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:26.110183 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3edb63-ba40-4370-a27b-e205bdd95f42 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:26.110804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdf26b-c34c-49d6-bc9e-8cacbbda321f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:26.111635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdf26b-c34c-49d6-bc9e-8cacbbda321f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:26.112010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdf26b-c34c-49d6-bc9e-8cacbbda321f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:26.112382 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdf26b-c34c-49d6-bc9e-8cacbbda321f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:26.114064 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdf26b-c34c-49d6-bc9e-8cacbbda321f None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=caf2c8ab542845ae9205702525b855e2, user.id=f8d87aca886c4c2eb2651db46e0ae180) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:26.114458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdf26b-c34c-49d6-bc9e-8cacbbda321f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:26.115908 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdf26b-c34c-49d6-bc9e-8cacbbda321f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:26.124330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 90/174] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:25 2022] GET /identity/v3/role_assignments?user.id=f8d87aca886c4c2eb2651db46e0ae180&scope.project.id=caf2c8ab542845ae9205702525b855e2&role.id=1896db68dc754d5293037ab100ce46d9 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:26.125349 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a8a9f-08df-429e-a417-3685d2405676 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:26.125636 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a8a9f-08df-429e-a417-3685d2405676 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:26.125914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a8a9f-08df-429e-a417-3685d2405676 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:26.127570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 91/175] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:26.128875 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a8a9f-08df-429e-a417-3685d2405676 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:26.157253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bb72b-e68c-46dd-97e4-7fb71a773704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:26.158307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb72b-e68c-46dd-97e4-7fb71a773704 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:26.159577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb72b-e68c-46dd-97e4-7fb71a773704 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:26.160064 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb72b-e68c-46dd-97e4-7fb71a773704 None admin] PATH_INFO: `/v3/users/d2e3112275334ef6a07084887adb4bfc` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:26.162391 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bb72b-e68c-46dd-97e4-7fb71a773704 None admin] RBAC: Authorizing `identity:get_user(user_id=d2e3112275334ef6a07084887adb4bfc)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:26.164566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bb72b-e68c-46dd-97e4-7fb71a773704 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:26.165540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:26.168225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 85/176] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:25 2022] GET /identity/v3/users/d2e3112275334ef6a07084887adb4bfc => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:26.169654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bb72b-e68c-46dd-97e4-7fb71a773704 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:26.221628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:26.293191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a8a9f-08df-429e-a417-3685d2405676 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:26.323416 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bb72b-e68c-46dd-97e4-7fb71a773704 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:26.338884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b4d22-3556-43d5-9083-02d9bacd6cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:26.339651 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b4d22-3556-43d5-9083-02d9bacd6cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:26.339930 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b4d22-3556-43d5-9083-02d9bacd6cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:26.340202 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b4d22-3556-43d5-9083-02d9bacd6cd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:26.352142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b4d22-3556-43d5-9083-02d9bacd6cd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-e01b4d22-3556-43d5-9083-02d9bacd6cd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:26.357001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:26.358041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:26.358995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:26.358995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:26.358995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:26.358995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:26.358995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:26.358995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:26.358995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:26.358995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:26.358995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:26.358995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:26.358995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:26.358995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:26.365295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 92/177] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:24:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:26.365295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e8627-17ba-4cc0-bbc4-07e75b384b45 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:26.365295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e8627-17ba-4cc0-bbc4-07e75b384b45 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:26.365295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e8627-17ba-4cc0-bbc4-07e75b384b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:26.372480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d422c80-9af0-48c8-8a07-eb433c08c592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:26.373110 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d422c80-9af0-48c8-8a07-eb433c08c592 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:26.374364 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d422c80-9af0-48c8-8a07-eb433c08c592 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:26.374648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d422c80-9af0-48c8-8a07-eb433c08c592 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:26.375330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d422c80-9af0-48c8-8a07-eb433c08c592 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:26.375636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d422c80-9af0-48c8-8a07-eb433c08c592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:26.377027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d422c80-9af0-48c8-8a07-eb433c08c592 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:26.384542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-505e8627-17ba-4cc0-bbc4-07e75b384b45 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:26.385779 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-505e8627-17ba-4cc0-bbc4-07e75b384b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:26.387029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 86/178] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:26.388270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bb710-3bf5-444d-9f2b-31275a7b38b4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:26.388560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bb710-3bf5-444d-9f2b-31275a7b38b4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:26.389647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bb710-3bf5-444d-9f2b-31275a7b38b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:26.409717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c95bb710-3bf5-444d-9f2b-31275a7b38b4 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:26.410921 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c95bb710-3bf5-444d-9f2b-31275a7b38b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:26.460488 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 93/179] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:26.461769 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e8627-17ba-4cc0-bbc4-07e75b384b45 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:26.477896 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:26.504668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 87/180] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:26.505982 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bb710-3bf5-444d-9f2b-31275a7b38b4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:26.540234 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:26.627969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bb710-3bf5-444d-9f2b-31275a7b38b4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:26.635369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e8627-17ba-4cc0-bbc4-07e75b384b45 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:26.673943 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e7efb-8aa9-458d-8c91-258d6c6d8ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:26.675167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7efb-8aa9-458d-8c91-258d6c6d8ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:26.675618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7efb-8aa9-458d-8c91-258d6c6d8ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:26.676036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7efb-8aa9-458d-8c91-258d6c6d8ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:26.677105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e7efb-8aa9-458d-8c91-258d6c6d8ae7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:26.678003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e7efb-8aa9-458d-8c91-258d6c6d8ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:26.680140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e7efb-8aa9-458d-8c91-258d6c6d8ae7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:26.682615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d4340-9cc9-44f8-a9ea-863b7e6310ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:26.683653 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4340-9cc9-44f8-a9ea-863b7e6310ff None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:26.684026 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4340-9cc9-44f8-a9ea-863b7e6310ff None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:26.684396 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4340-9cc9-44f8-a9ea-863b7e6310ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:26.691524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 88/181] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:26.692483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e7efb-8aa9-458d-8c91-258d6c6d8ae7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:26.795782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d4340-9cc9-44f8-a9ea-863b7e6310ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:26.797279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d4340-9cc9-44f8-a9ea-863b7e6310ff None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:26.813474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:26.841466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:26.854065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e7efb-8aa9-458d-8c91-258d6c6d8ae7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:26.892366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca9dd9-ae49-4ee4-9937-73fdb24bf4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:26.893271 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9dd9-ae49-4ee4-9937-73fdb24bf4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:26.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9dd9-ae49-4ee4-9937-73fdb24bf4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:26.894920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9dd9-ae49-4ee4-9937-73fdb24bf4c1 None admin] PATH_INFO: `/v3/users/d2e3112275334ef6a07084887adb4bfc` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:26.896449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca9dd9-ae49-4ee4-9937-73fdb24bf4c1 None admin] RBAC: Authorizing `identity:get_user(user_id=d2e3112275334ef6a07084887adb4bfc)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:26.897919 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca9dd9-ae49-4ee4-9937-73fdb24bf4c1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:26.899729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 89/182] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:26 2022] GET /identity/v3/users/d2e3112275334ef6a07084887adb4bfc => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:26.900503 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca9dd9-ae49-4ee4-9937-73fdb24bf4c1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:26.908690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 94/183] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:26.910305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d4340-9cc9-44f8-a9ea-863b7e6310ff None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:27.013466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca9dd9-ae49-4ee4-9937-73fdb24bf4c1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:27.021114 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d4340-9cc9-44f8-a9ea-863b7e6310ff None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:27.036174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:27.049723 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fdded-e6e9-4d86-84fd-3da489ea7067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:27.051234 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fdded-e6e9-4d86-84fd-3da489ea7067 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:27.051707 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fdded-e6e9-4d86-84fd-3da489ea7067 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:27.052182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fdded-e6e9-4d86-84fd-3da489ea7067 None admin] PATH_INFO: `/v3/users/b9795dad3ecc4fc6a7c7d50da491e93c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:27.062610 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f216eeb-04f7-4012-bb99-49e86c6e4cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:27.063470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f216eeb-04f7-4012-bb99-49e86c6e4cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:27.063919 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f216eeb-04f7-4012-bb99-49e86c6e4cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:27.064360 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f216eeb-04f7-4012-bb99-49e86c6e4cc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:27.068744 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fdded-e6e9-4d86-84fd-3da489ea7067 None admin] RBAC: Authorizing `identity:get_user(user_id=b9795dad3ecc4fc6a7c7d50da491e93c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:27.070218 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fdded-e6e9-4d86-84fd-3da489ea7067 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:27.072040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 90/184] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:26 2022] GET /identity/v3/users/b9795dad3ecc4fc6a7c7d50da491e93c => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:27.072638 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fdded-e6e9-4d86-84fd-3da489ea7067 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:27.086380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f216eeb-04f7-4012-bb99-49e86c6e4cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-6f216eeb-04f7-4012-bb99-49e86c6e4cc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:27.091745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:27.092635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:27.093505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:27.093505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:27.093505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:27.093505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:27.093505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:27.093505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:27.093505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:27.093505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:27.093505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:27.093505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:27.093505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:27.093505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:27.093505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 95/185] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:24:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:27.094271 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f216eeb-04f7-4012-bb99-49e86c6e4cc4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:27.102790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:27.186691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fdded-e6e9-4d86-84fd-3da489ea7067 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:27.213738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f216eeb-04f7-4012-bb99-49e86c6e4cc4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:27.223209 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6537fc-164e-4434-ae90-44957def5559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:27.223854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6537fc-164e-4434-ae90-44957def5559 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:27.224135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6537fc-164e-4434-ae90-44957def5559 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:27.224406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6537fc-164e-4434-ae90-44957def5559 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:27.225560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6537fc-164e-4434-ae90-44957def5559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:27.227003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6537fc-164e-4434-ae90-44957def5559 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:27.228576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 91/186] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:27.229344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6537fc-164e-4434-ae90-44957def5559 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:27.255785 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ef7cc-0d74-41b4-b8b5-e97a2abb48b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:27.256409 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ef7cc-0d74-41b4-b8b5-e97a2abb48b9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:27.256678 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ef7cc-0d74-41b4-b8b5-e97a2abb48b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:27.256952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ef7cc-0d74-41b4-b8b5-e97a2abb48b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:27.304245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:27.323950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:27.330730 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ef7cc-0d74-41b4-b8b5-e97a2abb48b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:27.332266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ef7cc-0d74-41b4-b8b5-e97a2abb48b9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:27.340699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6537fc-164e-4434-ae90-44957def5559 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:27.378697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833c72b-63a3-46c5-8b25-b006e8e874e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:27.379558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833c72b-63a3-46c5-8b25-b006e8e874e0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:27.379843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833c72b-63a3-46c5-8b25-b006e8e874e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:27.380110 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833c72b-63a3-46c5-8b25-b006e8e874e0 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:27.381289 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833c72b-63a3-46c5-8b25-b006e8e874e0 None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:27.382742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833c72b-63a3-46c5-8b25-b006e8e874e0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:27.388991 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 92/187] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:27 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:27.388991 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833c72b-63a3-46c5-8b25-b006e8e874e0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:27.452261 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 96/188] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:27.452261 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ef7cc-0d74-41b4-b8b5-e97a2abb48b9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:27.493679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833c72b-63a3-46c5-8b25-b006e8e874e0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:27.528527 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc51a3-59a5-48a6-aa1b-4dc68c597624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:27.529136 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc51a3-59a5-48a6-aa1b-4dc68c597624 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:27.529440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc51a3-59a5-48a6-aa1b-4dc68c597624 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:27.529711 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc51a3-59a5-48a6-aa1b-4dc68c597624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:27.532510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:27.551743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:27.560886 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ef7cc-0d74-41b4-b8b5-e97a2abb48b9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:27.598310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78654094-234d-4402-878c-f9fbb5148548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:27.598921 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78654094-234d-4402-878c-f9fbb5148548 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:27.599199 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78654094-234d-4402-878c-f9fbb5148548 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:27.599471 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78654094-234d-4402-878c-f9fbb5148548 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:27.600144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78654094-234d-4402-878c-f9fbb5148548 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:27.600443 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78654094-234d-4402-878c-f9fbb5148548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:27.601866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78654094-234d-4402-878c-f9fbb5148548 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:27.603384 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc51a3-59a5-48a6-aa1b-4dc68c597624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:27.604912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc51a3-59a5-48a6-aa1b-4dc68c597624 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:27.614940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 97/189] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:24:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:27.614940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78654094-234d-4402-878c-f9fbb5148548 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:27.714088 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 93/190] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:27.715175 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc51a3-59a5-48a6-aa1b-4dc68c597624 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:27.726595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78654094-234d-4402-878c-f9fbb5148548 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:27.762231 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a20d5-f5fe-4e2a-a87d-01fb8211d939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:27.762831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a20d5-f5fe-4e2a-a87d-01fb8211d939 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:27.763105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a20d5-f5fe-4e2a-a87d-01fb8211d939 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:27.763372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a20d5-f5fe-4e2a-a87d-01fb8211d939 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:27.764015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a20d5-f5fe-4e2a-a87d-01fb8211d939 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:27.765480 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a20d5-f5fe-4e2a-a87d-01fb8211d939 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:27.775073 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:27.776922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:27.826518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc51a3-59a5-48a6-aa1b-4dc68c597624 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:27.863492 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d90e9-0456-4bb6-b22c-19593513aec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:27.864094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d90e9-0456-4bb6-b22c-19593513aec3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:27.864373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d90e9-0456-4bb6-b22c-19593513aec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:27.864644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d90e9-0456-4bb6-b22c-19593513aec3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:27.865397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d90e9-0456-4bb6-b22c-19593513aec3 None admin] RBAC: Adding query filter params (role.id=64f2951b9ce444bcad20c61347224196, scope.project.id=caf2c8ab542845ae9205702525b855e2, user.id=d2e3112275334ef6a07084887adb4bfc) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:27.865706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d90e9-0456-4bb6-b22c-19593513aec3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:27.867167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d90e9-0456-4bb6-b22c-19593513aec3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:27.872782 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 94/191] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:27 2022] GET /identity/v3/role_assignments?user.id=d2e3112275334ef6a07084887adb4bfc&scope.project.id=caf2c8ab542845ae9205702525b855e2&role.id=64f2951b9ce444bcad20c61347224196 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:27.872995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 98/192] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:24:27 2022] POST /identity/v3/users => generated 297 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:24:27.873579 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d90e9-0456-4bb6-b22c-19593513aec3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:27.873854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a20d5-f5fe-4e2a-a87d-01fb8211d939 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:28.015673 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d90e9-0456-4bb6-b22c-19593513aec3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:28.038151 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:28.040507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a20d5-f5fe-4e2a-a87d-01fb8211d939 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:28.067278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48a40a-a47a-46fe-952c-efe9f85a8b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:28.068058 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48a40a-a47a-46fe-952c-efe9f85a8b91 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:28.068361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48a40a-a47a-46fe-952c-efe9f85a8b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:28.068634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48a40a-a47a-46fe-952c-efe9f85a8b91 None admin] PATH_INFO: `/v3/projects/983ff0ca118a4df98dccb931b0dcf86b` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:28.069886 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48a40a-a47a-46fe-952c-efe9f85a8b91 None admin] RBAC: Authorizing `identity:get_project(project_id=983ff0ca118a4df98dccb931b0dcf86b)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:28.071360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48a40a-a47a-46fe-952c-efe9f85a8b91 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:28.073012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 95/193] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:27 2022] GET /identity/v3/projects/983ff0ca118a4df98dccb931b0dcf86b => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:28.076294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48a40a-a47a-46fe-952c-efe9f85a8b91 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:28.094985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b352ab-c8df-4494-be6b-32f2fc78460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:28.095692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b352ab-c8df-4494-be6b-32f2fc78460e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:28.096062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b352ab-c8df-4494-be6b-32f2fc78460e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:28.096426 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b352ab-c8df-4494-be6b-32f2fc78460e None admin] PATH_INFO: `/v3/users/b9795dad3ecc4fc6a7c7d50da491e93c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:28.099491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b352ab-c8df-4494-be6b-32f2fc78460e None admin] RBAC: Authorizing `identity:get_user(user_id=b9795dad3ecc4fc6a7c7d50da491e93c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:28.101035 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b352ab-c8df-4494-be6b-32f2fc78460e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:28.103093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 99/194] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:27 2022] GET /identity/v3/users/b9795dad3ecc4fc6a7c7d50da491e93c => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:28.104356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fa054-bf6e-43fb-a5f4-04ad41239281 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:28.104756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fa054-bf6e-43fb-a5f4-04ad41239281 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:28.105125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fa054-bf6e-43fb-a5f4-04ad41239281 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:28.106700 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 100/195] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:28.107495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fa054-bf6e-43fb-a5f4-04ad41239281 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:28.179485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:28.211727 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48a40a-a47a-46fe-952c-efe9f85a8b91 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:28.228171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fa054-bf6e-43fb-a5f4-04ad41239281 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:28.248696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ff2d6-1673-4009-8d58-21e09c2a7ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:28.249427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ff2d6-1673-4009-8d58-21e09c2a7ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:28.249704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ff2d6-1673-4009-8d58-21e09c2a7ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:28.249973 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ff2d6-1673-4009-8d58-21e09c2a7ab3 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:28.251120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ff2d6-1673-4009-8d58-21e09c2a7ab3 None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:28.252572 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ff2d6-1673-4009-8d58-21e09c2a7ab3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:28.255072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 96/196] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:28 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:28.257048 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ff2d6-1673-4009-8d58-21e09c2a7ab3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:28.282056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d4af7-9ae3-40d4-8cdf-65d4f0cc51fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:28.282672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d4af7-9ae3-40d4-8cdf-65d4f0cc51fc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:28.283009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d4af7-9ae3-40d4-8cdf-65d4f0cc51fc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:28.283277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d4af7-9ae3-40d4-8cdf-65d4f0cc51fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:28.284014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d4af7-9ae3-40d4-8cdf-65d4f0cc51fc None admin] RBAC: Adding query filter params (role.id=64f2951b9ce444bcad20c61347224196, scope.project.id=983ff0ca118a4df98dccb931b0dcf86b, user.id=d2e3112275334ef6a07084887adb4bfc) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:28.284883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d4af7-9ae3-40d4-8cdf-65d4f0cc51fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:28.286582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d4af7-9ae3-40d4-8cdf-65d4f0cc51fc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:28.293305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 101/197] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:28 2022] GET /identity/v3/role_assignments?user.id=d2e3112275334ef6a07084887adb4bfc&scope.project.id=983ff0ca118a4df98dccb931b0dcf86b&role.id=64f2951b9ce444bcad20c61347224196 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:28.294521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ffef5-d5e5-49ae-a6d6-c0a5ef59f469 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:28.294785 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ffef5-d5e5-49ae-a6d6-c0a5ef59f469 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:28.295060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ffef5-d5e5-49ae-a6d6-c0a5ef59f469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:28.316699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fa5ffef5-d5e5-49ae-a6d6-c0a5ef59f469 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:28.317952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fa5ffef5-d5e5-49ae-a6d6-c0a5ef59f469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:28.326191 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:28.388058 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ff2d6-1673-4009-8d58-21e09c2a7ab3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:28.411457 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 102/198] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:28.413886 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ffef5-d5e5-49ae-a6d6-c0a5ef59f469 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:28.458760 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41f86a-50fa-4c52-ac55-d557eeba4c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:28.459786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41f86a-50fa-4c52-ac55-d557eeba4c6d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:28.460270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41f86a-50fa-4c52-ac55-d557eeba4c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:28.460747 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41f86a-50fa-4c52-ac55-d557eeba4c6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:28.562687 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:28.604580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41f86a-50fa-4c52-ac55-d557eeba4c6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:28.606069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41f86a-50fa-4c52-ac55-d557eeba4c6d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:28.651424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ffef5-d5e5-49ae-a6d6-c0a5ef59f469 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:28.699012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:28.717401 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6922f41-91d3-4bf6-933a-66959acc51e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:28.718020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6922f41-91d3-4bf6-933a-66959acc51e0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:28.718296 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6922f41-91d3-4bf6-933a-66959acc51e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:28.719027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6922f41-91d3-4bf6-933a-66959acc51e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:28.719289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6922f41-91d3-4bf6-933a-66959acc51e0 None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=5d510566458c49848cdbe57fbe030354, user.id=b9795dad3ecc4fc6a7c7d50da491e93c) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:28.719595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6922f41-91d3-4bf6-933a-66959acc51e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:28.726325 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6922f41-91d3-4bf6-933a-66959acc51e0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:28.740964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 103/199] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:28 2022] GET /identity/v3/role_assignments?user.id=b9795dad3ecc4fc6a7c7d50da491e93c&scope.project.id=5d510566458c49848cdbe57fbe030354&role.id=1896db68dc754d5293037ab100ce46d9 => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:28.789734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 97/200] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:28.795016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6922f41-91d3-4bf6-933a-66959acc51e0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:28.802865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41f86a-50fa-4c52-ac55-d557eeba4c6d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:28.944480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41f86a-50fa-4c52-ac55-d557eeba4c6d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:28.998136 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157edf97-c4aa-45b0-99fa-a64be9b73ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:28.998772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157edf97-c4aa-45b0-99fa-a64be9b73ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:28.999047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157edf97-c4aa-45b0-99fa-a64be9b73ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:28.999317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157edf97-c4aa-45b0-99fa-a64be9b73ff3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:29.018170 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157edf97-c4aa-45b0-99fa-a64be9b73ff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-157edf97-c4aa-45b0-99fa-a64be9b73ff3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:29.023556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:29.024415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:29.025333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:29.025333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:29.025333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:29.025333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:29.025333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:29.025333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:29.025333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:29.025333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:29.025333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:29.025333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:29.025333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:29.025333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:29.025333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 98/201] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:24:29.036604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157edf97-c4aa-45b0-99fa-a64be9b73ff3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:29.042172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6922f41-91d3-4bf6-933a-66959acc51e0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:29.063997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:29.070791 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:29.106573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e038989-1f6b-46c2-8d02-fb12e6a6825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:29.107246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e038989-1f6b-46c2-8d02-fb12e6a6825d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:29.107496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e038989-1f6b-46c2-8d02-fb12e6a6825d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:29.107774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e038989-1f6b-46c2-8d02-fb12e6a6825d None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:29.110843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e038989-1f6b-46c2-8d02-fb12e6a6825d None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:29.112312 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e038989-1f6b-46c2-8d02-fb12e6a6825d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:29.116458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 104/202] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:28 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:29.125876 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e038989-1f6b-46c2-8d02-fb12e6a6825d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:29.219745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157edf97-c4aa-45b0-99fa-a64be9b73ff3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:29.273122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b4430-8a95-4105-a13d-51f0769efe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:29.274324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b4430-8a95-4105-a13d-51f0769efe1f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:29.274809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b4430-8a95-4105-a13d-51f0769efe1f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:29.275279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b4430-8a95-4105-a13d-51f0769efe1f None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:29.276296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b4430-8a95-4105-a13d-51f0769efe1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:29.276798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b4430-8a95-4105-a13d-51f0769efe1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:29.278506 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b4430-8a95-4105-a13d-51f0769efe1f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:29.295197 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 99/203] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:29.301697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b4430-8a95-4105-a13d-51f0769efe1f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:29.314039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e038989-1f6b-46c2-8d02-fb12e6a6825d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:29.385652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec043878-b9d9-4931-b977-b3f0f801307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:29.386722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec043878-b9d9-4931-b977-b3f0f801307d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:29.387204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec043878-b9d9-4931-b977-b3f0f801307d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:29.387678 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec043878-b9d9-4931-b977-b3f0f801307d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:29.388612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec043878-b9d9-4931-b977-b3f0f801307d None admin] RBAC: Adding query filter params (role.id=0c9ebbeca1134eb4914025ef4cf80f5c, scope.project.id=5d510566458c49848cdbe57fbe030354, user.id=b9795dad3ecc4fc6a7c7d50da491e93c) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:29.389972 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec043878-b9d9-4931-b977-b3f0f801307d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:29.391740 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec043878-b9d9-4931-b977-b3f0f801307d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:29.408104 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 105/204] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:29 2022] GET /identity/v3/role_assignments?user.id=b9795dad3ecc4fc6a7c7d50da491e93c&scope.project.id=5d510566458c49848cdbe57fbe030354&role.id=0c9ebbeca1134eb4914025ef4cf80f5c => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:29.432552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:29.471230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b4430-8a95-4105-a13d-51f0769efe1f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:29.518058 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb547c-9565-4f14-9b62-f6d63663f993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:29.520051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb547c-9565-4f14-9b62-f6d63663f993 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:29.520791 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb547c-9565-4f14-9b62-f6d63663f993 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:29.521376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb547c-9565-4f14-9b62-f6d63663f993 None admin] PATH_INFO: `/v3/users/b255b863112f4c9fb7dc042284b0979a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:29.522943 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb547c-9565-4f14-9b62-f6d63663f993 None admin] RBAC: Authorizing `identity:get_user(user_id=b255b863112f4c9fb7dc042284b0979a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:29.524641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb547c-9565-4f14-9b62-f6d63663f993 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:29.526564 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 100/205] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:29 2022] GET /identity/v3/users/b255b863112f4c9fb7dc042284b0979a => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:29.534419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec043878-b9d9-4931-b977-b3f0f801307d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:29.600997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:29.652205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec043878-b9d9-4931-b977-b3f0f801307d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:29.692273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde862d-1afb-4db8-afe8-2ed25d594206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:29.692900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde862d-1afb-4db8-afe8-2ed25d594206 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:29.693186 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde862d-1afb-4db8-afe8-2ed25d594206 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:29.693502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde862d-1afb-4db8-afe8-2ed25d594206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:29.771529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde862d-1afb-4db8-afe8-2ed25d594206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:29.772944 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde862d-1afb-4db8-afe8-2ed25d594206 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:29.833679 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:29.894714 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 106/206] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:29.900726 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb547c-9565-4f14-9b62-f6d63663f993 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:30.026068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb547c-9565-4f14-9b62-f6d63663f993 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:30.071162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d51b1-5938-4e66-a0ce-f73be7eca693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:30.071839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d51b1-5938-4e66-a0ce-f73be7eca693 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:30.072117 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d51b1-5938-4e66-a0ce-f73be7eca693 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:30.072455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d51b1-5938-4e66-a0ce-f73be7eca693 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:30.077037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d51b1-5938-4e66-a0ce-f73be7eca693 None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:30.078555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d51b1-5938-4e66-a0ce-f73be7eca693 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:30.080583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 101/207] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:29 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:30.087175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde862d-1afb-4db8-afe8-2ed25d594206 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:30.238324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d712a-d9ff-4b3e-beb6-b9c1be1f984a None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:30.238711 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d712a-d9ff-4b3e-beb6-b9c1be1f984a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:30.238878 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d712a-d9ff-4b3e-beb6-b9c1be1f984a None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:30.240575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 102/208] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:30.247250 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde862d-1afb-4db8-afe8-2ed25d594206 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:30.251870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e651-d997-4e9d-8feb-e3619a05210d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:30.252162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e651-d997-4e9d-8feb-e3619a05210d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:30.252441 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e651-d997-4e9d-8feb-e3619a05210d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:30.271385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ffd3e651-d997-4e9d-8feb-e3619a05210d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:30.272587 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ffd3e651-d997-4e9d-8feb-e3619a05210d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:30.276421 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:30.321405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59eb204-1d59-440b-b0a7-38bde27ba845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:30.322017 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eb204-1d59-440b-b0a7-38bde27ba845 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:30.322295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eb204-1d59-440b-b0a7-38bde27ba845 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:30.322617 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eb204-1d59-440b-b0a7-38bde27ba845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:30.323359 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59eb204-1d59-440b-b0a7-38bde27ba845 None admin] RBAC: Adding query filter params (role.id=1d182987dff1438492d3b48c532573c0, scope.project.id=caf2c8ab542845ae9205702525b855e2, user.id=b255b863112f4c9fb7dc042284b0979a) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:30.323671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59eb204-1d59-440b-b0a7-38bde27ba845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:30.325582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59eb204-1d59-440b-b0a7-38bde27ba845 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:30.341212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 107/209] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:30 2022] GET /identity/v3/role_assignments?user.id=b255b863112f4c9fb7dc042284b0979a&scope.project.id=caf2c8ab542845ae9205702525b855e2&role.id=1d182987dff1438492d3b48c532573c0 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:30.377670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 103/210] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:30.586609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da2aa2-fe44-4cb4-80e6-30fbf3ec6200 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:30.586998 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da2aa2-fe44-4cb4-80e6-30fbf3ec6200 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:30.587211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da2aa2-fe44-4cb4-80e6-30fbf3ec6200 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:30.588811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 108/211] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:30.593681 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf9986-cf69-460a-b731-9e231dceed23 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:30.594202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf9986-cf69-460a-b731-9e231dceed23 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:30.594481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf9986-cf69-460a-b731-9e231dceed23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:30.615009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f2bf9986-cf69-460a-b731-9e231dceed23 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:30.616277 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f2bf9986-cf69-460a-b731-9e231dceed23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:30.690273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da2aa2-fe44-4cb4-80e6-30fbf3ec6200 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:30.698718 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 104/212] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:30.709226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:30.805917 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da2aa2-fe44-4cb4-80e6-30fbf3ec6200 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:30.842428 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050a5c-7ca7-46c8-a3c9-14b28e01c1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:30.842980 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050a5c-7ca7-46c8-a3c9-14b28e01c1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:30.843256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050a5c-7ca7-46c8-a3c9-14b28e01c1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:30.843521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050a5c-7ca7-46c8-a3c9-14b28e01c1a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:30.844636 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83050a5c-7ca7-46c8-a3c9-14b28e01c1a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:30.846180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83050a5c-7ca7-46c8-a3c9-14b28e01c1a5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:30.852429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 109/213] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:30.853854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf9986-cf69-460a-b731-9e231dceed23 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:30.930523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:30.968555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf9986-cf69-460a-b731-9e231dceed23 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:30.991916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050a5c-7ca7-46c8-a3c9-14b28e01c1a5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:31.005812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcea4b-cb66-4034-b1c5-f3c9f0d6a05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:31.006746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcea4b-cb66-4034-b1c5-f3c9f0d6a05d None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:31.007225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcea4b-cb66-4034-b1c5-f3c9f0d6a05d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:31.007699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcea4b-cb66-4034-b1c5-f3c9f0d6a05d None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:31.008664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcea4b-cb66-4034-b1c5-f3c9f0d6a05d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:31.010399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcea4b-cb66-4034-b1c5-f3c9f0d6a05d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:31.092145 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:31.113250 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050a5c-7ca7-46c8-a3c9-14b28e01c1a5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:31.137269 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 105/214] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:24:30 2022] POST /identity/v3/users => generated 297 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:24:31.164836 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362441e3-ce0b-401d-9a41-9bfe3ec2e1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:31.165578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362441e3-ce0b-401d-9a41-9bfe3ec2e1eb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:31.165856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362441e3-ce0b-401d-9a41-9bfe3ec2e1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:31.166127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362441e3-ce0b-401d-9a41-9bfe3ec2e1eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:31.180226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362441e3-ce0b-401d-9a41-9bfe3ec2e1eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-362441e3-ce0b-401d-9a41-9bfe3ec2e1eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:31.185959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:31.192598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:31.193455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:31.193455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:31.193455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:31.193455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:31.193455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:31.193455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:31.193455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:31.193455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:31.193455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:31.193455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:31.193455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:31.193455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:31.193455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 110/215] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:31.196633 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcea4b-cb66-4034-b1c5-f3c9f0d6a05d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:31.227639 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad230c-b453-47ed-8b41-501122559f92 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:31.227920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad230c-b453-47ed-8b41-501122559f92 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:31.228190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad230c-b453-47ed-8b41-501122559f92 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:31.230377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 111/216] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:24:31.235906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85835d15-3372-432e-be54-4f8f7530735e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:31.236188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85835d15-3372-432e-be54-4f8f7530735e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:31.236518 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85835d15-3372-432e-be54-4f8f7530735e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:31.264564 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-85835d15-3372-432e-be54-4f8f7530735e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:31.265814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-85835d15-3372-432e-be54-4f8f7530735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:31.324315 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcea4b-cb66-4034-b1c5-f3c9f0d6a05d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:31.350459 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 112/217] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:31.358461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:31.368072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49097fa8-3b85-4e14-b476-99bc0846214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:31.368759 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49097fa8-3b85-4e14-b476-99bc0846214f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:31.374666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49097fa8-3b85-4e14-b476-99bc0846214f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:31.374666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49097fa8-3b85-4e14-b476-99bc0846214f None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:31.374666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49097fa8-3b85-4e14-b476-99bc0846214f None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:31.374666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49097fa8-3b85-4e14-b476-99bc0846214f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:31.374666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49097fa8-3b85-4e14-b476-99bc0846214f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:31.383639 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 106/218] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:31.389400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85835d15-3372-432e-be54-4f8f7530735e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:31.467192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:31.499474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85835d15-3372-432e-be54-4f8f7530735e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:31.537343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e911fc-1476-44fe-9100-76d9195f3f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:31.537980 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e911fc-1476-44fe-9100-76d9195f3f3e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:31.538255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e911fc-1476-44fe-9100-76d9195f3f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:31.538552 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e911fc-1476-44fe-9100-76d9195f3f3e None admin] PATH_INFO: `/v3/users/61573f9c43ca43848c4c3ad7631606c0` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:31.553601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e911fc-1476-44fe-9100-76d9195f3f3e None admin] RBAC: Authorizing `identity:get_user(user_id=61573f9c43ca43848c4c3ad7631606c0)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:31.555143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e911fc-1476-44fe-9100-76d9195f3f3e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:31.561273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 113/219] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:31 2022] GET /identity/v3/users/61573f9c43ca43848c4c3ad7631606c0 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:31.562958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49097fa8-3b85-4e14-b476-99bc0846214f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:31.622579 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e911fc-1476-44fe-9100-76d9195f3f3e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:31.698403 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49097fa8-3b85-4e14-b476-99bc0846214f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:31.745416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e911fc-1476-44fe-9100-76d9195f3f3e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:31.750800 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef35db-b08d-44ab-8c31-8058666e3468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:31.751586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef35db-b08d-44ab-8c31-8058666e3468 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:31.752026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef35db-b08d-44ab-8c31-8058666e3468 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:31.752454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef35db-b08d-44ab-8c31-8058666e3468 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:31.783625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:31.798250 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d055228-a556-4e9d-ac09-ed9466b101b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:31.798950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d055228-a556-4e9d-ac09-ed9466b101b4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:31.799228 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d055228-a556-4e9d-ac09-ed9466b101b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:31.800469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d055228-a556-4e9d-ac09-ed9466b101b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:31.813863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d055228-a556-4e9d-ac09-ed9466b101b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:31.819045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-9d055228-a556-4e9d-ac09-ed9466b101b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:31.821628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:31.822541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:31.823322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:31.823322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:31.823322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:31.823322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:31.823322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:31.823322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:31.823322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:31.823322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:31.823322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:31.823322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:31.823322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:31.823322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:31.823943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 114/220] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:24:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:24:31.826528 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbfbec-9e42-4819-bd49-30c50ea4cf21 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:31.833578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbfbec-9e42-4819-bd49-30c50ea4cf21 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:31.833578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbfbec-9e42-4819-bd49-30c50ea4cf21 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:31.833578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 115/221] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:31.833578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbfbec-9e42-4819-bd49-30c50ea4cf21 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:31.838977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef35db-b08d-44ab-8c31-8058666e3468 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:31.840570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef35db-b08d-44ab-8c31-8058666e3468 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:31.954823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 107/222] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:31.956284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18a7a6-fa50-4b9c-8526-6ac17a8be10c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:31.956758 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18a7a6-fa50-4b9c-8526-6ac17a8be10c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:31.957045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18a7a6-fa50-4b9c-8526-6ac17a8be10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:31.966945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbfbec-9e42-4819-bd49-30c50ea4cf21 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:31.981160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-cd18a7a6-fa50-4b9c-8526-6ac17a8be10c None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:31.982474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cd18a7a6-fa50-4b9c-8526-6ac17a8be10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:32.013393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e2430-efb5-4480-8d2a-365a5f280c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:32.014640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2430-efb5-4480-8d2a-365a5f280c7c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:32.015516 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2430-efb5-4480-8d2a-365a5f280c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:32.016202 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2430-efb5-4480-8d2a-365a5f280c7c None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:32.017048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e2430-efb5-4480-8d2a-365a5f280c7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:32.017556 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e2430-efb5-4480-8d2a-365a5f280c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:32.019420 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e2430-efb5-4480-8d2a-365a5f280c7c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:32.030847 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 116/223] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:32.031867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e2430-efb5-4480-8d2a-365a5f280c7c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:32.066288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 108/224] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:32.067345 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18a7a6-fa50-4b9c-8526-6ac17a8be10c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:32.092434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:32.109564 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:32.173411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e2430-efb5-4480-8d2a-365a5f280c7c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:32.226869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc036abc-7621-411c-9c00-9428d9570d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:32.227909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc036abc-7621-411c-9c00-9428d9570d94 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:32.228392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc036abc-7621-411c-9c00-9428d9570d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:32.228863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc036abc-7621-411c-9c00-9428d9570d94 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:32.230267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc036abc-7621-411c-9c00-9428d9570d94 None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:32.232012 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc036abc-7621-411c-9c00-9428d9570d94 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:32.234820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 117/225] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:32 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:32.241642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc036abc-7621-411c-9c00-9428d9570d94 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:32.255519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18a7a6-fa50-4b9c-8526-6ac17a8be10c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:32.351121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b372858-2af2-4f58-b2c9-e85ccc7ba5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:32.352265 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b372858-2af2-4f58-b2c9-e85ccc7ba5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:32.353918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b372858-2af2-4f58-b2c9-e85ccc7ba5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:32.355003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b372858-2af2-4f58-b2c9-e85ccc7ba5f2 None admin] PATH_INFO: `/v3/users/b9795dad3ecc4fc6a7c7d50da491e93c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:32.357693 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b372858-2af2-4f58-b2c9-e85ccc7ba5f2 None admin] RBAC: Authorizing `identity:get_user(user_id=b9795dad3ecc4fc6a7c7d50da491e93c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:32.359348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b372858-2af2-4f58-b2c9-e85ccc7ba5f2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:32.366782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc036abc-7621-411c-9c00-9428d9570d94 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:32.368648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 109/226] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:32 2022] GET /identity/v3/users/b9795dad3ecc4fc6a7c7d50da491e93c => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:32.369563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b372858-2af2-4f58-b2c9-e85ccc7ba5f2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:32.400935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:32.418843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425507d-98af-496f-87ec-8f30ec240d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:32.421612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425507d-98af-496f-87ec-8f30ec240d75 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:32.421612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425507d-98af-496f-87ec-8f30ec240d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:32.421612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425507d-98af-496f-87ec-8f30ec240d75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:32.421945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425507d-98af-496f-87ec-8f30ec240d75 None admin] RBAC: Adding query filter params (role.id=64f2951b9ce444bcad20c61347224196, scope.project.id=5d510566458c49848cdbe57fbe030354, user.id=61573f9c43ca43848c4c3ad7631606c0) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:32.422223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425507d-98af-496f-87ec-8f30ec240d75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:32.423721 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425507d-98af-496f-87ec-8f30ec240d75 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:32.437335 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 118/227] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:32 2022] GET /identity/v3/role_assignments?user.id=61573f9c43ca43848c4c3ad7631606c0&scope.project.id=5d510566458c49848cdbe57fbe030354&role.id=64f2951b9ce444bcad20c61347224196 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:32.437335 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425507d-98af-496f-87ec-8f30ec240d75 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:32.507089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:32.525012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b372858-2af2-4f58-b2c9-e85ccc7ba5f2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:32.564336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b215e29-7eba-4b1f-9c72-175a07215942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:32.565052 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b215e29-7eba-4b1f-9c72-175a07215942 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:32.565413 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b215e29-7eba-4b1f-9c72-175a07215942 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:32.566228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b215e29-7eba-4b1f-9c72-175a07215942 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:32.578269 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b215e29-7eba-4b1f-9c72-175a07215942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4b215e29-7eba-4b1f-9c72-175a07215942 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:32.583326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:32.584242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:32.585019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:32.585019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:32.585019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:32.585019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:32.585019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:32.585019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:32.585019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:32.585019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:32.585019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:32.585019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:32.585019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:32.585019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:32.585019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 110/228] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:24:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:32.592764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b215e29-7eba-4b1f-9c72-175a07215942 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:32.660392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425507d-98af-496f-87ec-8f30ec240d75 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:32.708285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b58b05-98c4-4e2f-a0d5-f94b2b569997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:32.708923 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b58b05-98c4-4e2f-a0d5-f94b2b569997 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:32.709219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b58b05-98c4-4e2f-a0d5-f94b2b569997 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:32.710673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b58b05-98c4-4e2f-a0d5-f94b2b569997 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:32.712370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b58b05-98c4-4e2f-a0d5-f94b2b569997 None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:32.715239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b58b05-98c4-4e2f-a0d5-f94b2b569997 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:32.722601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 119/229] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:32 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:32.728359 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b58b05-98c4-4e2f-a0d5-f94b2b569997 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:32.746089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b215e29-7eba-4b1f-9c72-175a07215942 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:32.795587 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6412b02-d905-45ae-b2b8-f782f8e3d570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:32.801532 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6412b02-d905-45ae-b2b8-f782f8e3d570 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:32.802124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6412b02-d905-45ae-b2b8-f782f8e3d570 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:32.802687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6412b02-d905-45ae-b2b8-f782f8e3d570 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:32.803579 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6412b02-d905-45ae-b2b8-f782f8e3d570 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:32.804073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6412b02-d905-45ae-b2b8-f782f8e3d570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:32.805686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6412b02-d905-45ae-b2b8-f782f8e3d570 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:32.816590 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 111/230] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:24:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:32.822282 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6412b02-d905-45ae-b2b8-f782f8e3d570 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:32.834721 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:32.903505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:32.977535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6412b02-d905-45ae-b2b8-f782f8e3d570 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:32.990149 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b58b05-98c4-4e2f-a0d5-f94b2b569997 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:33.023864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b5f3d-b057-4300-8c7b-fdb30ab244be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:33.024684 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b5f3d-b057-4300-8c7b-fdb30ab244be None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:33.025069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b5f3d-b057-4300-8c7b-fdb30ab244be None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:33.025376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b5f3d-b057-4300-8c7b-fdb30ab244be None admin] PATH_INFO: `/v3/users/b9795dad3ecc4fc6a7c7d50da491e93c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:33.026433 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220cefb-311a-4992-8e95-cb50e4a6e7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:33.026563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b5f3d-b057-4300-8c7b-fdb30ab244be None admin] RBAC: Authorizing `identity:get_user(user_id=b9795dad3ecc4fc6a7c7d50da491e93c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:33.027399 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220cefb-311a-4992-8e95-cb50e4a6e7f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:33.027883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220cefb-311a-4992-8e95-cb50e4a6e7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:33.028049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b5f3d-b057-4300-8c7b-fdb30ab244be None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:33.028497 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220cefb-311a-4992-8e95-cb50e4a6e7f2 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354/users/b9795dad3ecc4fc6a7c7d50da491e93c/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:33.030668 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220cefb-311a-4992-8e95-cb50e4a6e7f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d510566458c49848cdbe57fbe030354, user_id=b9795dad3ecc4fc6a7c7d50da491e93c, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:33.032301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220cefb-311a-4992-8e95-cb50e4a6e7f2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:33.036256 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 112/231] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:32 2022] GET /identity/v3/users/b9795dad3ecc4fc6a7c7d50da491e93c => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:33.036843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b5f3d-b057-4300-8c7b-fdb30ab244be None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:33.134369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 120/232] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:24:32 2022] PUT /identity/v3/projects/5d510566458c49848cdbe57fbe030354/users/b9795dad3ecc4fc6a7c7d50da491e93c/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:24:33.144836 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:33.196701 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b5f3d-b057-4300-8c7b-fdb30ab244be None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:33.310786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42239f22-2ec2-4662-87ef-b7b79d7940ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:33.311372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42239f22-2ec2-4662-87ef-b7b79d7940ca None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:33.311652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42239f22-2ec2-4662-87ef-b7b79d7940ca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:33.311923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42239f22-2ec2-4662-87ef-b7b79d7940ca None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:33.313081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42239f22-2ec2-4662-87ef-b7b79d7940ca None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:33.314585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42239f22-2ec2-4662-87ef-b7b79d7940ca None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:33.317240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 113/233] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:33 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:33.323236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220cefb-311a-4992-8e95-cb50e4a6e7f2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:33.502680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220cefb-311a-4992-8e95-cb50e4a6e7f2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:33.517057 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:33.542760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cccf4-d871-4b98-bf7c-5ec60f388f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:33.543760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cccf4-d871-4b98-bf7c-5ec60f388f24 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:33.544233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cccf4-d871-4b98-bf7c-5ec60f388f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:33.544718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cccf4-d871-4b98-bf7c-5ec60f388f24 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354/users/b9795dad3ecc4fc6a7c7d50da491e93c/roles/0c9ebbeca1134eb4914025ef4cf80f5c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:33.547188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cccf4-d871-4b98-bf7c-5ec60f388f24 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d510566458c49848cdbe57fbe030354, user_id=b9795dad3ecc4fc6a7c7d50da491e93c, role_id=0c9ebbeca1134eb4914025ef4cf80f5c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:33.548890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cccf4-d871-4b98-bf7c-5ec60f388f24 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:33.648256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 121/234] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:24:33 2022] PUT /identity/v3/projects/5d510566458c49848cdbe57fbe030354/users/b9795dad3ecc4fc6a7c7d50da491e93c/roles/0c9ebbeca1134eb4914025ef4cf80f5c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:24:33.739809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfc8fa-df8a-4122-abf2-f23522b9f244 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:33.740105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfc8fa-df8a-4122-abf2-f23522b9f244 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:33.740363 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfc8fa-df8a-4122-abf2-f23522b9f244 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:33.741917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 114/235] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:33.750587 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e0056-1949-4c29-8fa5-17e4a3237991 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:33.750871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e0056-1949-4c29-8fa5-17e4a3237991 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:33.751155 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e0056-1949-4c29-8fa5-17e4a3237991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:33.782792 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-899e0056-1949-4c29-8fa5-17e4a3237991 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:33.784032 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-899e0056-1949-4c29-8fa5-17e4a3237991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:33.902708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 122/236] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:33.987062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80eb16-7025-4961-86a4-42942b20acb3 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:33.987838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80eb16-7025-4961-86a4-42942b20acb3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:33.987838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80eb16-7025-4961-86a4-42942b20acb3 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:33.989345 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 115/237] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:33.994850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64722ae-54b9-496b-a2ac-c108ce6725b1 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:33.995277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64722ae-54b9-496b-a2ac-c108ce6725b1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:33.995385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64722ae-54b9-496b-a2ac-c108ce6725b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:34.015914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d64722ae-54b9-496b-a2ac-c108ce6725b1 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:34.017108 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d64722ae-54b9-496b-a2ac-c108ce6725b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:34.097626 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 123/238] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:34.327428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80eb16-7025-4961-86a4-42942b20acb3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:34.438185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80eb16-7025-4961-86a4-42942b20acb3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:34.453662 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64722ae-54b9-496b-a2ac-c108ce6725b1 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:34.482075 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621ea6b-f23d-4661-a564-5127c497e060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:34.482839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621ea6b-f23d-4661-a564-5127c497e060 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:34.483125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621ea6b-f23d-4661-a564-5127c497e060 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:34.483397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621ea6b-f23d-4661-a564-5127c497e060 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:34.488116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:34.510202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621ea6b-f23d-4661-a564-5127c497e060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3621ea6b-f23d-4661-a564-5127c497e060 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:34.515070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:34.516142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:34.517099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:34.517099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:34.517099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:34.517099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:34.517099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:34.517099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:34.517099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:34.517099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:34.517099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:34.517099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:34.517099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:34.517099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:34.517099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 116/239] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:34.523280 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621ea6b-f23d-4661-a564-5127c497e060 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:34.545559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:34.620927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64722ae-54b9-496b-a2ac-c108ce6725b1 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:34.694435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d0665-86e0-4870-84a1-e33c8d8db295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:34.695085 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0665-86e0-4870-84a1-e33c8d8db295 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:34.695418 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0665-86e0-4870-84a1-e33c8d8db295 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:34.695699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0665-86e0-4870-84a1-e33c8d8db295 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:34.698372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d0665-86e0-4870-84a1-e33c8d8db295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:34.699845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d0665-86e0-4870-84a1-e33c8d8db295 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:34.704652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 124/240] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:34.708578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621ea6b-f23d-4661-a564-5127c497e060 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:34.710517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d0665-86e0-4870-84a1-e33c8d8db295 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:34.764788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6b0b3-4d0f-4dcd-b085-3950d80d7f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:34.765747 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6b0b3-4d0f-4dcd-b085-3950d80d7f65 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:34.766750 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6b0b3-4d0f-4dcd-b085-3950d80d7f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:34.766750 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6b0b3-4d0f-4dcd-b085-3950d80d7f65 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:34.767321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6b0b3-4d0f-4dcd-b085-3950d80d7f65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:34.767687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6b0b3-4d0f-4dcd-b085-3950d80d7f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:34.769345 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6b0b3-4d0f-4dcd-b085-3950d80d7f65 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:34.783737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 117/241] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:34.786065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308cba7-a57a-4f3d-aec7-b1bd9404ba2d None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:34.786361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308cba7-a57a-4f3d-aec7-b1bd9404ba2d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:34.786632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308cba7-a57a-4f3d-aec7-b1bd9404ba2d None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:34.788002 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 118/242] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:34.788692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308cba7-a57a-4f3d-aec7-b1bd9404ba2d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:34.844531 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:34.848807 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d0665-86e0-4870-84a1-e33c8d8db295 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:34.872174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:34.887952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5155c-0615-4dd9-87c5-505a3c662896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:34.888758 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5155c-0615-4dd9-87c5-505a3c662896 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:34.889223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5155c-0615-4dd9-87c5-505a3c662896 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:34.889632 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5155c-0615-4dd9-87c5-505a3c662896 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:34.890492 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5155c-0615-4dd9-87c5-505a3c662896 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:34.892155 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5155c-0615-4dd9-87c5-505a3c662896 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:34.914879 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308cba7-a57a-4f3d-aec7-b1bd9404ba2d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:34.950062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b897a-ae0c-4c49-a132-02a48a63fb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:34.950745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b897a-ae0c-4c49-a132-02a48a63fb12 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:34.951027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b897a-ae0c-4c49-a132-02a48a63fb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:34.951354 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b897a-ae0c-4c49-a132-02a48a63fb12 None admin] PATH_INFO: `/v3/users/ad46f402b6484fc2a5c0f626cb69fe02` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:34.952984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 125/243] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:24:34 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:24:34.955876 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0a846-b188-41e7-aa9b-bd12966537d4 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:34.956670 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0a846-b188-41e7-aa9b-bd12966537d4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:34.957127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0a846-b188-41e7-aa9b-bd12966537d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:34.970080 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b897a-ae0c-4c49-a132-02a48a63fb12 None admin] RBAC: Authorizing `identity:get_user(user_id=ad46f402b6484fc2a5c0f626cb69fe02)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:34.971136 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b897a-ae0c-4c49-a132-02a48a63fb12 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:34.973963 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 119/244] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:34 2022] GET /identity/v3/users/ad46f402b6484fc2a5c0f626cb69fe02 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:34.979948 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b897a-ae0c-4c49-a132-02a48a63fb12 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:34.985873 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fba0a846-b188-41e7-aa9b-bd12966537d4 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:34.987931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fba0a846-b188-41e7-aa9b-bd12966537d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:35.111809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 126/245] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:35.121546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b897a-ae0c-4c49-a132-02a48a63fb12 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:35.149062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:35.161714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcd4ee-7269-4f68-9935-d57f03e63e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:35.162574 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcd4ee-7269-4f68-9935-d57f03e63e25 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:35.163021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcd4ee-7269-4f68-9935-d57f03e63e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:35.163489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcd4ee-7269-4f68-9935-d57f03e63e25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:35.236469 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcd4ee-7269-4f68-9935-d57f03e63e25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:35.238500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcd4ee-7269-4f68-9935-d57f03e63e25 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:35.342700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 120/246] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:35.350373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0a846-b188-41e7-aa9b-bd12966537d4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:35.426116 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcd4ee-7269-4f68-9935-d57f03e63e25 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:35.465027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:35.472590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:35.490625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0a846-b188-41e7-aa9b-bd12966537d4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:35.529412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae266021-842b-4436-bcfb-4fe620d7b350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:35.530387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae266021-842b-4436-bcfb-4fe620d7b350 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:35.530947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae266021-842b-4436-bcfb-4fe620d7b350 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:35.531445 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae266021-842b-4436-bcfb-4fe620d7b350 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:35.532883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae266021-842b-4436-bcfb-4fe620d7b350 None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:35.535349 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae266021-842b-4436-bcfb-4fe620d7b350 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:35.537782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 127/247] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:35 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:35.546205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae266021-842b-4436-bcfb-4fe620d7b350 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:35.547037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcd4ee-7269-4f68-9935-d57f03e63e25 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:35.587137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c620c-a2b9-4cc5-877b-7110ca5878f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:35.587783 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c620c-a2b9-4cc5-877b-7110ca5878f2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:35.588078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c620c-a2b9-4cc5-877b-7110ca5878f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:35.588337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c620c-a2b9-4cc5-877b-7110ca5878f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:35.600125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c620c-a2b9-4cc5-877b-7110ca5878f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-504c620c-a2b9-4cc5-877b-7110ca5878f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:35.604946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:35.605866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:35.606655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:35.606655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:35.606655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:35.606655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:35.606655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:35.606655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:35.606655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:35.606655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:35.606655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:35.606655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:35.606655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:35.606655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:35.611026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 121/248] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:24:35.612321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c620c-a2b9-4cc5-877b-7110ca5878f2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:35.666283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae266021-842b-4436-bcfb-4fe620d7b350 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:35.716291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3272129-3d6e-4df0-b0e8-4c6d94c68653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:35.716820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3272129-3d6e-4df0-b0e8-4c6d94c68653 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:35.717099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3272129-3d6e-4df0-b0e8-4c6d94c68653 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:35.717415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3272129-3d6e-4df0-b0e8-4c6d94c68653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:35.718056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:35.719164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3272129-3d6e-4df0-b0e8-4c6d94c68653 None admin] RBAC: Adding query filter params (role.id=1d182987dff1438492d3b48c532573c0, scope.project.id=5d510566458c49848cdbe57fbe030354, user.id=ad46f402b6484fc2a5c0f626cb69fe02) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:35.719442 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3272129-3d6e-4df0-b0e8-4c6d94c68653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:35.721300 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3272129-3d6e-4df0-b0e8-4c6d94c68653 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:35.728990 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 128/249] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:35 2022] GET /identity/v3/role_assignments?user.id=ad46f402b6484fc2a5c0f626cb69fe02&scope.project.id=5d510566458c49848cdbe57fbe030354&role.id=1d182987dff1438492d3b48c532573c0 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:35.733221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0157b-b528-4496-b86c-b466fe3822c8 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:35.733221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0157b-b528-4496-b86c-b466fe3822c8 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:35.733221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0157b-b528-4496-b86c-b466fe3822c8 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:35.733221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 129/250] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:35.739191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f848c7-9aee-4b16-9555-6024d3fca436 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:35.739542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f848c7-9aee-4b16-9555-6024d3fca436 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:35.739824 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f848c7-9aee-4b16-9555-6024d3fca436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:35.760455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c620c-a2b9-4cc5-877b-7110ca5878f2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:35.764255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-40f848c7-9aee-4b16-9555-6024d3fca436 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:35.766638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-40f848c7-9aee-4b16-9555-6024d3fca436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:35.791298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:35.847489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d3fe0-5d42-4a59-8bd6-00613c399372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:35.848342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3fe0-5d42-4a59-8bd6-00613c399372 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:35.848629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3fe0-5d42-4a59-8bd6-00613c399372 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:35.848900 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3fe0-5d42-4a59-8bd6-00613c399372 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:35.849876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d3fe0-5d42-4a59-8bd6-00613c399372 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:35.850179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d3fe0-5d42-4a59-8bd6-00613c399372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:35.851605 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d3fe0-5d42-4a59-8bd6-00613c399372 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:35.871579 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 122/251] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:35.880862 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d3fe0-5d42-4a59-8bd6-00613c399372 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:35.936071 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 130/252] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:36.044235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d3fe0-5d42-4a59-8bd6-00613c399372 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:36.102578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e049f-5610-48d1-90bc-0e997014bc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:36.103633 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e049f-5610-48d1-90bc-0e997014bc5e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:36.104040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e049f-5610-48d1-90bc-0e997014bc5e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:36.104316 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e049f-5610-48d1-90bc-0e997014bc5e None admin] PATH_INFO: `/v3/users/61573f9c43ca43848c4c3ad7631606c0` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:36.109894 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e049f-5610-48d1-90bc-0e997014bc5e None admin] RBAC: Authorizing `identity:get_user(user_id=61573f9c43ca43848c4c3ad7631606c0)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:36.111436 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e049f-5610-48d1-90bc-0e997014bc5e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:36.114161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 123/253] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:35 2022] GET /identity/v3/users/61573f9c43ca43848c4c3ad7631606c0 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:36.119707 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f848c7-9aee-4b16-9555-6024d3fca436 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:36.261941 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f848c7-9aee-4b16-9555-6024d3fca436 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:36.311727 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cfcef-cf3d-4d31-899a-73b937a25cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:36.312273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cfcef-cf3d-4d31-899a-73b937a25cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:36.312551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cfcef-cf3d-4d31-899a-73b937a25cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:36.312817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cfcef-cf3d-4d31-899a-73b937a25cb0 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:36.314757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cfcef-cf3d-4d31-899a-73b937a25cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:36.316790 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cfcef-cf3d-4d31-899a-73b937a25cb0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:36.318776 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 131/254] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:36 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:36.324166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e049f-5610-48d1-90bc-0e997014bc5e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:36.357642 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:36.433739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c306a-1f69-4088-91c1-07a1eeab3fe5 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:36.434046 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c306a-1f69-4088-91c1-07a1eeab3fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:36.434822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c306a-1f69-4088-91c1-07a1eeab3fe5 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:36.436321 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 132/255] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:36.445161 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173798a-f98c-4c2d-a99f-56211917cfa7 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:36.445477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173798a-f98c-4c2d-a99f-56211917cfa7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:36.445724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173798a-f98c-4c2d-a99f-56211917cfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:36.472616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e049f-5610-48d1-90bc-0e997014bc5e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:36.483143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e173798a-f98c-4c2d-a99f-56211917cfa7 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:36.484328 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e173798a-f98c-4c2d-a99f-56211917cfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:36.502666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:36.509188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dbbfd-ab5e-4670-8c63-e24260c37bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:36.509875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dbbfd-ab5e-4670-8c63-e24260c37bdc None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:36.510153 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dbbfd-ab5e-4670-8c63-e24260c37bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:36.510430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dbbfd-ab5e-4670-8c63-e24260c37bdc None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354/users/61573f9c43ca43848c4c3ad7631606c0/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:36.515804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dbbfd-ab5e-4670-8c63-e24260c37bdc None admin] RBAC: Authorizing `identity:create_grant(project_id=5d510566458c49848cdbe57fbe030354, user_id=61573f9c43ca43848c4c3ad7631606c0, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:36.515804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dbbfd-ab5e-4670-8c63-e24260c37bdc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:36.574064 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 133/256] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:36.574850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173798a-f98c-4c2d-a99f-56211917cfa7 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:36.589500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 124/257] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:24:36 2022] PUT /identity/v3/projects/5d510566458c49848cdbe57fbe030354/users/61573f9c43ca43848c4c3ad7631606c0/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:24:36.691850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173798a-f98c-4c2d-a99f-56211917cfa7 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:36.729930 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568b5af-0391-4ef1-9bb1-b9a5abd9cc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:36.730581 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568b5af-0391-4ef1-9bb1-b9a5abd9cc4c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:36.730995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568b5af-0391-4ef1-9bb1-b9a5abd9cc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:36.731262 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568b5af-0391-4ef1-9bb1-b9a5abd9cc4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:36.743605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568b5af-0391-4ef1-9bb1-b9a5abd9cc4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-7568b5af-0391-4ef1-9bb1-b9a5abd9cc4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:36.748580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:36.749559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:36.750355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:36.750355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:36.750355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:36.750355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:36.750355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:36.750355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:36.750355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:36.750355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:36.750355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:36.750355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:36.750355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:36.750355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:36.750355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 134/258] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:24:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:36.756107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dbbfd-ab5e-4670-8c63-e24260c37bdc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:36.848636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:36.881368 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dbbfd-ab5e-4670-8c63-e24260c37bdc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:36.923918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24466715-7334-4283-9dae-c9ae9ca9d843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:36.924537 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466715-7334-4283-9dae-c9ae9ca9d843 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:36.924923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466715-7334-4283-9dae-c9ae9ca9d843 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:36.925352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466715-7334-4283-9dae-c9ae9ca9d843 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:36.926042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24466715-7334-4283-9dae-c9ae9ca9d843 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:36.926391 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24466715-7334-4283-9dae-c9ae9ca9d843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:36.927829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24466715-7334-4283-9dae-c9ae9ca9d843 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:36.941801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 125/259] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:36.947582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568b5af-0391-4ef1-9bb1-b9a5abd9cc4c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:36.961314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:37.074786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24466715-7334-4283-9dae-c9ae9ca9d843 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:37.093315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568b5af-0391-4ef1-9bb1-b9a5abd9cc4c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:37.183330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9e182-de83-4612-96af-2cdbbf7c9bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:37.183956 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9e182-de83-4612-96af-2cdbbf7c9bde None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:37.184181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9e182-de83-4612-96af-2cdbbf7c9bde None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:37.184407 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9e182-de83-4612-96af-2cdbbf7c9bde None admin] PATH_INFO: `/v3/users/b9795dad3ecc4fc6a7c7d50da491e93c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:37.189915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9e182-de83-4612-96af-2cdbbf7c9bde None admin] RBAC: Authorizing `identity:get_user(user_id=b9795dad3ecc4fc6a7c7d50da491e93c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:37.192138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9e182-de83-4612-96af-2cdbbf7c9bde None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:37.194071 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 135/260] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:36 2022] GET /identity/v3/users/b9795dad3ecc4fc6a7c7d50da491e93c => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:37.205940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9e182-de83-4612-96af-2cdbbf7c9bde None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:37.228197 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24466715-7334-4283-9dae-c9ae9ca9d843 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:37.267160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6fd5e-fbf7-4adc-88ed-4d28b6813f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:37.268218 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6fd5e-fbf7-4adc-88ed-4d28b6813f51 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:37.268535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6fd5e-fbf7-4adc-88ed-4d28b6813f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:37.268865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6fd5e-fbf7-4adc-88ed-4d28b6813f51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:37.272031 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:37.282531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6fd5e-fbf7-4adc-88ed-4d28b6813f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-9da6fd5e-fbf7-4adc-88ed-4d28b6813f51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:37.289299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:37.290292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:37.291095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:37.291095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:37.291095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:37.291095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:37.291095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:37.291095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:37.291095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:37.291095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:37.291095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:37.291095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:37.291095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:37.291095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:37.294612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 126/261] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:24:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:37.300875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6fd5e-fbf7-4adc-88ed-4d28b6813f51 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:37.379150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:37.436169 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9e182-de83-4612-96af-2cdbbf7c9bde None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:37.486740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6fd5e-fbf7-4adc-88ed-4d28b6813f51 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:37.496255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b865b9-e622-429a-b896-13041217458a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:37.497227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b865b9-e622-429a-b896-13041217458a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:37.497710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b865b9-e622-429a-b896-13041217458a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:37.498221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b865b9-e622-429a-b896-13041217458a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:37.532629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99870a-a4b6-40b2-a341-0e9bddcd34bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:37.533335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99870a-a4b6-40b2-a341-0e9bddcd34bd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:37.533617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99870a-a4b6-40b2-a341-0e9bddcd34bd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:37.533893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99870a-a4b6-40b2-a341-0e9bddcd34bd None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:37.534878 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99870a-a4b6-40b2-a341-0e9bddcd34bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:37.535417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99870a-a4b6-40b2-a341-0e9bddcd34bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:37.536792 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99870a-a4b6-40b2-a341-0e9bddcd34bd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:37.545856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 127/262] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:24:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:37.569678 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99870a-a4b6-40b2-a341-0e9bddcd34bd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:37.583223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b865b9-e622-429a-b896-13041217458a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:37.585088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b865b9-e622-429a-b896-13041217458a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:37.655982 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:37.667151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:37.694181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 136/263] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 04:24:37.700137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b865b9-e622-429a-b896-13041217458a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:37.728430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99870a-a4b6-40b2-a341-0e9bddcd34bd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:37.783501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03314051-a299-41cb-8ee9-65705756d6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:37.784272 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03314051-a299-41cb-8ee9-65705756d6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:37.784645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03314051-a299-41cb-8ee9-65705756d6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:37.785622 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03314051-a299-41cb-8ee9-65705756d6a1 None admin] PATH_INFO: `/v3/users/b9795dad3ecc4fc6a7c7d50da491e93c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:37.786438 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03314051-a299-41cb-8ee9-65705756d6a1 None admin] RBAC: Authorizing `identity:get_user(user_id=b9795dad3ecc4fc6a7c7d50da491e93c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:37.787885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03314051-a299-41cb-8ee9-65705756d6a1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:37.797098 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 128/264] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:37 2022] GET /identity/v3/users/b9795dad3ecc4fc6a7c7d50da491e93c => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:37.798533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03314051-a299-41cb-8ee9-65705756d6a1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:37.841273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b865b9-e622-429a-b896-13041217458a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:37.877093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d42636-891a-44fc-b1db-5941cd3f171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:37.878741 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d42636-891a-44fc-b1db-5941cd3f171c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:37.879199 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d42636-891a-44fc-b1db-5941cd3f171c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:37.879654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d42636-891a-44fc-b1db-5941cd3f171c None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:37.880965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d42636-891a-44fc-b1db-5941cd3f171c None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:37.882656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d42636-891a-44fc-b1db-5941cd3f171c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:37.884803 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 137/265] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:37 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:37.890701 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d42636-891a-44fc-b1db-5941cd3f171c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:37.955706 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:37.996123 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03314051-a299-41cb-8ee9-65705756d6a1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:38.005100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d42636-891a-44fc-b1db-5941cd3f171c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:38.043582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e4a7c-19b5-4f93-95dc-6098bae3babf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:38.044771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e4a7c-19b5-4f93-95dc-6098bae3babf None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:38.045518 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e4a7c-19b5-4f93-95dc-6098bae3babf None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:38.046041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e4a7c-19b5-4f93-95dc-6098bae3babf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:38.047001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e4a7c-19b5-4f93-95dc-6098bae3babf None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=5d510566458c49848cdbe57fbe030354, user.id=b9795dad3ecc4fc6a7c7d50da491e93c) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:38.047500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e4a7c-19b5-4f93-95dc-6098bae3babf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:38.049115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e4a7c-19b5-4f93-95dc-6098bae3babf None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:38.057828 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 138/266] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:37 2022] GET /identity/v3/role_assignments?user.id=b9795dad3ecc4fc6a7c7d50da491e93c&scope.project.id=5d510566458c49848cdbe57fbe030354&role.id=1896db68dc754d5293037ab100ce46d9 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:38.062156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:38.106762 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57877321-d5ae-49bd-8f63-9a6a03efd526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:38.107670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57877321-d5ae-49bd-8f63-9a6a03efd526 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:38.108090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57877321-d5ae-49bd-8f63-9a6a03efd526 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:38.108513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57877321-d5ae-49bd-8f63-9a6a03efd526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:38.213151 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57877321-d5ae-49bd-8f63-9a6a03efd526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:38.214844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57877321-d5ae-49bd-8f63-9a6a03efd526 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:38.338829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 129/267] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 04:24:38.342365 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aabc61-3418-4248-8305-91e3154b8994 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:38.342864 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aabc61-3418-4248-8305-91e3154b8994 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:38.342963 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aabc61-3418-4248-8305-91e3154b8994 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:38.344481 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 139/268] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:38.348846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57877321-d5ae-49bd-8f63-9a6a03efd526 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:38.350506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e633e-5f11-4b53-9cd8-289517135728 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:38.350796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e633e-5f11-4b53-9cd8-289517135728 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:38.351133 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e633e-5f11-4b53-9cd8-289517135728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:38.377410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-cd5e633e-5f11-4b53-9cd8-289517135728 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:38.378750 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cd5e633e-5f11-4b53-9cd8-289517135728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:38.401580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:38.458033 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 140/269] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:38.537708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57877321-d5ae-49bd-8f63-9a6a03efd526 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:38.589902 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401d86b-ad75-4223-8e77-77dd4c9fa2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:38.590542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401d86b-ad75-4223-8e77-77dd4c9fa2ce None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:38.590819 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401d86b-ad75-4223-8e77-77dd4c9fa2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:38.591086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401d86b-ad75-4223-8e77-77dd4c9fa2ce None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:38.592230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401d86b-ad75-4223-8e77-77dd4c9fa2ce None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:38.593712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401d86b-ad75-4223-8e77-77dd4c9fa2ce None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:38.595648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 130/270] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:38 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:38.601896 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e633e-5f11-4b53-9cd8-289517135728 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:38.616335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332b7a-ddbf-433f-b74d-2ba3b9bd8f12 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:38.616615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332b7a-ddbf-433f-b74d-2ba3b9bd8f12 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:38.616882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332b7a-ddbf-433f-b74d-2ba3b9bd8f12 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:38.618567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 131/271] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:24:38.624290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1c749-10a8-48bd-97d1-39e6202869bc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:38.624577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1c749-10a8-48bd-97d1-39e6202869bc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:38.624839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1c749-10a8-48bd-97d1-39e6202869bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:38.650305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:38.666221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c0e1c749-10a8-48bd-97d1-39e6202869bc None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:38.667573 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c0e1c749-10a8-48bd-97d1-39e6202869bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:38.731148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e633e-5f11-4b53-9cd8-289517135728 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:38.769128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377b722-b47f-4655-92e6-bc1f65b6405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:38.769775 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377b722-b47f-4655-92e6-bc1f65b6405d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:38.770054 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377b722-b47f-4655-92e6-bc1f65b6405d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:38.770322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377b722-b47f-4655-92e6-bc1f65b6405d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:38.771324 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377b722-b47f-4655-92e6-bc1f65b6405d None admin] RBAC: Adding query filter params (role.id=0c9ebbeca1134eb4914025ef4cf80f5c, scope.project.id=5d510566458c49848cdbe57fbe030354, user.id=b9795dad3ecc4fc6a7c7d50da491e93c) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:38.771635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377b722-b47f-4655-92e6-bc1f65b6405d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:38.773439 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377b722-b47f-4655-92e6-bc1f65b6405d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:38.779838 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 141/272] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:38 2022] GET /identity/v3/role_assignments?user.id=b9795dad3ecc4fc6a7c7d50da491e93c&scope.project.id=5d510566458c49848cdbe57fbe030354&role.id=0c9ebbeca1134eb4914025ef4cf80f5c => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:38.780625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377b722-b47f-4655-92e6-bc1f65b6405d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:38.804800 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 132/273] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:38.920695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:38.923702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377b722-b47f-4655-92e6-bc1f65b6405d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:38.962942 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a6748-1f31-4c97-9294-d8cc78c13979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:38.963577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a6748-1f31-4c97-9294-d8cc78c13979 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:38.963855 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a6748-1f31-4c97-9294-d8cc78c13979 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:38.964125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a6748-1f31-4c97-9294-d8cc78c13979 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:38.975245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a6748-1f31-4c97-9294-d8cc78c13979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-eb0a6748-1f31-4c97-9294-d8cc78c13979 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:38.980227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:38.982345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:38.984154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:38.984154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:38.984154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:38.984154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:38.984154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:38.984154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:38.984154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:38.984154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:38.984154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:38.984154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:38.984154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:38.984154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:38.984154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 142/274] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:38.998376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1c749-10a8-48bd-97d1-39e6202869bc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:39.040538 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:39.054468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d9b98-c8bc-49de-82ce-a053e3e2ce11 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:39.054468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d9b98-c8bc-49de-82ce-a053e3e2ce11 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:39.054468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d9b98-c8bc-49de-82ce-a053e3e2ce11 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:39.054468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 143/275] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:39.060381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4a12e-d6e0-431e-9e54-983a1eb2fc41 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:39.060957 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4a12e-d6e0-431e-9e54-983a1eb2fc41 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:39.065646 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4a12e-d6e0-431e-9e54-983a1eb2fc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:39.083664 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3de4a12e-d6e0-431e-9e54-983a1eb2fc41 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:39.085312 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3de4a12e-d6e0-431e-9e54-983a1eb2fc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:39.151856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1c749-10a8-48bd-97d1-39e6202869bc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:39.167547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 144/276] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:39.168214 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4a12e-d6e0-431e-9e54-983a1eb2fc41 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:39.197779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bb6cf-18aa-4fca-bd82-79fba7497459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:39.198449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bb6cf-18aa-4fca-bd82-79fba7497459 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:39.198727 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bb6cf-18aa-4fca-bd82-79fba7497459 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:39.198993 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bb6cf-18aa-4fca-bd82-79fba7497459 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:39.200122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bb6cf-18aa-4fca-bd82-79fba7497459 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:39.200375 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bb6cf-18aa-4fca-bd82-79fba7497459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:39.201779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bb6cf-18aa-4fca-bd82-79fba7497459 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:39.212338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 133/277] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:39.218422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bb6cf-18aa-4fca-bd82-79fba7497459 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:39.281699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:39.292905 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4a12e-d6e0-431e-9e54-983a1eb2fc41 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:39.340577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:39.361531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bb6cf-18aa-4fca-bd82-79fba7497459 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:39.371637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0c028-0bef-4bbd-b945-b79facb85705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:39.372973 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0c028-0bef-4bbd-b945-b79facb85705 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:39.374924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0c028-0bef-4bbd-b945-b79facb85705 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:39.375457 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0c028-0bef-4bbd-b945-b79facb85705 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:39.377609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0c028-0bef-4bbd-b945-b79facb85705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:39.382163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0c028-0bef-4bbd-b945-b79facb85705 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:39.385235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 145/278] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:39.390391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0c028-0bef-4bbd-b945-b79facb85705 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:39.427998 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da16886-8961-4e11-97fa-da4008b90cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:39.429115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da16886-8961-4e11-97fa-da4008b90cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:39.429694 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da16886-8961-4e11-97fa-da4008b90cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:39.430210 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da16886-8961-4e11-97fa-da4008b90cd5 None admin] PATH_INFO: `/v3/users/33c51ddb611d42d4a22137d8b41a11e3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:39.448170 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da16886-8961-4e11-97fa-da4008b90cd5 None admin] RBAC: Authorizing `identity:get_user(user_id=33c51ddb611d42d4a22137d8b41a11e3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:39.450061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da16886-8961-4e11-97fa-da4008b90cd5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:39.452597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 134/279] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:39 2022] GET /identity/v3/users/33c51ddb611d42d4a22137d8b41a11e3 => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:39.462202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da16886-8961-4e11-97fa-da4008b90cd5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:39.508077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0c028-0bef-4bbd-b945-b79facb85705 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:39.542628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d0e66-c5b7-49ff-a20a-7ee4cc1a4cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:39.543233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0e66-c5b7-49ff-a20a-7ee4cc1a4cf6 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:39.543512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0e66-c5b7-49ff-a20a-7ee4cc1a4cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:39.543797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0e66-c5b7-49ff-a20a-7ee4cc1a4cf6 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:39.544448 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d0e66-c5b7-49ff-a20a-7ee4cc1a4cf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:39.545910 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d0e66-c5b7-49ff-a20a-7ee4cc1a4cf6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:39.562527 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da16886-8961-4e11-97fa-da4008b90cd5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:39.598195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950d033-03be-428d-9c2f-a54ddc4a9844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:39.598740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950d033-03be-428d-9c2f-a54ddc4a9844 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:39.599016 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950d033-03be-428d-9c2f-a54ddc4a9844 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:39.599287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950d033-03be-428d-9c2f-a54ddc4a9844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:39.600005 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950d033-03be-428d-9c2f-a54ddc4a9844 None admin] RBAC: Adding query filter params (role.id=64f2951b9ce444bcad20c61347224196, user.id=33c51ddb611d42d4a22137d8b41a11e3, scope.system=all) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:39.600311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950d033-03be-428d-9c2f-a54ddc4a9844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:39.601781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950d033-03be-428d-9c2f-a54ddc4a9844 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:39.606614 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 135/280] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Aug 31 04:24:39 2022] GET /identity/v3/role_assignments?user.id=33c51ddb611d42d4a22137d8b41a11e3&scope.system=all&role.id=64f2951b9ce444bcad20c61347224196 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:39.607783 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29833688-d6f7-4218-8173-b92d6f63dfa8 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:39.608067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29833688-d6f7-4218-8173-b92d6f63dfa8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:39.608339 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29833688-d6f7-4218-8173-b92d6f63dfa8 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:39.609711 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 136/281] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:39.610268 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29833688-d6f7-4218-8173-b92d6f63dfa8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:39.625595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:39.651714 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 146/282] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:24:39 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:24:39.653082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd2344-ff97-4237-9b09-aa2d2d9416ed None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:39.653457 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd2344-ff97-4237-9b09-aa2d2d9416ed None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:39.654058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd2344-ff97-4237-9b09-aa2d2d9416ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:39.674835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-11bd2344-ff97-4237-9b09-aa2d2d9416ed None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:39.677291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-11bd2344-ff97-4237-9b09-aa2d2d9416ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:39.687863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:39.760160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 147/283] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:39.772082 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29833688-d6f7-4218-8173-b92d6f63dfa8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:39.816977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b13a6-f294-41e5-b183-645e085ebb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:39.817761 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b13a6-f294-41e5-b183-645e085ebb56 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:39.818154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b13a6-f294-41e5-b183-645e085ebb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:39.818456 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b13a6-f294-41e5-b183-645e085ebb56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:39.830888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b13a6-f294-41e5-b183-645e085ebb56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c37b13a6-f294-41e5-b183-645e085ebb56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:39.836875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:39.837910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:39.838715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:39.838715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:39.838715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:39.838715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:39.838715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:39.838715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:39.838715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:39.838715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:39.838715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:39.838715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:39.838715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:39.838715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:39.838715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 137/284] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:39.843744 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd2344-ff97-4237-9b09-aa2d2d9416ed None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:39.963231 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd2344-ff97-4237-9b09-aa2d2d9416ed None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:39.999740 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d45b7-a5d2-48bb-9ccd-e971427e61b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:40.000352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d45b7-a5d2-48bb-9ccd-e971427e61b0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:40.000624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d45b7-a5d2-48bb-9ccd-e971427e61b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:40.000891 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d45b7-a5d2-48bb-9ccd-e971427e61b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:40.001654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d45b7-a5d2-48bb-9ccd-e971427e61b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:40.001950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d45b7-a5d2-48bb-9ccd-e971427e61b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:40.003914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d45b7-a5d2-48bb-9ccd-e971427e61b0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:40.014612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 148/285] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:40.021485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b13a6-f294-41e5-b183-645e085ebb56 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:40.049843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d45b7-a5d2-48bb-9ccd-e971427e61b0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:40.060015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:40.117433 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:40.148083 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b13a6-f294-41e5-b183-645e085ebb56 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:40.193701 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d45b7-a5d2-48bb-9ccd-e971427e61b0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:40.215852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630ce88-71e4-4f5c-b6d0-c0a875ee911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:40.216424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ce88-71e4-4f5c-b6d0-c0a875ee911c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:40.216692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ce88-71e4-4f5c-b6d0-c0a875ee911c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:40.216962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ce88-71e4-4f5c-b6d0-c0a875ee911c None admin] PATH_INFO: `/v3/users/ad46f402b6484fc2a5c0f626cb69fe02` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:40.222444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630ce88-71e4-4f5c-b6d0-c0a875ee911c None admin] RBAC: Authorizing `identity:get_user(user_id=ad46f402b6484fc2a5c0f626cb69fe02)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:40.223899 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630ce88-71e4-4f5c-b6d0-c0a875ee911c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:40.225853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 138/286] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:40 2022] GET /identity/v3/users/ad46f402b6484fc2a5c0f626cb69fe02 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:40.231552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630ce88-71e4-4f5c-b6d0-c0a875ee911c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:40.231961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0ea83-1a5b-4903-a2b2-572ed7c085e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:40.232592 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0ea83-1a5b-4903-a2b2-572ed7c085e9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:40.232873 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0ea83-1a5b-4903-a2b2-572ed7c085e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:40.233140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0ea83-1a5b-4903-a2b2-572ed7c085e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:40.246757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0ea83-1a5b-4903-a2b2-572ed7c085e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-5cb0ea83-1a5b-4903-a2b2-572ed7c085e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:40.252013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:40.253479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:40.254419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:40.254419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:40.254419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:40.254419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:40.254419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:40.254419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:40.254419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:40.254419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:40.254419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:40.254419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:40.254419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:40.254419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:40.254419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 149/287] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:24:40.259835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0ea83-1a5b-4903-a2b2-572ed7c085e9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:40.383117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:40.420010 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630ce88-71e4-4f5c-b6d0-c0a875ee911c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:40.427037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0ea83-1a5b-4903-a2b2-572ed7c085e9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:40.489326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572843e-8dbc-4fe9-8249-362fc74fed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:40.490208 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572843e-8dbc-4fe9-8249-362fc74fed11 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:40.490728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572843e-8dbc-4fe9-8249-362fc74fed11 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:40.490938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940b718-63ea-4ebc-8cf0-dd6eb4ae36e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:40.492681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940b718-63ea-4ebc-8cf0-dd6eb4ae36e2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:40.492681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940b718-63ea-4ebc-8cf0-dd6eb4ae36e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:40.492681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940b718-63ea-4ebc-8cf0-dd6eb4ae36e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:40.492989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940b718-63ea-4ebc-8cf0-dd6eb4ae36e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:40.493398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572843e-8dbc-4fe9-8249-362fc74fed11 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:40.493500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940b718-63ea-4ebc-8cf0-dd6eb4ae36e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:40.501220 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940b718-63ea-4ebc-8cf0-dd6eb4ae36e2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:40.502154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572843e-8dbc-4fe9-8249-362fc74fed11 None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:40.504215 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 150/288] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:40.504850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572843e-8dbc-4fe9-8249-362fc74fed11 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:40.507289 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 139/289] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:40 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:40.510446 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940b718-63ea-4ebc-8cf0-dd6eb4ae36e2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:40.513875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572843e-8dbc-4fe9-8249-362fc74fed11 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:40.527149 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:40.631514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940b718-63ea-4ebc-8cf0-dd6eb4ae36e2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:40.662699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:40.671909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17542e0-c467-423e-a85e-76ed35ccffa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:40.672802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17542e0-c467-423e-a85e-76ed35ccffa3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:40.673275 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17542e0-c467-423e-a85e-76ed35ccffa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:40.673727 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17542e0-c467-423e-a85e-76ed35ccffa3 None admin] PATH_INFO: `/v3/users/61573f9c43ca43848c4c3ad7631606c0` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:40.675797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17542e0-c467-423e-a85e-76ed35ccffa3 None admin] RBAC: Authorizing `identity:get_user(user_id=61573f9c43ca43848c4c3ad7631606c0)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:40.677589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17542e0-c467-423e-a85e-76ed35ccffa3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:40.680361 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 151/290] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:40 2022] GET /identity/v3/users/61573f9c43ca43848c4c3ad7631606c0 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:40.685873 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17542e0-c467-423e-a85e-76ed35ccffa3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:40.789991 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572843e-8dbc-4fe9-8249-362fc74fed11 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:40.820776 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17542e0-c467-423e-a85e-76ed35ccffa3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:40.850878 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c970a2-836e-4ef9-8a5c-1ed06f61cb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:40.851548 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c970a2-836e-4ef9-8a5c-1ed06f61cb86 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:40.851827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c970a2-836e-4ef9-8a5c-1ed06f61cb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:40.852102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c970a2-836e-4ef9-8a5c-1ed06f61cb86 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354/users/ad46f402b6484fc2a5c0f626cb69fe02/roles/1d182987dff1438492d3b48c532573c0` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:40.855458 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c970a2-836e-4ef9-8a5c-1ed06f61cb86 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d510566458c49848cdbe57fbe030354, user_id=ad46f402b6484fc2a5c0f626cb69fe02, role_id=1d182987dff1438492d3b48c532573c0)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:40.858099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c970a2-836e-4ef9-8a5c-1ed06f61cb86 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:40.879910 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561ec93-8821-4728-8a28-5c8d49e210d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:40.880646 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561ec93-8821-4728-8a28-5c8d49e210d1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:40.880807 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561ec93-8821-4728-8a28-5c8d49e210d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:40.881047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561ec93-8821-4728-8a28-5c8d49e210d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:40.931898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 140/291] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:24:40 2022] PUT /identity/v3/projects/5d510566458c49848cdbe57fbe030354/users/ad46f402b6484fc2a5c0f626cb69fe02/roles/1d182987dff1438492d3b48c532573c0 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:24:40.956535 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:40.964330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561ec93-8821-4728-8a28-5c8d49e210d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:40.965858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561ec93-8821-4728-8a28-5c8d49e210d1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:41.074556 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 152/292] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:41.079988 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c970a2-836e-4ef9-8a5c-1ed06f61cb86 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:41.169162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:41.213122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c970a2-836e-4ef9-8a5c-1ed06f61cb86 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:41.253774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cd9a5-e476-4920-a4af-c1a3ecdbb22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:41.254414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd9a5-e476-4920-a4af-c1a3ecdbb22d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:41.254691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd9a5-e476-4920-a4af-c1a3ecdbb22d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:41.254963 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd9a5-e476-4920-a4af-c1a3ecdbb22d None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:41.256117 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cd9a5-e476-4920-a4af-c1a3ecdbb22d None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:41.257712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cd9a5-e476-4920-a4af-c1a3ecdbb22d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:41.259703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 141/293] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:41 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:41.265134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561ec93-8821-4728-8a28-5c8d49e210d1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:41.369660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:41.372422 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561ec93-8821-4728-8a28-5c8d49e210d1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:41.408274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8d477-c088-4094-a989-1b09310942a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:41.408898 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d477-c088-4094-a989-1b09310942a1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:41.409262 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d477-c088-4094-a989-1b09310942a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:41.409663 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d477-c088-4094-a989-1b09310942a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:41.410401 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8d477-c088-4094-a989-1b09310942a1 None admin] RBAC: Adding query filter params (role.id=64f2951b9ce444bcad20c61347224196, scope.project.id=5d510566458c49848cdbe57fbe030354, user.id=61573f9c43ca43848c4c3ad7631606c0) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:41.410712 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8d477-c088-4094-a989-1b09310942a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:41.412210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8d477-c088-4094-a989-1b09310942a1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:41.418496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 153/294] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:41 2022] GET /identity/v3/role_assignments?user.id=61573f9c43ca43848c4c3ad7631606c0&scope.project.id=5d510566458c49848cdbe57fbe030354&role.id=64f2951b9ce444bcad20c61347224196 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:41.820763 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619707c1-c88a-46c0-8058-0506936f9fac None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:41.821656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619707c1-c88a-46c0-8058-0506936f9fac None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:41.822089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619707c1-c88a-46c0-8058-0506936f9fac None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:41.823818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 142/295] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:41.828796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb86f-de88-4344-b0f2-a8eb598e4113 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:41.829357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb86f-de88-4344-b0f2-a8eb598e4113 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:41.829822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb86f-de88-4344-b0f2-a8eb598e4113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:41.850027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-237cb86f-de88-4344-b0f2-a8eb598e4113 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:41.851632 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-237cb86f-de88-4344-b0f2-a8eb598e4113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:41.932449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 154/296] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:42.171641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93e7c-6785-4e25-a995-279aea2e22aa None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:42.171826 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93e7c-6785-4e25-a995-279aea2e22aa None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:42.172140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93e7c-6785-4e25-a995-279aea2e22aa None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:42.173542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 143/297] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:42.178906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016de11-4669-403d-a4e3-446e209506ef None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:42.179422 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016de11-4669-403d-a4e3-446e209506ef None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:42.179910 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016de11-4669-403d-a4e3-446e209506ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:42.199153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9016de11-4669-403d-a4e3-446e209506ef None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:42.200616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9016de11-4669-403d-a4e3-446e209506ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:42.209840 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df93e7c-6785-4e25-a995-279aea2e22aa None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:42.279456 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 155/298] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:42.280566 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71762d8a-ecc2-4ea2-a6cb-dd092eb9e76d None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:42.280854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71762d8a-ecc2-4ea2-a6cb-dd092eb9e76d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:42.281619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71762d8a-ecc2-4ea2-a6cb-dd092eb9e76d None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:42.282705 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 156/299] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:42.288469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322810c-3eba-4fb9-ae63-d3e4a6c64cbc None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:42.288754 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322810c-3eba-4fb9-ae63-d3e4a6c64cbc None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:42.289094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322810c-3eba-4fb9-ae63-d3e4a6c64cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:42.308063 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1322810c-3eba-4fb9-ae63-d3e4a6c64cbc None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:42.309291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1322810c-3eba-4fb9-ae63-d3e4a6c64cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:42.323781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df93e7c-6785-4e25-a995-279aea2e22aa None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:42.329533 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:42.358638 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:42.364565 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f440a90-b64c-408d-a267-152798c9392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:42.365788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f440a90-b64c-408d-a267-152798c9392c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:42.365788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f440a90-b64c-408d-a267-152798c9392c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:42.365788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f440a90-b64c-408d-a267-152798c9392c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:42.377021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f440a90-b64c-408d-a267-152798c9392c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6f440a90-b64c-408d-a267-152798c9392c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:42.382470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:42.383348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:42.384596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:42.384596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:42.384596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:42.384596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:42.384596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:42.384596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:42.384596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:42.384596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:42.384596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:42.384596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:42.384596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:42.384596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:42.384596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 144/300] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:42.389359 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f440a90-b64c-408d-a267-152798c9392c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:42.404262 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 157/301] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:42.502038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f440a90-b64c-408d-a267-152798c9392c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:42.538531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff75cf-d974-4b0f-93b6-b7ab00a7d4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:42.539137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff75cf-d974-4b0f-93b6-b7ab00a7d4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:42.539417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff75cf-d974-4b0f-93b6-b7ab00a7d4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:42.539695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff75cf-d974-4b0f-93b6-b7ab00a7d4c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:42.540363 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff75cf-d974-4b0f-93b6-b7ab00a7d4c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:42.540669 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff75cf-d974-4b0f-93b6-b7ab00a7d4c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:42.542079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff75cf-d974-4b0f-93b6-b7ab00a7d4c8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:42.551053 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 145/302] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:42.556587 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322810c-3eba-4fb9-ae63-d3e4a6c64cbc None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:42.580420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff75cf-d974-4b0f-93b6-b7ab00a7d4c8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:42.654000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:42.663712 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322810c-3eba-4fb9-ae63-d3e4a6c64cbc None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:42.700171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16b371-b9f3-4b40-85e0-33941ce2caf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:42.701146 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16b371-b9f3-4b40-85e0-33941ce2caf5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:42.701871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16b371-b9f3-4b40-85e0-33941ce2caf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:42.702344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16b371-b9f3-4b40-85e0-33941ce2caf5 None admin] PATH_INFO: `/v3/users/33c51ddb611d42d4a22137d8b41a11e3` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:42.703695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16b371-b9f3-4b40-85e0-33941ce2caf5 None admin] RBAC: Authorizing `identity:get_user(user_id=33c51ddb611d42d4a22137d8b41a11e3)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:42.705361 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16b371-b9f3-4b40-85e0-33941ce2caf5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:42.707233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff75cf-d974-4b0f-93b6-b7ab00a7d4c8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:42.707916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 158/303] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:42 2022] GET /identity/v3/users/33c51ddb611d42d4a22137d8b41a11e3 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:42.708974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16b371-b9f3-4b40-85e0-33941ce2caf5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:42.730314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:42.748764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1179e8-396b-4dc6-a46d-b9024d7d828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:42.749432 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1179e8-396b-4dc6-a46d-b9024d7d828b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:42.749711 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1179e8-396b-4dc6-a46d-b9024d7d828b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:42.749985 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1179e8-396b-4dc6-a46d-b9024d7d828b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:42.760982 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1179e8-396b-4dc6-a46d-b9024d7d828b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8d1179e8-396b-4dc6-a46d-b9024d7d828b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:42.766815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:42.767798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:42.769150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:42.769150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:42.769150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:42.769150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:42.769150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:42.769150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:42.769150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:42.769150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:42.769150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:42.769150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:42.769150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:42.769150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:42.773349 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 146/304] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:24:42.774514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1179e8-396b-4dc6-a46d-b9024d7d828b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:42.853327 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16b371-b9f3-4b40-85e0-33941ce2caf5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:42.890031 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709846e-dc3c-47d2-9ad6-f7539920fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:42.890513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709846e-dc3c-47d2-9ad6-f7539920fd4a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:42.890789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709846e-dc3c-47d2-9ad6-f7539920fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:42.891059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709846e-dc3c-47d2-9ad6-f7539920fd4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:42.892172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709846e-dc3c-47d2-9ad6-f7539920fd4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:42.894174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709846e-dc3c-47d2-9ad6-f7539920fd4a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:42.896176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 159/305] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:42.898068 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709846e-dc3c-47d2-9ad6-f7539920fd4a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:42.928487 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1179e8-396b-4dc6-a46d-b9024d7d828b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:42.943740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:42.964526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de9d3f-e2c7-4945-8539-62ea6b528209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:42.965182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de9d3f-e2c7-4945-8539-62ea6b528209 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:42.965490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de9d3f-e2c7-4945-8539-62ea6b528209 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:42.965767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de9d3f-e2c7-4945-8539-62ea6b528209 None admin] PATH_INFO: `/v3/system/users/33c51ddb611d42d4a22137d8b41a11e3/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:42.967249 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de9d3f-e2c7-4945-8539-62ea6b528209 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=33c51ddb611d42d4a22137d8b41a11e3, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:42.968678 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de9d3f-e2c7-4945-8539-62ea6b528209 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:42.989605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:43.004743 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709846e-dc3c-47d2-9ad6-f7539920fd4a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:43.038652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839c05f-3500-422d-99d3-8601c4f9b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:43.039183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839c05f-3500-422d-99d3-8601c4f9b6bb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:43.039463 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839c05f-3500-422d-99d3-8601c4f9b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:43.039733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839c05f-3500-422d-99d3-8601c4f9b6bb None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:43.040395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839c05f-3500-422d-99d3-8601c4f9b6bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:43.040705 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839c05f-3500-422d-99d3-8601c4f9b6bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:43.042116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839c05f-3500-422d-99d3-8601c4f9b6bb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:43.052780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 160/306] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:43.052780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839c05f-3500-422d-99d3-8601c4f9b6bb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:43.067968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 147/307] 10.222.0.39 () {58 vars in 1334 bytes} [Wed Aug 31 04:24:42 2022] PUT /identity/v3/system/users/33c51ddb611d42d4a22137d8b41a11e3/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:24:43.069016 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de9d3f-e2c7-4945-8539-62ea6b528209 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:43.190192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de9d3f-e2c7-4945-8539-62ea6b528209 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:43.192065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839c05f-3500-422d-99d3-8601c4f9b6bb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:43.233943 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b27352-29a1-4837-8ead-5eb5209fbf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:43.234392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ce7e4-a0b9-49eb-89bd-1608026f1c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:43.234576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b27352-29a1-4837-8ead-5eb5209fbf42 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:43.234848 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b27352-29a1-4837-8ead-5eb5209fbf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:43.235012 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ce7e4-a0b9-49eb-89bd-1608026f1c81 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:43.235112 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b27352-29a1-4837-8ead-5eb5209fbf42 None admin] PATH_INFO: `/v3/users/7c10bf16a5be4ccd808e11de7e86cd6a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:43.235281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ce7e4-a0b9-49eb-89bd-1608026f1c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:43.235548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ce7e4-a0b9-49eb-89bd-1608026f1c81 None admin] PATH_INFO: `/v3/groups` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:43.236188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ce7e4-a0b9-49eb-89bd-1608026f1c81 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:43.238241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ce7e4-a0b9-49eb-89bd-1608026f1c81 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:43.254113 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b27352-29a1-4837-8ead-5eb5209fbf42 None admin] RBAC: Authorizing `identity:get_user(user_id=7c10bf16a5be4ccd808e11de7e86cd6a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:43.256060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b27352-29a1-4837-8ead-5eb5209fbf42 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:43.257380 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 148/308] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:43 2022] GET /identity/v3/users/7c10bf16a5be4ccd808e11de7e86cd6a => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:43.258535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc3c34-87bf-4a8b-9fca-4a1d7dcb3aba None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:43.258811 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc3c34-87bf-4a8b-9fca-4a1d7dcb3aba None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:43.259077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc3c34-87bf-4a8b-9fca-4a1d7dcb3aba None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:43.260253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 149/309] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:43.265182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc3c34-87bf-4a8b-9fca-4a1d7dcb3aba None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:43.301186 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:43.310044 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 161/310] 10.222.0.39 () {60 vars in 1134 bytes} [Wed Aug 31 04:24:43 2022] POST /identity/v3/groups => generated 229 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:24:43.318711 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb29ef4-ae60-40be-a9f4-0fe410e41e0d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:43.319013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb29ef4-ae60-40be-a9f4-0fe410e41e0d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:43.319269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb29ef4-ae60-40be-a9f4-0fe410e41e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:43.340392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1fb29ef4-ae60-40be-a9f4-0fe410e41e0d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:43.341715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1fb29ef4-ae60-40be-a9f4-0fe410e41e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:43.344352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:43.396429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc3c34-87bf-4a8b-9fca-4a1d7dcb3aba None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:43.436481 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 162/311] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:43.448871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe89eb9-e885-40ed-9de6-71ea45febc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:43.449890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe89eb9-e885-40ed-9de6-71ea45febc82 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:43.450431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe89eb9-e885-40ed-9de6-71ea45febc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:43.450896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe89eb9-e885-40ed-9de6-71ea45febc82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:43.451968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe89eb9-e885-40ed-9de6-71ea45febc82 None admin] RBAC: Adding query filter params (role.id=1d182987dff1438492d3b48c532573c0, user.id=7c10bf16a5be4ccd808e11de7e86cd6a, scope.system=all) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:43.452478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe89eb9-e885-40ed-9de6-71ea45febc82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:43.454232 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe89eb9-e885-40ed-9de6-71ea45febc82 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:43.469262 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 150/312] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Aug 31 04:24:43 2022] GET /identity/v3/role_assignments?user.id=7c10bf16a5be4ccd808e11de7e86cd6a&scope.system=all&role.id=1d182987dff1438492d3b48c532573c0 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:43.707086 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb29ef4-ae60-40be-a9f4-0fe410e41e0d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:43.816733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb29ef4-ae60-40be-a9f4-0fe410e41e0d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:43.938070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6a846-611d-4b69-826f-f69d98d2c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:43.938710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6a846-611d-4b69-826f-f69d98d2c902 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:43.938989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6a846-611d-4b69-826f-f69d98d2c902 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:43.939261 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6a846-611d-4b69-826f-f69d98d2c902 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:43.947065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:43.951424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6a846-611d-4b69-826f-f69d98d2c902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-ffc6a846-611d-4b69-826f-f69d98d2c902 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:43.959342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:43.960211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:43.960982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:43.960982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:43.960982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:43.960982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:43.960982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:43.960982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:43.960982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:43.960982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:43.960982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:43.960982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:43.960982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:43.960982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:43.962455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 163/313] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:43.967513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe89eb9-e885-40ed-9de6-71ea45febc82 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:44.075341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:44.078973 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe89eb9-e885-40ed-9de6-71ea45febc82 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:44.115554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144a190-134a-479b-9ccb-9556d1eb32b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:44.116166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144a190-134a-479b-9ccb-9556d1eb32b7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:44.116447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144a190-134a-479b-9ccb-9556d1eb32b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:44.116720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144a190-134a-479b-9ccb-9556d1eb32b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:44.117417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144a190-134a-479b-9ccb-9556d1eb32b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:44.117725 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144a190-134a-479b-9ccb-9556d1eb32b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:44.119152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144a190-134a-479b-9ccb-9556d1eb32b7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:44.127993 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 151/314] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:44.133523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6a846-611d-4b69-826f-f69d98d2c902 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:44.249892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6a846-611d-4b69-826f-f69d98d2c902 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:44.286005 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f138e-74f1-4537-813d-89572ca34b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:44.286634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f138e-74f1-4537-813d-89572ca34b9e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:44.286911 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f138e-74f1-4537-813d-89572ca34b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:44.287187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f138e-74f1-4537-813d-89572ca34b9e None admin] PATH_INFO: `/v3/users/ad46f402b6484fc2a5c0f626cb69fe02` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:44.288334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f138e-74f1-4537-813d-89572ca34b9e None admin] RBAC: Authorizing `identity:get_user(user_id=ad46f402b6484fc2a5c0f626cb69fe02)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:44.289886 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f138e-74f1-4537-813d-89572ca34b9e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:44.291881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 164/315] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:44 2022] GET /identity/v3/users/ad46f402b6484fc2a5c0f626cb69fe02 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:44.297490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144a190-134a-479b-9ccb-9556d1eb32b7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:44.406152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144a190-134a-479b-9ccb-9556d1eb32b7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:44.442200 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5553f-fba4-4ac9-95c4-9351e6a5fea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:44.442813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5553f-fba4-4ac9-95c4-9351e6a5fea6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:44.443094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5553f-fba4-4ac9-95c4-9351e6a5fea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:44.443367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5553f-fba4-4ac9-95c4-9351e6a5fea6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:44.482601 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:44.523665 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5553f-fba4-4ac9-95c4-9351e6a5fea6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:44.525111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5553f-fba4-4ac9-95c4-9351e6a5fea6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:44.633974 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 152/316] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:44.639505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f138e-74f1-4537-813d-89572ca34b9e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:44.708708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:44.744588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f138e-74f1-4537-813d-89572ca34b9e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:44.781102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b59cf-efe6-4ca7-9c34-271ae4da7526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:44.781687 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b59cf-efe6-4ca7-9c34-271ae4da7526 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:44.782236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b59cf-efe6-4ca7-9c34-271ae4da7526 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:44.782236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b59cf-efe6-4ca7-9c34-271ae4da7526 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:44.783448 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b59cf-efe6-4ca7-9c34-271ae4da7526 None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:44.785612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b59cf-efe6-4ca7-9c34-271ae4da7526 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:44.787569 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 165/317] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:44 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:44.793452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5553f-fba4-4ac9-95c4-9351e6a5fea6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:44.861062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:44.903487 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5553f-fba4-4ac9-95c4-9351e6a5fea6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:44.938763 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf31004-ba52-4815-9cf6-8a8a1ff4f331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:44.939371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf31004-ba52-4815-9cf6-8a8a1ff4f331 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:44.939652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf31004-ba52-4815-9cf6-8a8a1ff4f331 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:44.939933 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf31004-ba52-4815-9cf6-8a8a1ff4f331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:44.940734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf31004-ba52-4815-9cf6-8a8a1ff4f331 None admin] RBAC: Adding query filter params (role.id=1d182987dff1438492d3b48c532573c0, scope.project.id=5d510566458c49848cdbe57fbe030354, user.id=ad46f402b6484fc2a5c0f626cb69fe02) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:44.941105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf31004-ba52-4815-9cf6-8a8a1ff4f331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:44.942494 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf31004-ba52-4815-9cf6-8a8a1ff4f331 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:44.948886 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 153/318] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:24:44 2022] GET /identity/v3/role_assignments?user.id=ad46f402b6484fc2a5c0f626cb69fe02&scope.project.id=5d510566458c49848cdbe57fbe030354&role.id=1d182987dff1438492d3b48c532573c0 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:45.122595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b56a-a61b-4cab-a564-73cc2da3c73c None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:45.123111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b56a-a61b-4cab-a564-73cc2da3c73c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:45.123599 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b56a-a61b-4cab-a564-73cc2da3c73c None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:45.126102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 166/319] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:45.132606 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38055d-fd6a-45a0-b1f4-22bd1f7ec861 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:45.133559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38055d-fd6a-45a0-b1f4-22bd1f7ec861 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:45.134037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38055d-fd6a-45a0-b1f4-22bd1f7ec861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:45.155141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0e38055d-fd6a-45a0-b1f4-22bd1f7ec861 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:45.156370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0e38055d-fd6a-45a0-b1f4-22bd1f7ec861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:45.229515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 154/320] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:45.312793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c7093-bdbc-4ee4-8179-a4f283a1ca02 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:45.313081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c7093-bdbc-4ee4-8179-a4f283a1ca02 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:45.313274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c7093-bdbc-4ee4-8179-a4f283a1ca02 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:45.314784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 167/321] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:45.319681 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f448ef-94bf-45bc-9816-b3046ab27588 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:45.319972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f448ef-94bf-45bc-9816-b3046ab27588 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:45.320241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f448ef-94bf-45bc-9816-b3046ab27588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:45.338237 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-47f448ef-94bf-45bc-9816-b3046ab27588 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:45.339401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-47f448ef-94bf-45bc-9816-b3046ab27588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:45.390476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:45.405952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49a505-1b52-4a6f-8002-d4e32cb83470 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:45.406345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49a505-1b52-4a6f-8002-d4e32cb83470 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:45.406622 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49a505-1b52-4a6f-8002-d4e32cb83470 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:45.408015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 168/322] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:45.414000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 155/323] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:45.414133 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed225c-a698-47df-badb-7beedb2f448c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:45.414133 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed225c-a698-47df-badb-7beedb2f448c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:45.414133 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed225c-a698-47df-badb-7beedb2f448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:45.431532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9aed225c-a698-47df-badb-7beedb2f448c None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:45.432685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9aed225c-a698-47df-badb-7beedb2f448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:45.498855 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 169/324] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:45.501539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f448ef-94bf-45bc-9816-b3046ab27588 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:45.600431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f448ef-94bf-45bc-9816-b3046ab27588 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:45.633848 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f411d-5027-4e4c-88c6-bc04ff629122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:45.634479 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f411d-5027-4e4c-88c6-bc04ff629122 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:45.634757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f411d-5027-4e4c-88c6-bc04ff629122 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:45.635030 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f411d-5027-4e4c-88c6-bc04ff629122 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:45.645482 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f411d-5027-4e4c-88c6-bc04ff629122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f03f411d-5027-4e4c-88c6-bc04ff629122 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:45.650518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:45.651398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:45.652187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:45.652187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:45.652187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:45.652187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:45.652187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:45.652187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:45.652187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:45.652187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:45.652187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:45.652187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:45.652187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:45.652187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:45.652187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 156/325] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:45.658739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed225c-a698-47df-badb-7beedb2f448c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:45.675353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f411d-5027-4e4c-88c6-bc04ff629122 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:45.723335 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:45.724087 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:45.763724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed225c-a698-47df-badb-7beedb2f448c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:45.778169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f411d-5027-4e4c-88c6-bc04ff629122 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:45.800801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133b1c0-8a64-4c96-867a-06caceb34b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:45.801435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133b1c0-8a64-4c96-867a-06caceb34b34 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:45.801717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133b1c0-8a64-4c96-867a-06caceb34b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:45.801991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133b1c0-8a64-4c96-867a-06caceb34b34 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:45.802655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133b1c0-8a64-4c96-867a-06caceb34b34 None admin] RBAC: Adding query filter params (name=member) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:45.802957 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133b1c0-8a64-4c96-867a-06caceb34b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:45.804328 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133b1c0-8a64-4c96-867a-06caceb34b34 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:45.812231 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 170/326] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:45.813015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133b1c0-8a64-4c96-867a-06caceb34b34 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:45.894559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1243-3b4a-47cc-b72e-08a4334aa3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:45.895101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1243-3b4a-47cc-b72e-08a4334aa3eb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:45.895376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1243-3b4a-47cc-b72e-08a4334aa3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:45.895900 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1243-3b4a-47cc-b72e-08a4334aa3eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:45.896999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d1243-3b4a-47cc-b72e-08a4334aa3eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:45.898461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d1243-3b4a-47cc-b72e-08a4334aa3eb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:45.900194 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 157/327] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:24:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:45.900743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1243-3b4a-47cc-b72e-08a4334aa3eb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:45.960633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133b1c0-8a64-4c96-867a-06caceb34b34 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:45.985234 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:45.996157 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fe561-2082-4e1a-b9e9-b635a9fb7f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:45.996899 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fe561-2082-4e1a-b9e9-b635a9fb7f93 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:45.997051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fe561-2082-4e1a-b9e9-b635a9fb7f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:45.997347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fe561-2082-4e1a-b9e9-b635a9fb7f93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:46.000686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1243-3b4a-47cc-b72e-08a4334aa3eb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:46.009230 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fe561-2082-4e1a-b9e9-b635a9fb7f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-174fe561-2082-4e1a-b9e9-b635a9fb7f93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:46.014037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:46.014929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:46.015729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:46.015729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:46.015729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:46.015729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:46.015729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:46.015729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:46.015729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:46.015729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:46.015729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:46.015729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:46.015729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:46.015729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:46.015729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 171/328] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:46.016394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:46.016464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fe561-2082-4e1a-b9e9-b635a9fb7f93 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:46.040739 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1fc6b-3306-4ac7-9ff2-0699718e42aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:46.040939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1fc6b-3306-4ac7-9ff2-0699718e42aa None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:46.041258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1fc6b-3306-4ac7-9ff2-0699718e42aa None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:46.041529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1fc6b-3306-4ac7-9ff2-0699718e42aa None admin] PATH_INFO: `/v3/users/33c51ddb611d42d4a22137d8b41a11e3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:46.042669 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1fc6b-3306-4ac7-9ff2-0699718e42aa None admin] RBAC: Authorizing `identity:get_user(user_id=33c51ddb611d42d4a22137d8b41a11e3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:46.044196 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1fc6b-3306-4ac7-9ff2-0699718e42aa None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:46.049833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 158/329] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:45 2022] GET /identity/v3/users/33c51ddb611d42d4a22137d8b41a11e3 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:46.050347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1fc6b-3306-4ac7-9ff2-0699718e42aa None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:46.124912 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fe561-2082-4e1a-b9e9-b635a9fb7f93 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:46.154455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1fc6b-3306-4ac7-9ff2-0699718e42aa None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:46.159814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a1c85-1060-4075-8349-02dbbaf8b7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:46.160419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a1c85-1060-4075-8349-02dbbaf8b7c1 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:46.160702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a1c85-1060-4075-8349-02dbbaf8b7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:46.160977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a1c85-1060-4075-8349-02dbbaf8b7c1 None admin] PATH_INFO: `/v3/groups` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:46.161655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a1c85-1060-4075-8349-02dbbaf8b7c1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:46.163097 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a1c85-1060-4075-8349-02dbbaf8b7c1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:46.189565 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdef77-2812-4321-9a77-ad12aef16994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:46.190171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdef77-2812-4321-9a77-ad12aef16994 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:46.191080 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdef77-2812-4321-9a77-ad12aef16994 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:46.191572 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdef77-2812-4321-9a77-ad12aef16994 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:46.192238 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdef77-2812-4321-9a77-ad12aef16994 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:46.192541 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdef77-2812-4321-9a77-ad12aef16994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:46.193940 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdef77-2812-4321-9a77-ad12aef16994 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:46.201806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 159/330] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:46.202651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdef77-2812-4321-9a77-ad12aef16994 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:46.247062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:46.266762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 172/331] 10.222.0.39 () {60 vars in 1134 bytes} [Wed Aug 31 04:24:46 2022] POST /identity/v3/groups => generated 226 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:24:46.267583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a1c85-1060-4075-8349-02dbbaf8b7c1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:46.307816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdef77-2812-4321-9a77-ad12aef16994 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:46.325707 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:46.347513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7e363-6d7d-4f42-aa71-8f351b4a6de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:46.348140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e363-6d7d-4f42-aa71-8f351b4a6de9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:46.348418 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e363-6d7d-4f42-aa71-8f351b4a6de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:46.348691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7e363-6d7d-4f42-aa71-8f351b4a6de9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:46.352140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7e363-6d7d-4f42-aa71-8f351b4a6de9 None admin] RBAC: Adding query filter params (role.id=64f2951b9ce444bcad20c61347224196, user.id=33c51ddb611d42d4a22137d8b41a11e3, scope.system=all) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:46.352140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7e363-6d7d-4f42-aa71-8f351b4a6de9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:46.352140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7e363-6d7d-4f42-aa71-8f351b4a6de9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:46.377244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 160/332] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Aug 31 04:24:46 2022] GET /identity/v3/role_assignments?user.id=33c51ddb611d42d4a22137d8b41a11e3&scope.system=all&role.id=64f2951b9ce444bcad20c61347224196 => generated 510 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:46.385983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a1c85-1060-4075-8349-02dbbaf8b7c1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:46.428889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0dc7b-3a2f-4f9e-a616-4cd929ec7648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:46.429605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0dc7b-3a2f-4f9e-a616-4cd929ec7648 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:46.429883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0dc7b-3a2f-4f9e-a616-4cd929ec7648 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:46.430155 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0dc7b-3a2f-4f9e-a616-4cd929ec7648 None admin] PATH_INFO: `/v3/users/7c10bf16a5be4ccd808e11de7e86cd6a` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:46.431411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0dc7b-3a2f-4f9e-a616-4cd929ec7648 None admin] RBAC: Authorizing `identity:get_user(user_id=7c10bf16a5be4ccd808e11de7e86cd6a)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:46.432888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0dc7b-3a2f-4f9e-a616-4cd929ec7648 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:46.434577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 173/333] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:46 2022] GET /identity/v3/users/7c10bf16a5be4ccd808e11de7e86cd6a => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:46.440479 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7e363-6d7d-4f42-aa71-8f351b4a6de9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:46.552946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7e363-6d7d-4f42-aa71-8f351b4a6de9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:46.554567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:46.590866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280d162-42ad-42a2-b7e7-81a49c864293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:46.591859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280d162-42ad-42a2-b7e7-81a49c864293 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:46.592390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280d162-42ad-42a2-b7e7-81a49c864293 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:46.592852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280d162-42ad-42a2-b7e7-81a49c864293 None admin] PATH_INFO: `/v3/system/users/7c10bf16a5be4ccd808e11de7e86cd6a/roles/1d182987dff1438492d3b48c532573c0` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:46.594924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280d162-42ad-42a2-b7e7-81a49c864293 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7c10bf16a5be4ccd808e11de7e86cd6a, role_id=1d182987dff1438492d3b48c532573c0)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:46.596287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280d162-42ad-42a2-b7e7-81a49c864293 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:46.654085 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 161/334] 10.222.0.39 () {58 vars in 1334 bytes} [Wed Aug 31 04:24:46 2022] PUT /identity/v3/system/users/7c10bf16a5be4ccd808e11de7e86cd6a/roles/1d182987dff1438492d3b48c532573c0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:24:48.474154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a1d39-61a2-4d5f-a59a-7d4e4d42d0e7 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:48.474639 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a1d39-61a2-4d5f-a59a-7d4e4d42d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:48.474639 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a1d39-61a2-4d5f-a59a-7d4e4d42d0e7 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:48.476214 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 174/335] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:48.481320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5864db-48c7-49a6-ace9-5f75752ef4ed None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:48.482127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5864db-48c7-49a6-ace9-5f75752ef4ed None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:48.482611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5864db-48c7-49a6-ace9-5f75752ef4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:48.503546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0e5864db-48c7-49a6-ace9-5f75752ef4ed None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:48.505136 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0e5864db-48c7-49a6-ace9-5f75752ef4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:48.583440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 162/336] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:48.743977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa4b84-2054-4f22-99d9-6d4d93bf3397 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:48.744267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa4b84-2054-4f22-99d9-6d4d93bf3397 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:48.744437 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa4b84-2054-4f22-99d9-6d4d93bf3397 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:48.746177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 175/337] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:48.751287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950424-fb26-4e0c-8a64-8f0f982ee2bf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:48.751800 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950424-fb26-4e0c-8a64-8f0f982ee2bf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:48.752266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950424-fb26-4e0c-8a64-8f0f982ee2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:48.774444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-21950424-fb26-4e0c-8a64-8f0f982ee2bf None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:48.778620 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-21950424-fb26-4e0c-8a64-8f0f982ee2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:48.871494 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 163/338] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:48.903128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef4366-e0ff-44a7-9be6-4048f07a0c5a None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:48.903445 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef4366-e0ff-44a7-9be6-4048f07a0c5a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:48.903669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef4366-e0ff-44a7-9be6-4048f07a0c5a None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:48.905152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 176/339] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:48.910531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ad895-a8db-4a9b-9c07-c33a4e4b8c1b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:48.910814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ad895-a8db-4a9b-9c07-c33a4e4b8c1b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:48.911095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ad895-a8db-4a9b-9c07-c33a4e4b8c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:48.933868 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b36ad895-a8db-4a9b-9c07-c33a4e4b8c1b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:48.935148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b36ad895-a8db-4a9b-9c07-c33a4e4b8c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:48.960723 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:49.011986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 164/340] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:49.098865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef4366-e0ff-44a7-9be6-4048f07a0c5a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:49.220538 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef4366-e0ff-44a7-9be6-4048f07a0c5a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:49.239760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:49.246022 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ad895-a8db-4a9b-9c07-c33a4e4b8c1b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:49.296495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65d085-4a0a-4e73-81d5-530e04966d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:49.297056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65d085-4a0a-4e73-81d5-530e04966d91 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:49.297359 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65d085-4a0a-4e73-81d5-530e04966d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:49.297631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65d085-4a0a-4e73-81d5-530e04966d91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:49.312103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65d085-4a0a-4e73-81d5-530e04966d91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2d65d085-4a0a-4e73-81d5-530e04966d91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:49.317072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:49.318121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:49.318900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:49.318900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:49.318900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:49.318900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:49.318900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:49.318900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:49.318900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:49.318900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:49.318900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:49.318900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:49.318900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:49.318900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:49.321341 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 177/341] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:24:49.324155 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65d085-4a0a-4e73-81d5-530e04966d91 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:49.371597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ad895-a8db-4a9b-9c07-c33a4e4b8c1b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:49.414866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f85a1-b607-4e4d-9c1f-27f7d1bb1962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:49.415890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f85a1-b607-4e4d-9c1f-27f7d1bb1962 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:49.416427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f85a1-b607-4e4d-9c1f-27f7d1bb1962 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:49.416969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f85a1-b607-4e4d-9c1f-27f7d1bb1962 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:49.430490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f85a1-b607-4e4d-9c1f-27f7d1bb1962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e55f85a1-b607-4e4d-9c1f-27f7d1bb1962 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:49.436471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:49.437401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:49.438192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:49.438192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:49.438192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:49.438192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:49.438192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:49.438192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:49.438192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:49.438192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:49.438192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:49.438192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:49.438192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:49.438192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:49.445390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 165/342] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:24:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:24:49.446588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f85a1-b607-4e4d-9c1f-27f7d1bb1962 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:49.451027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65d085-4a0a-4e73-81d5-530e04966d91 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:49.477049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:49.490264 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07381454-4c12-4862-9376-4cb6a128f900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:49.490933 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07381454-4c12-4862-9376-4cb6a128f900 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:49.491145 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07381454-4c12-4862-9376-4cb6a128f900 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:49.491417 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07381454-4c12-4862-9376-4cb6a128f900 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:49.492088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07381454-4c12-4862-9376-4cb6a128f900 None admin] RBAC: Adding query filter params (name=member) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:49.492389 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07381454-4c12-4862-9376-4cb6a128f900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:49.493864 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07381454-4c12-4862-9376-4cb6a128f900 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:49.503517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 178/343] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:49.504285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07381454-4c12-4862-9376-4cb6a128f900 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:49.553766 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:49.574507 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f85a1-b607-4e4d-9c1f-27f7d1bb1962 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:49.621373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07381454-4c12-4862-9376-4cb6a128f900 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:49.625746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d903c8-be26-49af-b8fa-a584e35b9403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:49.626611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d903c8-be26-49af-b8fa-a584e35b9403 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:49.627068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d903c8-be26-49af-b8fa-a584e35b9403 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:49.627516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d903c8-be26-49af-b8fa-a584e35b9403 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:49.639499 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d903c8-be26-49af-b8fa-a584e35b9403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c3d903c8-be26-49af-b8fa-a584e35b9403 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:49.648530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:49.649555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:49.650365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:49.650365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:49.650365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:49.650365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:49.650365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:49.650365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:49.650365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:49.650365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:49.650365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:49.650365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:49.650365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 04:24:49.650365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:49.653109 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 166/344] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:49.654413 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d903c8-be26-49af-b8fa-a584e35b9403 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:49.659834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243f629-9752-48ad-ba3a-27f4ba4db485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:49.660553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243f629-9752-48ad-ba3a-27f4ba4db485 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:49.660832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243f629-9752-48ad-ba3a-27f4ba4db485 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:49.661105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243f629-9752-48ad-ba3a-27f4ba4db485 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:49.661818 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243f629-9752-48ad-ba3a-27f4ba4db485 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:49.662120 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243f629-9752-48ad-ba3a-27f4ba4db485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:49.663491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243f629-9752-48ad-ba3a-27f4ba4db485 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:49.673260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 179/345] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:24:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:49.678230 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243f629-9752-48ad-ba3a-27f4ba4db485 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:49.749667 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:49.772570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d903c8-be26-49af-b8fa-a584e35b9403 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:49.790345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:49.793885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243f629-9752-48ad-ba3a-27f4ba4db485 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:49.815148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bb624-b11f-4673-b239-4562973bfdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:49.816972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bb624-b11f-4673-b239-4562973bfdbc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:49.817477 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bb624-b11f-4673-b239-4562973bfdbc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:49.817920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bb624-b11f-4673-b239-4562973bfdbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:49.834800 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee9cab-42ed-47d0-817e-a072061f548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:49.835520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee9cab-42ed-47d0-817e-a072061f548d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:49.835863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee9cab-42ed-47d0-817e-a072061f548d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:49.836201 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee9cab-42ed-47d0-817e-a072061f548d None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:49.836967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee9cab-42ed-47d0-817e-a072061f548d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:49.837389 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee9cab-42ed-47d0-817e-a072061f548d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:49.838890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee9cab-42ed-47d0-817e-a072061f548d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:49.849658 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 180/346] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:49.850439 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee9cab-42ed-47d0-817e-a072061f548d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:49.900876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bb624-b11f-4673-b239-4562973bfdbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:49.902680 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bb624-b11f-4673-b239-4562973bfdbc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:49.963186 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee9cab-42ed-47d0-817e-a072061f548d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:49.999754 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c4c5a-8d6a-4474-a6be-a5afca26654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:50.000489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c4c5a-8d6a-4474-a6be-a5afca26654b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:50.000829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c4c5a-8d6a-4474-a6be-a5afca26654b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:50.001164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c4c5a-8d6a-4474-a6be-a5afca26654b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:50.008553 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:50.038866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:50.053264 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 167/347] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:50.054446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bb624-b11f-4673-b239-4562973bfdbc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:50.098166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c4c5a-8d6a-4474-a6be-a5afca26654b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:50.099650 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c4c5a-8d6a-4474-a6be-a5afca26654b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:50.166938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bb624-b11f-4673-b239-4562973bfdbc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:50.209600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58add5f-c5f6-4e02-a459-ecf2f8e2c4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:50.209958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 181/348] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:50.210313 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58add5f-c5f6-4e02-a459-ecf2f8e2c4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:50.210596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58add5f-c5f6-4e02-a459-ecf2f8e2c4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:50.210865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58add5f-c5f6-4e02-a459-ecf2f8e2c4b4 None admin] PATH_INFO: `/v3/users/7c10bf16a5be4ccd808e11de7e86cd6a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:50.211221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73332786-bc2a-452f-8ccb-23061012fcfc None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:50.211633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73332786-bc2a-452f-8ccb-23061012fcfc None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:50.211946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73332786-bc2a-452f-8ccb-23061012fcfc None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:50.212047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58add5f-c5f6-4e02-a459-ecf2f8e2c4b4 None admin] RBAC: Authorizing `identity:get_user(user_id=7c10bf16a5be4ccd808e11de7e86cd6a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:50.213522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58add5f-c5f6-4e02-a459-ecf2f8e2c4b4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:50.215492 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 168/349] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:24:50 2022] GET /identity/v3/users/7c10bf16a5be4ccd808e11de7e86cd6a => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:50.216360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58add5f-c5f6-4e02-a459-ecf2f8e2c4b4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:50.217961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 182/350] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:50.218718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73332786-bc2a-452f-8ccb-23061012fcfc None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:50.274226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:50.285650 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:50.328702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73332786-bc2a-452f-8ccb-23061012fcfc None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:50.341909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58add5f-c5f6-4e02-a459-ecf2f8e2c4b4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:50.370635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e98755-3946-466c-aff1-931ac8187ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:50.371270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e98755-3946-466c-aff1-931ac8187ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:50.371618 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e98755-3946-466c-aff1-931ac8187ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:50.371955 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e98755-3946-466c-aff1-931ac8187ef6 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:50.373174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e98755-3946-466c-aff1-931ac8187ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:50.374794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e98755-3946-466c-aff1-931ac8187ef6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:50.376414 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 183/351] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:50 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:50.382306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e98755-3946-466c-aff1-931ac8187ef6 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:50.388723 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbc5c7-bcb6-474d-9cd1-78fcb53ebf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:50.389460 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc5c7-bcb6-474d-9cd1-78fcb53ebf53 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:50.389742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc5c7-bcb6-474d-9cd1-78fcb53ebf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:50.390020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc5c7-bcb6-474d-9cd1-78fcb53ebf53 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:50.391179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbc5c7-bcb6-474d-9cd1-78fcb53ebf53 None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:50.393852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbc5c7-bcb6-474d-9cd1-78fcb53ebf53 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:50.401302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 169/352] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:50 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:50.403772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2c58c-12e2-4dee-9c76-1f688def65e5 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:50.404049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2c58c-12e2-4dee-9c76-1f688def65e5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:50.404315 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2c58c-12e2-4dee-9c76-1f688def65e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:50.426327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f0b2c58c-12e2-4dee-9c76-1f688def65e5 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:50.427565 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f0b2c58c-12e2-4dee-9c76-1f688def65e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:50.507768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 170/353] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:50.508481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2c58c-12e2-4dee-9c76-1f688def65e5 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:50.524671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e98755-3946-466c-aff1-931ac8187ef6 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:50.557573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:50.570788 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a96f76-8f61-4746-8baf-84c3a21daf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:50.571919 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a96f76-8f61-4746-8baf-84c3a21daf68 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:50.572202 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a96f76-8f61-4746-8baf-84c3a21daf68 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:50.572489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a96f76-8f61-4746-8baf-84c3a21daf68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:50.573578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a96f76-8f61-4746-8baf-84c3a21daf68 None admin] RBAC: Adding query filter params (role.id=1d182987dff1438492d3b48c532573c0, user.id=7c10bf16a5be4ccd808e11de7e86cd6a, scope.system=all) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:50.573894 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a96f76-8f61-4746-8baf-84c3a21daf68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:50.577268 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a96f76-8f61-4746-8baf-84c3a21daf68 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:50.590985 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:50.593673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 184/354] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Aug 31 04:24:50 2022] GET /identity/v3/role_assignments?user.id=7c10bf16a5be4ccd808e11de7e86cd6a&scope.system=all&role.id=1d182987dff1438492d3b48c532573c0 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:50.594746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a96f76-8f61-4746-8baf-84c3a21daf68 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:50.697478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2c58c-12e2-4dee-9c76-1f688def65e5 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:50.719980 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a96f76-8f61-4746-8baf-84c3a21daf68 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:50.738077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406f81-a409-4322-bf68-348b6a3c8207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:50.738908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406f81-a409-4322-bf68-348b6a3c8207 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:50.739182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406f81-a409-4322-bf68-348b6a3c8207 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:50.739520 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406f81-a409-4322-bf68-348b6a3c8207 None admin] PATH_INFO: `/v3/groups/889110c984344dc4a14699b61f2310f8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:50.746154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5406f81-a409-4322-bf68-348b6a3c8207 None admin] RBAC: Authorizing `identity:get_group(group_id=889110c984344dc4a14699b61f2310f8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:50.747608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5406f81-a409-4322-bf68-348b6a3c8207 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:50.749396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 171/355] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:24:50 2022] GET /identity/v3/groups/889110c984344dc4a14699b61f2310f8 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:50.755886 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406f81-a409-4322-bf68-348b6a3c8207 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:50.762218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1a4d6-5e53-4ce4-81db-85120355f11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:50.762861 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1a4d6-5e53-4ce4-81db-85120355f11e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:50.763139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1a4d6-5e53-4ce4-81db-85120355f11e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:50.763408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1a4d6-5e53-4ce4-81db-85120355f11e None admin] PATH_INFO: `/v3/groups/889110c984344dc4a14699b61f2310f8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:50.764559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1a4d6-5e53-4ce4-81db-85120355f11e None admin] RBAC: Authorizing `identity:get_group(group_id=889110c984344dc4a14699b61f2310f8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:50.766177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1a4d6-5e53-4ce4-81db-85120355f11e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:50.768135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 185/356] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:24:50 2022] GET /identity/v3/groups/889110c984344dc4a14699b61f2310f8 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:50.776196 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1a4d6-5e53-4ce4-81db-85120355f11e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:50.848485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:50.874973 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406f81-a409-4322-bf68-348b6a3c8207 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:50.882603 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:50.896613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1a4d6-5e53-4ce4-81db-85120355f11e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:50.912623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f149e-2413-40d5-ab41-7a397751df62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:50.913257 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f149e-2413-40d5-ab41-7a397751df62 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:50.913528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f149e-2413-40d5-ab41-7a397751df62 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:50.913798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f149e-2413-40d5-ab41-7a397751df62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:50.914529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f149e-2413-40d5-ab41-7a397751df62 None admin] RBAC: Adding query filter params (group.id=889110c984344dc4a14699b61f2310f8, role.id=0c9ebbeca1134eb4914025ef4cf80f5c, scope.project.id=caf2c8ab542845ae9205702525b855e2) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:50.914833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f149e-2413-40d5-ab41-7a397751df62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:50.916306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f149e-2413-40d5-ab41-7a397751df62 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:50.923342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 172/357] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 31 04:24:50 2022] GET /identity/v3/role_assignments?group.id=889110c984344dc4a14699b61f2310f8&scope.project.id=caf2c8ab542845ae9205702525b855e2&role.id=0c9ebbeca1134eb4914025ef4cf80f5c => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:50.924571 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6d9b2-e2cf-4790-88ce-4c8a8efc6798 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:50.924830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6d9b2-e2cf-4790-88ce-4c8a8efc6798 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:50.925144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6d9b2-e2cf-4790-88ce-4c8a8efc6798 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:50.931150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 173/358] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:50.936424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cd576-1d7c-4b2a-bab3-4e7149180ca6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:50.936788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cd576-1d7c-4b2a-bab3-4e7149180ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:50.937125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cd576-1d7c-4b2a-bab3-4e7149180ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:50.949625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54476bb-3238-4036-97b8-1247f7873762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:50.950166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54476bb-3238-4036-97b8-1247f7873762 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:50.950444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54476bb-3238-4036-97b8-1247f7873762 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:50.950695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54476bb-3238-4036-97b8-1247f7873762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:50.951554 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54476bb-3238-4036-97b8-1247f7873762 None admin] RBAC: Adding query filter params (group.id=889110c984344dc4a14699b61f2310f8, role.id=64f2951b9ce444bcad20c61347224196, scope.project.id=caf2c8ab542845ae9205702525b855e2) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:50.951864 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54476bb-3238-4036-97b8-1247f7873762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:50.953333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54476bb-3238-4036-97b8-1247f7873762 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:50.958276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-038cd576-1d7c-4b2a-bab3-4e7149180ca6 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:50.959547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-038cd576-1d7c-4b2a-bab3-4e7149180ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:50.965463 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 186/359] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 31 04:24:50 2022] GET /identity/v3/role_assignments?group.id=889110c984344dc4a14699b61f2310f8&scope.project.id=caf2c8ab542845ae9205702525b855e2&role.id=64f2951b9ce444bcad20c61347224196 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:51.007488 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54476bb-3238-4036-97b8-1247f7873762 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:51.049038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 174/360] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:51.054018 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e7ee6-a85e-4fdd-8a42-b5276c858b31 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:51.054310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e7ee6-a85e-4fdd-8a42-b5276c858b31 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:51.054565 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e7ee6-a85e-4fdd-8a42-b5276c858b31 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:51.060675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 175/361] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:51.061964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce303892-013d-4e61-adfe-56e71962f4e7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:51.062241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce303892-013d-4e61-adfe-56e71962f4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:51.062508 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce303892-013d-4e61-adfe-56e71962f4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:51.087323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ce303892-013d-4e61-adfe-56e71962f4e7 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:51.088771 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ce303892-013d-4e61-adfe-56e71962f4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:51.151578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54476bb-3238-4036-97b8-1247f7873762 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:51.173883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 176/362] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:51.185781 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:51.207630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bd32b-4fa5-4c4c-aad8-ce31d25c541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:51.208494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bd32b-4fa5-4c4c-aad8-ce31d25c541e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:51.208924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bd32b-4fa5-4c4c-aad8-ce31d25c541e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:51.209384 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bd32b-4fa5-4c4c-aad8-ce31d25c541e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:51.223010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bd32b-4fa5-4c4c-aad8-ce31d25c541e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-259bd32b-4fa5-4c4c-aad8-ce31d25c541e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:51.228431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:51.229573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:51.230557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:51.230557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:51.230557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:51.230557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:51.230557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:51.230557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:51.230557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:51.230557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:51.230557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:51.230557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:51.230557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:51.230557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:51.232831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 187/363] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:24:51.238930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce303892-013d-4e61-adfe-56e71962f4e7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:51.276522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:51.353363 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce303892-013d-4e61-adfe-56e71962f4e7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:51.397438 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f72fd-d840-48bf-9e9b-a572cd3437cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:51.398348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f72fd-d840-48bf-9e9b-a572cd3437cd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:51.398831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f72fd-d840-48bf-9e9b-a572cd3437cd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:51.399281 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f72fd-d840-48bf-9e9b-a572cd3437cd None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:51.400122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f72fd-d840-48bf-9e9b-a572cd3437cd None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:51.400600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f72fd-d840-48bf-9e9b-a572cd3437cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:51.402190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f72fd-d840-48bf-9e9b-a572cd3437cd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:51.414683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 177/364] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:51.420253 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bd32b-4fa5-4c4c-aad8-ce31d25c541e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:51.466222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f72fd-d840-48bf-9e9b-a572cd3437cd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:51.577125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bd32b-4fa5-4c4c-aad8-ce31d25c541e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:51.587197 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:51.598250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f72fd-d840-48bf-9e9b-a572cd3437cd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:51.626122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17357885-f2a2-43de-8266-8c1917137ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:51.628609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357885-f2a2-43de-8266-8c1917137ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:51.628909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357885-f2a2-43de-8266-8c1917137ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:51.629184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357885-f2a2-43de-8266-8c1917137ed7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:51.639108 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf243392-2c46-476b-98d8-46ab384478c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:51.639866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf243392-2c46-476b-98d8-46ab384478c3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:51.640281 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf243392-2c46-476b-98d8-46ab384478c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:51.640690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf243392-2c46-476b-98d8-46ab384478c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:51.654173 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf243392-2c46-476b-98d8-46ab384478c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-bf243392-2c46-476b-98d8-46ab384478c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:51.659452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:51.660920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:51.662008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:51.662008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:51.662008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:51.662008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:51.662008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:51.662008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:51.662008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:51.662008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:51.662008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:51.662008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:51.662008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:51.662008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:51.662008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 178/365] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:24:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:51.662008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf243392-2c46-476b-98d8-46ab384478c3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:51.691215 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:51.712352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17357885-f2a2-43de-8266-8c1917137ed7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:51.714208 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17357885-f2a2-43de-8266-8c1917137ed7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:51.796401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf243392-2c46-476b-98d8-46ab384478c3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:51.840516 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 188/366] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:51.841010 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf283c-fc78-4bae-8a20-551f4b9ff81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:51.841678 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf283c-fc78-4bae-8a20-551f4b9ff81c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:51.841954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf283c-fc78-4bae-8a20-551f4b9ff81c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:51.842228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf283c-fc78-4bae-8a20-551f4b9ff81c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:51.842592 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17357885-f2a2-43de-8266-8c1917137ed7 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:51.854801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf283c-fc78-4bae-8a20-551f4b9ff81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c8cf283c-fc78-4bae-8a20-551f4b9ff81c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:51.860284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:51.861233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:51.862652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:51.862652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:51.862652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:51.862652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:51.862652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:51.862652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:51.862652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:51.862652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:51.862652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:51.862652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:51.862652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:51.862652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:51.865281 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 179/367] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:24:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:51.866302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf283c-fc78-4bae-8a20-551f4b9ff81c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:51.885830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:51.970990 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:51.988584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf283c-fc78-4bae-8a20-551f4b9ff81c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:51.999018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17357885-f2a2-43de-8266-8c1917137ed7 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:52.029888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c26b26-f9fd-48d6-a202-ef00ea2e766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:52.030848 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c26b26-f9fd-48d6-a202-ef00ea2e766d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:52.031324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c26b26-f9fd-48d6-a202-ef00ea2e766d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:52.031831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c26b26-f9fd-48d6-a202-ef00ea2e766d None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:52.033166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c26b26-f9fd-48d6-a202-ef00ea2e766d None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:52.035952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c26b26-f9fd-48d6-a202-ef00ea2e766d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:52.038988 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 180/368] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:51 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:52.045383 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c26b26-f9fd-48d6-a202-ef00ea2e766d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:52.052902 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613094d3-c463-4e21-8a13-1fb84f06d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:52.053355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613094d3-c463-4e21-8a13-1fb84f06d074 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:52.055439 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613094d3-c463-4e21-8a13-1fb84f06d074 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:52.055719 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613094d3-c463-4e21-8a13-1fb84f06d074 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:52.056393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613094d3-c463-4e21-8a13-1fb84f06d074 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:52.056706 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613094d3-c463-4e21-8a13-1fb84f06d074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:52.058182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613094d3-c463-4e21-8a13-1fb84f06d074 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:52.068912 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 189/369] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:24:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:52.069787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613094d3-c463-4e21-8a13-1fb84f06d074 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:52.168849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:52.186393 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c26b26-f9fd-48d6-a202-ef00ea2e766d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:52.199950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613094d3-c463-4e21-8a13-1fb84f06d074 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:52.231796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a572d-cc14-41ef-a583-11eee775cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:52.232418 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a572d-cc14-41ef-a583-11eee775cf8c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:52.232845 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a572d-cc14-41ef-a583-11eee775cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:52.233294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a572d-cc14-41ef-a583-11eee775cf8c None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:52.233975 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a572d-cc14-41ef-a583-11eee775cf8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:52.234296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a572d-cc14-41ef-a583-11eee775cf8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:52.236112 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a572d-cc14-41ef-a583-11eee775cf8c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:52.241412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbbfa0-56a3-46ad-8dda-6efcd68ec9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:52.242755 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbbfa0-56a3-46ad-8dda-6efcd68ec9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:52.243232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbbfa0-56a3-46ad-8dda-6efcd68ec9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:52.243940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbbfa0-56a3-46ad-8dda-6efcd68ec9a7 None admin] PATH_INFO: `/v3/groups/889110c984344dc4a14699b61f2310f8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:52.245326 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbbfa0-56a3-46ad-8dda-6efcd68ec9a7 None admin] RBAC: Authorizing `identity:get_group(group_id=889110c984344dc4a14699b61f2310f8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:52.245881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 181/370] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:52.246793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a572d-cc14-41ef-a583-11eee775cf8c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:52.247585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbbfa0-56a3-46ad-8dda-6efcd68ec9a7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:52.249534 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 190/371] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:24:52 2022] GET /identity/v3/groups/889110c984344dc4a14699b61f2310f8 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:52.254166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbbfa0-56a3-46ad-8dda-6efcd68ec9a7 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:52.268181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:52.384000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a572d-cc14-41ef-a583-11eee775cf8c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:52.387475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbbfa0-56a3-46ad-8dda-6efcd68ec9a7 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:52.432295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5e4f5-0c05-4b4e-85fa-a0b9cff0af07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:52.432916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e4f5-0c05-4b4e-85fa-a0b9cff0af07 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:52.433191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e4f5-0c05-4b4e-85fa-a0b9cff0af07 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:52.433486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e4f5-0c05-4b4e-85fa-a0b9cff0af07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:52.436601 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b429a-9c09-44b9-bd73-9419e081fca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:52.438172 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b429a-9c09-44b9-bd73-9419e081fca1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:52.438457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b429a-9c09-44b9-bd73-9419e081fca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:52.438732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b429a-9c09-44b9-bd73-9419e081fca1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:52.456604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:52.515056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5e4f5-0c05-4b4e-85fa-a0b9cff0af07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:52.516580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5e4f5-0c05-4b4e-85fa-a0b9cff0af07 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:52.527718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:52.530004 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b429a-9c09-44b9-bd73-9419e081fca1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:52.532054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b429a-9c09-44b9-bd73-9419e081fca1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:52.658016 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 182/373] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:52.658595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 191/373] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:52.659253 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5e4f5-0c05-4b4e-85fa-a0b9cff0af07 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:52.668435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b429a-9c09-44b9-bd73-9419e081fca1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:52.721254 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:52.793078 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5e4f5-0c05-4b4e-85fa-a0b9cff0af07 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:52.795848 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b429a-9c09-44b9-bd73-9419e081fca1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:52.805867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:52.838509 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a146-660d-4186-b73f-2132cf7b255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:52.839506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4574b0-9df9-4a1b-904a-2d0fddd0d64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:52.839761 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a146-660d-4186-b73f-2132cf7b255a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:52.840247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a146-660d-4186-b73f-2132cf7b255a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:52.840348 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4574b0-9df9-4a1b-904a-2d0fddd0d64e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:52.840611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4574b0-9df9-4a1b-904a-2d0fddd0d64e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:52.840947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4574b0-9df9-4a1b-904a-2d0fddd0d64e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:52.841070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a146-660d-4186-b73f-2132cf7b255a None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:52.841773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4574b0-9df9-4a1b-904a-2d0fddd0d64e None admin] RBAC: Adding query filter params (group.id=889110c984344dc4a14699b61f2310f8, role.id=64f2951b9ce444bcad20c61347224196, scope.project.id=5d510566458c49848cdbe57fbe030354) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:52.842139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4574b0-9df9-4a1b-904a-2d0fddd0d64e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:52.842731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3a146-660d-4186-b73f-2132cf7b255a None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:52.843709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4574b0-9df9-4a1b-904a-2d0fddd0d64e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:52.844537 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3a146-660d-4186-b73f-2132cf7b255a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:52.847682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 183/374] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:52 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:52.848654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a146-660d-4186-b73f-2132cf7b255a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:52.850486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 192/375] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 31 04:24:52 2022] GET /identity/v3/role_assignments?group.id=889110c984344dc4a14699b61f2310f8&scope.project.id=5d510566458c49848cdbe57fbe030354&role.id=64f2951b9ce444bcad20c61347224196 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:52.857291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4574b0-9df9-4a1b-904a-2d0fddd0d64e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:52.978870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4574b0-9df9-4a1b-904a-2d0fddd0d64e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:53.022867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d28771-662a-44b2-9b53-68fe7770b2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:53.024070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d28771-662a-44b2-9b53-68fe7770b2cc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:53.024466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d28771-662a-44b2-9b53-68fe7770b2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:53.024834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d28771-662a-44b2-9b53-68fe7770b2cc None admin] PATH_INFO: `/v3/groups/889110c984344dc4a14699b61f2310f8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:53.026405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d28771-662a-44b2-9b53-68fe7770b2cc None admin] RBAC: Authorizing `identity:get_group(group_id=889110c984344dc4a14699b61f2310f8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:53.028315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d28771-662a-44b2-9b53-68fe7770b2cc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:53.031287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 193/376] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:24:52 2022] GET /identity/v3/groups/889110c984344dc4a14699b61f2310f8 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:53.040143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d28771-662a-44b2-9b53-68fe7770b2cc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:53.064547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a146-660d-4186-b73f-2132cf7b255a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:53.083375 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:53.098011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:53.115579 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac52c3-d76d-4b5f-a8c2-53b42d26e48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:53.116550 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac52c3-d76d-4b5f-a8c2-53b42d26e48c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:53.116996 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac52c3-d76d-4b5f-a8c2-53b42d26e48c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:53.117504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac52c3-d76d-4b5f-a8c2-53b42d26e48c None admin] PATH_INFO: `/v3/projects/c036297280a949b589ef447a76452691` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:53.122103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac52c3-d76d-4b5f-a8c2-53b42d26e48c None admin] RBAC: Authorizing `identity:get_project(project_id=c036297280a949b589ef447a76452691)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:53.123912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac52c3-d76d-4b5f-a8c2-53b42d26e48c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:53.126135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 184/377] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:52 2022] GET /identity/v3/projects/c036297280a949b589ef447a76452691 => generated 344 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:53.133882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac52c3-d76d-4b5f-a8c2-53b42d26e48c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:53.171091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d28771-662a-44b2-9b53-68fe7770b2cc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:53.220575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766ce62-85e7-434a-aa93-cac6fb417a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:53.221180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766ce62-85e7-434a-aa93-cac6fb417a7b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:53.221521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766ce62-85e7-434a-aa93-cac6fb417a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:53.221790 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766ce62-85e7-434a-aa93-cac6fb417a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:53.222591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766ce62-85e7-434a-aa93-cac6fb417a7b None admin] RBAC: Adding query filter params (group.id=889110c984344dc4a14699b61f2310f8, role.id=0c9ebbeca1134eb4914025ef4cf80f5c, scope.project.id=5d510566458c49848cdbe57fbe030354) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:53.223015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766ce62-85e7-434a-aa93-cac6fb417a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:53.224521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766ce62-85e7-434a-aa93-cac6fb417a7b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:53.235092 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 194/378] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 31 04:24:53 2022] GET /identity/v3/role_assignments?group.id=889110c984344dc4a14699b61f2310f8&scope.project.id=5d510566458c49848cdbe57fbe030354&role.id=0c9ebbeca1134eb4914025ef4cf80f5c => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:53.300233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac52c3-d76d-4b5f-a8c2-53b42d26e48c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:53.349134 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae1e45-7b2b-476b-a974-c19c7435a1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:53.349812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae1e45-7b2b-476b-a974-c19c7435a1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:53.350093 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae1e45-7b2b-476b-a974-c19c7435a1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:53.350361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae1e45-7b2b-476b-a974-c19c7435a1a9 None admin] PATH_INFO: `/v3/groups/0637f88a19b64f8da7af70432ff0a159` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:53.359019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae1e45-7b2b-476b-a974-c19c7435a1a9 None admin] RBAC: Authorizing `identity:get_group(group_id=0637f88a19b64f8da7af70432ff0a159)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:53.360523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae1e45-7b2b-476b-a974-c19c7435a1a9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:53.363023 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 185/379] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:24:53 2022] GET /identity/v3/groups/0637f88a19b64f8da7af70432ff0a159 => generated 229 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:53.369241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766ce62-85e7-434a-aa93-cac6fb417a7b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:53.460989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8760515-3745-4a99-925a-ce98bf2f54bb None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:53.461319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8760515-3745-4a99-925a-ce98bf2f54bb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:53.461616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8760515-3745-4a99-925a-ce98bf2f54bb None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:53.464200 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 186/380] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:24:53.468278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415824a-e7f8-4a6b-a2eb-b9d4e11fda3d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:53.468563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415824a-e7f8-4a6b-a2eb-b9d4e11fda3d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:53.468835 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415824a-e7f8-4a6b-a2eb-b9d4e11fda3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:53.497817 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f415824a-e7f8-4a6b-a2eb-b9d4e11fda3d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:53.498970 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f415824a-e7f8-4a6b-a2eb-b9d4e11fda3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:53.521664 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766ce62-85e7-434a-aa93-cac6fb417a7b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:53.525328 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:53.562328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:53.573919 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de9002-b19f-4b56-b752-ce5c0d84f32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:53.574907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de9002-b19f-4b56-b752-ce5c0d84f32f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:53.575378 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de9002-b19f-4b56-b752-ce5c0d84f32f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:53.575850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de9002-b19f-4b56-b752-ce5c0d84f32f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:53.576677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de9002-b19f-4b56-b752-ce5c0d84f32f None admin] RBAC: Adding query filter params (group.id=0637f88a19b64f8da7af70432ff0a159, role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=c036297280a949b589ef447a76452691) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:53.577125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de9002-b19f-4b56-b752-ce5c0d84f32f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:53.582541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de9002-b19f-4b56-b752-ce5c0d84f32f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:53.585125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 195/381] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 31 04:24:53 2022] GET /identity/v3/role_assignments?group.id=0637f88a19b64f8da7af70432ff0a159&scope.project.id=c036297280a949b589ef447a76452691&role.id=1896db68dc754d5293037ab100ce46d9 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:53.588418 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65b7de-2985-44fc-8bed-a6fbfd2787e7 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:53.588689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65b7de-2985-44fc-8bed-a6fbfd2787e7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:53.588985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65b7de-2985-44fc-8bed-a6fbfd2787e7 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:53.590567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 196/382] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:53.596221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b55e0-f93d-4b0a-b667-cdcac669097d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:53.597047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b55e0-f93d-4b0a-b667-cdcac669097d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:53.597333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b55e0-f93d-4b0a-b667-cdcac669097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:53.613333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 187/383] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:53.618498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2a2b55e0-f93d-4b0a-b667-cdcac669097d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:53.619761 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2a2b55e0-f93d-4b0a-b667-cdcac669097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:53.698252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 197/384] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:53.941627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415824a-e7f8-4a6b-a2eb-b9d4e11fda3d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:54.045507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b55e0-f93d-4b0a-b667-cdcac669097d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:54.075038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415824a-e7f8-4a6b-a2eb-b9d4e11fda3d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:54.141567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7ac19-89c0-432e-a512-3a2b5e081604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:54.142735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ac19-89c0-432e-a512-3a2b5e081604 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:54.146397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ac19-89c0-432e-a512-3a2b5e081604 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:54.146929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ac19-89c0-432e-a512-3a2b5e081604 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:54.166277 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7ac19-89c0-432e-a512-3a2b5e081604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-89c7ac19-89c0-432e-a512-3a2b5e081604 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:54.172822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:54.173749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:54.174612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:54.174612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:54.174612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:54.174612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:54.174612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:54.174612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:54.174612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:54.174612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:54.174612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:54.174612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:54.174612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:54.174612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:54.186274 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 188/385] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:54.208095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7ac19-89c0-432e-a512-3a2b5e081604 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:54.241992 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:54.248037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b55e0-f93d-4b0a-b667-cdcac669097d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:54.266345 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:54.318668 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33929974-9731-4270-b8b1-823b23ab36cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:54.319306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929974-9731-4270-b8b1-823b23ab36cb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:54.319793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929974-9731-4270-b8b1-823b23ab36cb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:54.319910 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33929974-9731-4270-b8b1-823b23ab36cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:54.332919 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33929974-9731-4270-b8b1-823b23ab36cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-33929974-9731-4270-b8b1-823b23ab36cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:54.338251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:54.339153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:54.339935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:54.339935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:54.339935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:54.339935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:54.339935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:54.339935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:54.339935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:54.339935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:54.339935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:54.339935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:54.339935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:54.339935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:54.342617 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 198/386] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:24:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:54.349371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33929974-9731-4270-b8b1-823b23ab36cb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:54.375755 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7ac19-89c0-432e-a512-3a2b5e081604 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:54.425745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a1724-239b-4fac-8da4-24f318438a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:54.426512 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a1724-239b-4fac-8da4-24f318438a5e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:54.427148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a1724-239b-4fac-8da4-24f318438a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:54.427518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a1724-239b-4fac-8da4-24f318438a5e None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:54.428702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a1724-239b-4fac-8da4-24f318438a5e None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:54.429390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a1724-239b-4fac-8da4-24f318438a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:54.430866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a1724-239b-4fac-8da4-24f318438a5e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:54.448525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 189/387] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:54.456608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a1724-239b-4fac-8da4-24f318438a5e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:54.473237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33929974-9731-4270-b8b1-823b23ab36cb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:54.519623 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8fc6f-d169-4c88-af08-c2f32c88677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:54.520241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8fc6f-d169-4c88-af08-c2f32c88677b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:54.520517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8fc6f-d169-4c88-af08-c2f32c88677b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:54.521050 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8fc6f-d169-4c88-af08-c2f32c88677b None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:54.522256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8fc6f-d169-4c88-af08-c2f32c88677b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:54.522571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8fc6f-d169-4c88-af08-c2f32c88677b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:54.524471 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8fc6f-d169-4c88-af08-c2f32c88677b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:54.540914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 199/388] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:24:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:54.542430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8fc6f-d169-4c88-af08-c2f32c88677b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:54.572479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:54.593057 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:54.601678 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a1724-239b-4fac-8da4-24f318438a5e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:54.646933 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358182e-a5f7-4c18-9427-f22eaa33f249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:54.647979 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358182e-a5f7-4c18-9427-f22eaa33f249 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:54.648413 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358182e-a5f7-4c18-9427-f22eaa33f249 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:54.648823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358182e-a5f7-4c18-9427-f22eaa33f249 None admin] PATH_INFO: `/v3/groups/889110c984344dc4a14699b61f2310f8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:54.650693 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358182e-a5f7-4c18-9427-f22eaa33f249 None admin] RBAC: Authorizing `identity:get_group(group_id=889110c984344dc4a14699b61f2310f8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:54.652336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358182e-a5f7-4c18-9427-f22eaa33f249 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:54.654501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 190/389] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:24:54 2022] GET /identity/v3/groups/889110c984344dc4a14699b61f2310f8 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:54.666547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358182e-a5f7-4c18-9427-f22eaa33f249 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:54.682466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8fc6f-d169-4c88-af08-c2f32c88677b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:54.724955 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d428d3-2b2a-4827-a035-13e11e77106a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:54.725587 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d428d3-2b2a-4827-a035-13e11e77106a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:54.725795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d428d3-2b2a-4827-a035-13e11e77106a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:54.726068 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d428d3-2b2a-4827-a035-13e11e77106a None admin] PATH_INFO: `/v3/groups/889110c984344dc4a14699b61f2310f8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:54.727205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d428d3-2b2a-4827-a035-13e11e77106a None admin] RBAC: Authorizing `identity:get_group(group_id=889110c984344dc4a14699b61f2310f8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:54.728747 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d428d3-2b2a-4827-a035-13e11e77106a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:54.733218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 200/390] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:24:54 2022] GET /identity/v3/groups/889110c984344dc4a14699b61f2310f8 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:54.737583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d428d3-2b2a-4827-a035-13e11e77106a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:54.847454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358182e-a5f7-4c18-9427-f22eaa33f249 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:54.863384 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:54.876889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d428d3-2b2a-4827-a035-13e11e77106a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:54.916074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f00ca-1d21-4251-b7f2-6bab58641211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:54.917095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f00ca-1d21-4251-b7f2-6bab58641211 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:54.917537 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f00ca-1d21-4251-b7f2-6bab58641211 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:54.917942 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f00ca-1d21-4251-b7f2-6bab58641211 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:54.921266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f00ca-1d21-4251-b7f2-6bab58641211 None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:54.922606 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7ac42-a9d2-4a40-b187-ec73462f762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:54.923249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ac42-a9d2-4a40-b187-ec73462f762e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:54.923528 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ac42-a9d2-4a40-b187-ec73462f762e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:54.923628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f00ca-1d21-4251-b7f2-6bab58641211 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:54.923796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ac42-a9d2-4a40-b187-ec73462f762e None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:54.925911 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7ac42-a9d2-4a40-b187-ec73462f762e None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:54.926604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 191/391] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:54 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:54.927415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7ac42-a9d2-4a40-b187-ec73462f762e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:54.929143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 201/392] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:54 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:54.934896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f00ca-1d21-4251-b7f2-6bab58641211 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:54.936978 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7ac42-a9d2-4a40-b187-ec73462f762e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:55.010950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:55.119287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7ac42-a9d2-4a40-b187-ec73462f762e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:55.152593 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f00ca-1d21-4251-b7f2-6bab58641211 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:55.189929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0815b-7d2b-44be-923a-0bd500005095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:55.191402 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0815b-7d2b-44be-923a-0bd500005095 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:55.191737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0815b-7d2b-44be-923a-0bd500005095 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:55.192739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0815b-7d2b-44be-923a-0bd500005095 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2/groups/889110c984344dc4a14699b61f2310f8/roles/0c9ebbeca1134eb4914025ef4cf80f5c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:55.199264 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0815b-7d2b-44be-923a-0bd500005095 None admin] RBAC: Authorizing `identity:create_grant(project_id=caf2c8ab542845ae9205702525b855e2, group_id=889110c984344dc4a14699b61f2310f8, role_id=0c9ebbeca1134eb4914025ef4cf80f5c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:55.204025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0815b-7d2b-44be-923a-0bd500005095 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:55.216310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125b2ba-4c3f-409a-b735-f78ea9900c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:55.217409 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125b2ba-4c3f-409a-b735-f78ea9900c62 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:55.217885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125b2ba-4c3f-409a-b735-f78ea9900c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:55.218347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125b2ba-4c3f-409a-b735-f78ea9900c62 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2/groups/889110c984344dc4a14699b61f2310f8/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:55.220735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125b2ba-4c3f-409a-b735-f78ea9900c62 None admin] RBAC: Authorizing `identity:create_grant(project_id=caf2c8ab542845ae9205702525b855e2, group_id=889110c984344dc4a14699b61f2310f8, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:55.223177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125b2ba-4c3f-409a-b735-f78ea9900c62 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:55.309147 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 202/393] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 31 04:24:54 2022] PUT /identity/v3/projects/caf2c8ab542845ae9205702525b855e2/groups/889110c984344dc4a14699b61f2310f8/roles/0c9ebbeca1134eb4914025ef4cf80f5c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:24:55.324071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 192/394] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 31 04:24:54 2022] PUT /identity/v3/projects/caf2c8ab542845ae9205702525b855e2/groups/889110c984344dc4a14699b61f2310f8/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:24:55.492848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f49f49-f58b-4ce5-81b9-9d6c25d9e83d None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:55.493127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f49f49-f58b-4ce5-81b9-9d6c25d9e83d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:55.493436 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f49f49-f58b-4ce5-81b9-9d6c25d9e83d None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:55.495118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 203/395] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:55.500737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa55c6-fa0f-46ef-80f3-6a0830a70117 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:55.501014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa55c6-fa0f-46ef-80f3-6a0830a70117 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:55.501300 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa55c6-fa0f-46ef-80f3-6a0830a70117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:55.523668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-44fa55c6-fa0f-46ef-80f3-6a0830a70117 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:55.524864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-44fa55c6-fa0f-46ef-80f3-6a0830a70117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:55.608855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 193/396] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:55.812001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393901b5-7725-4304-b07c-64f7af9f421d None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:55.812522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393901b5-7725-4304-b07c-64f7af9f421d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:55.812522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393901b5-7725-4304-b07c-64f7af9f421d None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:55.814156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 204/397] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:55.819883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48adf3-2736-4a7c-a20c-94dd7587ee09 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:55.820172 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48adf3-2736-4a7c-a20c-94dd7587ee09 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:55.820449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48adf3-2736-4a7c-a20c-94dd7587ee09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:55.845880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6b48adf3-2736-4a7c-a20c-94dd7587ee09 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:55.847732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6b48adf3-2736-4a7c-a20c-94dd7587ee09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:55.868184 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:55.930378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 194/398] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:55.995535 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393901b5-7725-4304-b07c-64f7af9f421d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:56.015363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:56.130694 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393901b5-7725-4304-b07c-64f7af9f421d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:56.174067 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e64f5-5492-421f-8947-57814d94f8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:56.175424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e64f5-5492-421f-8947-57814d94f8fb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:56.175717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e64f5-5492-421f-8947-57814d94f8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:56.175945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e64f5-5492-421f-8947-57814d94f8fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:56.186898 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e64f5-5492-421f-8947-57814d94f8fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:56.190583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb41dcd-9553-4966-a215-7bbe0c714774 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:56.191182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb41dcd-9553-4966-a215-7bbe0c714774 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:56.191182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb41dcd-9553-4966-a215-7bbe0c714774 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-528e64f5-5492-421f-8947-57814d94f8fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:56.192148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:56.193022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:56.193878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:56.193878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:56.193878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:56.193878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:56.193878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:56.193878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:56.193878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:56.193878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:56.193878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:56.193878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:56.193878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:56.193878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:56.194485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 195/399] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:24:56.194552 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 205/400] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:24:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:56.200099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb41dcd-9553-4966-a215-7bbe0c714774 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:56.204102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce261a1b-68de-4c3a-93ca-73755f23bfe3 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:56.204380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce261a1b-68de-4c3a-93ca-73755f23bfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:56.204649 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce261a1b-68de-4c3a-93ca-73755f23bfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:56.242188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ce261a1b-68de-4c3a-93ca-73755f23bfe3 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:56.243619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ce261a1b-68de-4c3a-93ca-73755f23bfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:56.370029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb41dcd-9553-4966-a215-7bbe0c714774 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:56.372374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 206/401] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:56.373521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce261a1b-68de-4c3a-93ca-73755f23bfe3 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:56.394164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:56.443369 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acda01-6480-4fa1-908c-1a975348525a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:56.443986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acda01-6480-4fa1-908c-1a975348525a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:56.444265 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acda01-6480-4fa1-908c-1a975348525a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:56.444533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acda01-6480-4fa1-908c-1a975348525a None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:56.445235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acda01-6480-4fa1-908c-1a975348525a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:56.445570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acda01-6480-4fa1-908c-1a975348525a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:56.450242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acda01-6480-4fa1-908c-1a975348525a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:56.469623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 196/402] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:24:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:56.475118 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acda01-6480-4fa1-908c-1a975348525a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:56.498625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:56.579543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce261a1b-68de-4c3a-93ca-73755f23bfe3 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:56.650496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376c0bb-ac4f-4377-85e1-b06b5d18d863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:56.651577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376c0bb-ac4f-4377-85e1-b06b5d18d863 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:56.653943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376c0bb-ac4f-4377-85e1-b06b5d18d863 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:56.654434 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376c0bb-ac4f-4377-85e1-b06b5d18d863 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:56.665249 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acda01-6480-4fa1-908c-1a975348525a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:56.682305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376c0bb-ac4f-4377-85e1-b06b5d18d863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-7376c0bb-ac4f-4377-85e1-b06b5d18d863 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:56.687778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:56.688674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:56.692505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:56.692505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:56.692505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:56.692505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:56.692505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:56.692505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:56.692505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:56.692505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:56.692505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:56.692505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:56.692505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:56.692505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:56.694654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 207/403] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:56.695851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376c0bb-ac4f-4377-85e1-b06b5d18d863 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:56.710428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ede58-069a-4d24-a17d-e06a59ea9b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:56.711081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ede58-069a-4d24-a17d-e06a59ea9b9d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:56.711473 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ede58-069a-4d24-a17d-e06a59ea9b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:56.711750 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ede58-069a-4d24-a17d-e06a59ea9b9d None admin] PATH_INFO: `/v3/groups/889110c984344dc4a14699b61f2310f8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:56.713066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ede58-069a-4d24-a17d-e06a59ea9b9d None admin] RBAC: Authorizing `identity:get_group(group_id=889110c984344dc4a14699b61f2310f8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:56.714516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ede58-069a-4d24-a17d-e06a59ea9b9d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:56.716270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 197/404] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:24:56 2022] GET /identity/v3/groups/889110c984344dc4a14699b61f2310f8 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:56.718762 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ede58-069a-4d24-a17d-e06a59ea9b9d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:56.788490 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:56.831574 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:56.835590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376c0bb-ac4f-4377-85e1-b06b5d18d863 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:56.854359 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ede58-069a-4d24-a17d-e06a59ea9b9d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:56.884568 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a863105-92a3-49d8-810b-1e5a1d33ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:56.885380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a863105-92a3-49d8-810b-1e5a1d33ae12 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:56.885866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a863105-92a3-49d8-810b-1e5a1d33ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:56.886213 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a863105-92a3-49d8-810b-1e5a1d33ae12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:56.891030 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef98f1-c542-481e-bc76-acebbecf5746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:56.891709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef98f1-c542-481e-bc76-acebbecf5746 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:56.891989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef98f1-c542-481e-bc76-acebbecf5746 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:56.892259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef98f1-c542-481e-bc76-acebbecf5746 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:56.892919 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef98f1-c542-481e-bc76-acebbecf5746 None admin] RBAC: Adding query filter params (name=member) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:56.894451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef98f1-c542-481e-bc76-acebbecf5746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:56.896332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef98f1-c542-481e-bc76-acebbecf5746 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:56.900609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a863105-92a3-49d8-810b-1e5a1d33ae12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-3a863105-92a3-49d8-810b-1e5a1d33ae12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:56.907168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:56.908163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:56.909655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:56.909655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:56.909655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:56.909655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:56.909655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:56.909655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:56.909655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:56.909655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:56.909655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:56.909655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:56.909655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:24:56.909655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:56.910266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 198/405] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:56.910338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 208/406] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:24:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:56.910403 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef98f1-c542-481e-bc76-acebbecf5746 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:56.915581 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a863105-92a3-49d8-810b-1e5a1d33ae12 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:57.029894 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef98f1-c542-481e-bc76-acebbecf5746 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:57.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a863105-92a3-49d8-810b-1e5a1d33ae12 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:57.067586 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:57.074280 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6b0d2-cd4e-43cb-898c-fc2422d7fb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:57.074928 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6b0d2-cd4e-43cb-898c-fc2422d7fb2f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:57.075211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6b0d2-cd4e-43cb-898c-fc2422d7fb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:57.075489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6b0d2-cd4e-43cb-898c-fc2422d7fb2f None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:57.076740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6b0d2-cd4e-43cb-898c-fc2422d7fb2f None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:57.078247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0b5aa-cfbb-4824-8352-40d7b53d9e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:57.078383 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6b0d2-cd4e-43cb-898c-fc2422d7fb2f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:57.079151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0b5aa-cfbb-4824-8352-40d7b53d9e52 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:57.079585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0b5aa-cfbb-4824-8352-40d7b53d9e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:57.080065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0b5aa-cfbb-4824-8352-40d7b53d9e52 None admin] PATH_INFO: `/v3/groups/889110c984344dc4a14699b61f2310f8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:57.080236 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 199/407] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:56 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:57.081570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6b0d2-cd4e-43cb-898c-fc2422d7fb2f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:57.082439 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0b5aa-cfbb-4824-8352-40d7b53d9e52 None admin] RBAC: Authorizing `identity:get_group(group_id=889110c984344dc4a14699b61f2310f8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:57.084108 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0b5aa-cfbb-4824-8352-40d7b53d9e52 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:57.086190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 209/408] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:24:56 2022] GET /identity/v3/groups/889110c984344dc4a14699b61f2310f8 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:57.103837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0b5aa-cfbb-4824-8352-40d7b53d9e52 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:57.105009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:57.205082 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6b0d2-cd4e-43cb-898c-fc2422d7fb2f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:57.217427 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0b5aa-cfbb-4824-8352-40d7b53d9e52 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:57.249020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fa61a-ddb2-4cea-bbd5-be4a2288df99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:57.249824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fa61a-ddb2-4cea-bbd5-be4a2288df99 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:57.250207 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fa61a-ddb2-4cea-bbd5-be4a2288df99 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:57.250575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fa61a-ddb2-4cea-bbd5-be4a2288df99 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:57.251510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fa61a-ddb2-4cea-bbd5-be4a2288df99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:57.251728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fa61a-ddb2-4cea-bbd5-be4a2288df99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:57.253790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fa61a-ddb2-4cea-bbd5-be4a2288df99 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:57.263108 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc2755-4d4c-401e-94af-8f6b2b36b3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:57.264573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc2755-4d4c-401e-94af-8f6b2b36b3e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:57.265227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc2755-4d4c-401e-94af-8f6b2b36b3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:57.265824 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc2755-4d4c-401e-94af-8f6b2b36b3e9 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354/groups/889110c984344dc4a14699b61f2310f8/roles/0c9ebbeca1134eb4914025ef4cf80f5c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:57.267787 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 200/409] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:57.268855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fa61a-ddb2-4cea-bbd5-be4a2288df99 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:57.269114 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc2755-4d4c-401e-94af-8f6b2b36b3e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d510566458c49848cdbe57fbe030354, group_id=889110c984344dc4a14699b61f2310f8, role_id=0c9ebbeca1134eb4914025ef4cf80f5c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:57.271000 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc2755-4d4c-401e-94af-8f6b2b36b3e9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:57.345329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:57.377239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 210/410] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 31 04:24:57 2022] PUT /identity/v3/projects/5d510566458c49848cdbe57fbe030354/groups/889110c984344dc4a14699b61f2310f8/roles/0c9ebbeca1134eb4914025ef4cf80f5c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:24:57.377239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc2755-4d4c-401e-94af-8f6b2b36b3e9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:57.388355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fa61a-ddb2-4cea-bbd5-be4a2288df99 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:57.458684 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b22b77-5af2-4c5f-902d-d55e514b6e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:57.459254 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b22b77-5af2-4c5f-902d-d55e514b6e61 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:57.459531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b22b77-5af2-4c5f-902d-d55e514b6e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:57.459807 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b22b77-5af2-4c5f-902d-d55e514b6e61 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:57.465609 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b22b77-5af2-4c5f-902d-d55e514b6e61 None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:57.467112 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b22b77-5af2-4c5f-902d-d55e514b6e61 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:57.471987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 201/411] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:57 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:57.483110 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b22b77-5af2-4c5f-902d-d55e514b6e61 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:57.491693 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:57.583217 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc2755-4d4c-401e-94af-8f6b2b36b3e9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:57.623153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72453f9-cada-40b1-96c5-618de93db86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:57.624233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72453f9-cada-40b1-96c5-618de93db86d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:57.624715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72453f9-cada-40b1-96c5-618de93db86d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:57.625188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72453f9-cada-40b1-96c5-618de93db86d None admin] PATH_INFO: `/v3/groups/0637f88a19b64f8da7af70432ff0a159` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:57.626709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72453f9-cada-40b1-96c5-618de93db86d None admin] RBAC: Authorizing `identity:get_group(group_id=0637f88a19b64f8da7af70432ff0a159)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:57.628596 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72453f9-cada-40b1-96c5-618de93db86d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:57.630668 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 211/412] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:24:57 2022] GET /identity/v3/groups/0637f88a19b64f8da7af70432ff0a159 => generated 229 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:57.637393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72453f9-cada-40b1-96c5-618de93db86d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:57.643885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b22b77-5af2-4c5f-902d-d55e514b6e61 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:57.687435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddd27b-65ef-4ef2-979b-c45944beca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:57.688825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddd27b-65ef-4ef2-979b-c45944beca08 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:57.689322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddd27b-65ef-4ef2-979b-c45944beca08 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:57.689781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddd27b-65ef-4ef2-979b-c45944beca08 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354/groups/889110c984344dc4a14699b61f2310f8/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:57.692955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddd27b-65ef-4ef2-979b-c45944beca08 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d510566458c49848cdbe57fbe030354, group_id=889110c984344dc4a14699b61f2310f8, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:57.694869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddd27b-65ef-4ef2-979b-c45944beca08 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:57.758392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72453f9-cada-40b1-96c5-618de93db86d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:57.775465 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:57.781677 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 202/413] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 31 04:24:57 2022] PUT /identity/v3/projects/5d510566458c49848cdbe57fbe030354/groups/889110c984344dc4a14699b61f2310f8/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:24:57.782969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7a2e7-e96c-4233-8a11-ff5d5ad94b1f None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:57.783255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7a2e7-e96c-4233-8a11-ff5d5ad94b1f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:57.783533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7a2e7-e96c-4233-8a11-ff5d5ad94b1f None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:57.785780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 203/414] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:57.792241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d12f4d-e68d-44e4-a93c-6c730e845178 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:57.792574 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d12f4d-e68d-44e4-a93c-6c730e845178 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:57.794255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d12f4d-e68d-44e4-a93c-6c730e845178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:57.802666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:57.823112 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a8d12f4d-e68d-44e4-a93c-6c730e845178 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:57.825312 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a8d12f4d-e68d-44e4-a93c-6c730e845178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:57.828056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2cb3c-4620-45b9-9c9b-76d3e7485c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:57.828995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2cb3c-4620-45b9-9c9b-76d3e7485c21 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:57.829325 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2cb3c-4620-45b9-9c9b-76d3e7485c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:57.829601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2cb3c-4620-45b9-9c9b-76d3e7485c21 None admin] PATH_INFO: `/v3/projects/c036297280a949b589ef447a76452691` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:57.832483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2cb3c-4620-45b9-9c9b-76d3e7485c21 None admin] RBAC: Authorizing `identity:get_project(project_id=c036297280a949b589ef447a76452691)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:57.834227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2cb3c-4620-45b9-9c9b-76d3e7485c21 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:57.836373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 212/415] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:57 2022] GET /identity/v3/projects/c036297280a949b589ef447a76452691 => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:57.837730 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36f63a-ae73-4d4b-878c-92df0feb6df9 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:57.838013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36f63a-ae73-4d4b-878c-92df0feb6df9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:57.838290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36f63a-ae73-4d4b-878c-92df0feb6df9 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:57.841356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 213/416] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:57.848474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36f63a-ae73-4d4b-878c-92df0feb6df9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:57.919657 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 204/417] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:24:57.920964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1cadc-8b3c-4825-ac04-39927022f964 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:57.930904 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1cadc-8b3c-4825-ac04-39927022f964 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:57.931254 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1cadc-8b3c-4825-ac04-39927022f964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:57.957728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e8f1cadc-8b3c-4825-ac04-39927022f964 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:57.959285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e8f1cadc-8b3c-4825-ac04-39927022f964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:57.992594 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36f63a-ae73-4d4b-878c-92df0feb6df9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:58.036231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 205/418] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:58.048668 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5e8c-e4fa-4d2d-a0d3-aa0d53171bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:58.054892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5e8c-e4fa-4d2d-a0d3-aa0d53171bf2 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:58.055381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5e8c-e4fa-4d2d-a0d3-aa0d53171bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:58.055851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5e8c-e4fa-4d2d-a0d3-aa0d53171bf2 None admin] PATH_INFO: `/v3/projects/c036297280a949b589ef447a76452691/groups/0637f88a19b64f8da7af70432ff0a159/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:58.066418 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f5e8c-e4fa-4d2d-a0d3-aa0d53171bf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c036297280a949b589ef447a76452691, group_id=0637f88a19b64f8da7af70432ff0a159, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:58.068127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f5e8c-e4fa-4d2d-a0d3-aa0d53171bf2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:58.189454 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 214/419] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 31 04:24:57 2022] PUT /identity/v3/projects/c036297280a949b589ef447a76452691/groups/0637f88a19b64f8da7af70432ff0a159/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:24:58.275642 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1cadc-8b3c-4825-ac04-39927022f964 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:58.361649 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:58.377668 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5e8c-e4fa-4d2d-a0d3-aa0d53171bf2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:58.414034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1cadc-8b3c-4825-ac04-39927022f964 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:58.441828 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:58.458554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97348b1-1e14-4500-af64-1b2a459d082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:58.459234 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97348b1-1e14-4500-af64-1b2a459d082a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:58.459583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97348b1-1e14-4500-af64-1b2a459d082a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:58.459783 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97348b1-1e14-4500-af64-1b2a459d082a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:58.494194 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97348b1-1e14-4500-af64-1b2a459d082a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:58.499698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5e8c-e4fa-4d2d-a0d3-aa0d53171bf2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-d97348b1-1e14-4500-af64-1b2a459d082a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:58.499827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:58.500751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:58.501611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:58.501611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:58.501611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:58.501611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:58.501611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:58.501611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:58.501611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:58.501611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:58.501611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:58.501611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:58.501611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:24:58.501611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:24:58.502226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 206/420] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:24:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:24:58.507653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97348b1-1e14-4500-af64-1b2a459d082a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:58.540695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30671b43-f15b-46cf-a2aa-416df6845007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:58.541731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30671b43-f15b-46cf-a2aa-416df6845007 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:58.542193 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30671b43-f15b-46cf-a2aa-416df6845007 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:58.542660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30671b43-f15b-46cf-a2aa-416df6845007 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:58.554457 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30671b43-f15b-46cf-a2aa-416df6845007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-30671b43-f15b-46cf-a2aa-416df6845007 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:24:58.560489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:24:58.561392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:24:58.562204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:24:58.562204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:24:58.562204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:24:58.562204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:24:58.562204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:24:58.562204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:24:58.562204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:24:58.562204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:24:58.562204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:24:58.562204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:24:58.562204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:24:58.562204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:24:58.564629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 215/421] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:24:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:24:58.570518 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30671b43-f15b-46cf-a2aa-416df6845007 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:58.633516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97348b1-1e14-4500-af64-1b2a459d082a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:58.660490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:58.670884 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e5b64-cce1-4d7d-9f4b-c31ddc25e13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:58.671510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e5b64-cce1-4d7d-9f4b-c31ddc25e13f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:58.671796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e5b64-cce1-4d7d-9f4b-c31ddc25e13f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:58.672078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e5b64-cce1-4d7d-9f4b-c31ddc25e13f None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:58.672841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e5b64-cce1-4d7d-9f4b-c31ddc25e13f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:58.673153 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e5b64-cce1-4d7d-9f4b-c31ddc25e13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:58.674621 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e5b64-cce1-4d7d-9f4b-c31ddc25e13f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:58.684203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 207/422] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:24:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:58.689687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e5b64-cce1-4d7d-9f4b-c31ddc25e13f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:58.785102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30671b43-f15b-46cf-a2aa-416df6845007 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:58.809543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:58.838704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e5b64-cce1-4d7d-9f4b-c31ddc25e13f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:58.855724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8ded2-c233-4f3c-853f-59dff222d5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:58.856988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8ded2-c233-4f3c-853f-59dff222d5cc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:58.857490 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8ded2-c233-4f3c-853f-59dff222d5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:58.857939 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8ded2-c233-4f3c-853f-59dff222d5cc None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:58.858780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8ded2-c233-4f3c-853f-59dff222d5cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:58.859274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8ded2-c233-4f3c-853f-59dff222d5cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:58.862209 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8ded2-c233-4f3c-853f-59dff222d5cc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:58.876826 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 216/423] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:24:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:58.881364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8ded2-c233-4f3c-853f-59dff222d5cc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:58.954575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b558dce-8d23-40f3-b60e-5d14e751a456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:58.955115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b558dce-8d23-40f3-b60e-5d14e751a456 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:58.955395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b558dce-8d23-40f3-b60e-5d14e751a456 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:58.955698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b558dce-8d23-40f3-b60e-5d14e751a456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:58.984901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8ded2-c233-4f3c-853f-59dff222d5cc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:59.021275 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ce351-8c8e-41c3-8d97-d9c2002a7851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:59.022232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ce351-8c8e-41c3-8d97-d9c2002a7851 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:59.022686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ce351-8c8e-41c3-8d97-d9c2002a7851 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:59.023167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ce351-8c8e-41c3-8d97-d9c2002a7851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:59.082057 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:59.093894 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:59.134233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ce351-8c8e-41c3-8d97-d9c2002a7851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:59.135715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ce351-8c8e-41c3-8d97-d9c2002a7851 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:59.138161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b558dce-8d23-40f3-b60e-5d14e751a456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:59.139610 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b558dce-8d23-40f3-b60e-5d14e751a456 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:59.312684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 217/424] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:59.318136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ce351-8c8e-41c3-8d97-d9c2002a7851 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:59.345397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 208/425] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:24:59.352904 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b558dce-8d23-40f3-b60e-5d14e751a456 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:59.451692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:59.500249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ce351-8c8e-41c3-8d97-d9c2002a7851 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:59.512029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:59.543417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b558dce-8d23-40f3-b60e-5d14e751a456 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:59.566753 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014571a-b9ba-47be-bd55-6a321be36e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:59.567304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014571a-b9ba-47be-bd55-6a321be36e1e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:59.567573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014571a-b9ba-47be-bd55-6a321be36e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:59.567843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014571a-b9ba-47be-bd55-6a321be36e1e None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:59.570624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014571a-b9ba-47be-bd55-6a321be36e1e None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:59.572110 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014571a-b9ba-47be-bd55-6a321be36e1e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:59.574112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 218/426] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:59 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:24:59.583225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014571a-b9ba-47be-bd55-6a321be36e1e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:59.613854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9459b38-ea47-4c7d-93fd-38a1c03e0be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:59.615162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9459b38-ea47-4c7d-93fd-38a1c03e0be6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:59.615614 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9459b38-ea47-4c7d-93fd-38a1c03e0be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:59.616069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9459b38-ea47-4c7d-93fd-38a1c03e0be6 None admin] PATH_INFO: `/v3/projects/caf2c8ab542845ae9205702525b855e2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:59.621932 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9459b38-ea47-4c7d-93fd-38a1c03e0be6 None admin] RBAC: Authorizing `identity:get_project(project_id=caf2c8ab542845ae9205702525b855e2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:59.623383 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9459b38-ea47-4c7d-93fd-38a1c03e0be6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:59.626683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 209/427] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:24:59 2022] GET /identity/v3/projects/caf2c8ab542845ae9205702525b855e2 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:59.632174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9459b38-ea47-4c7d-93fd-38a1c03e0be6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:59.709439 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014571a-b9ba-47be-bd55-6a321be36e1e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:59.771754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9459b38-ea47-4c7d-93fd-38a1c03e0be6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:59.780632 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b81e1-d6b4-4cd9-88e7-4c37cf67ec70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:59.781306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b81e1-d6b4-4cd9-88e7-4c37cf67ec70 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:59.781584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b81e1-d6b4-4cd9-88e7-4c37cf67ec70 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:59.789913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b81e1-d6b4-4cd9-88e7-4c37cf67ec70 None admin] PATH_INFO: `/v3/groups/889110c984344dc4a14699b61f2310f8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:59.789913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b81e1-d6b4-4cd9-88e7-4c37cf67ec70 None admin] RBAC: Authorizing `identity:get_group(group_id=889110c984344dc4a14699b61f2310f8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:59.789913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b81e1-d6b4-4cd9-88e7-4c37cf67ec70 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:59.789913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 219/428] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:24:59 2022] GET /identity/v3/groups/889110c984344dc4a14699b61f2310f8 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:59.789913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74605749-143d-4d45-910f-ba73bb235fcc None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:59.789913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74605749-143d-4d45-910f-ba73bb235fcc None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:59.790315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74605749-143d-4d45-910f-ba73bb235fcc None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:59.794933 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 220/429] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:24:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:24:59.796672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74605749-143d-4d45-910f-ba73bb235fcc None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:59.809730 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:59.813969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b93138-2392-401b-8f8e-c47520a252cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:59.815054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b93138-2392-401b-8f8e-c47520a252cf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:59.815538 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b93138-2392-401b-8f8e-c47520a252cf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:59.816351 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b93138-2392-401b-8f8e-c47520a252cf None admin] PATH_INFO: `/v3/groups/889110c984344dc4a14699b61f2310f8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:59.822002 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b93138-2392-401b-8f8e-c47520a252cf None admin] RBAC: Authorizing `identity:get_group(group_id=889110c984344dc4a14699b61f2310f8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:59.822002 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b93138-2392-401b-8f8e-c47520a252cf None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:59.822002 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 210/430] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:24:59 2022] GET /identity/v3/groups/889110c984344dc4a14699b61f2310f8 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:24:59.823417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97f4a-a4f9-41e0-bbcd-5ddf1d10ac41 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:59.823863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97f4a-a4f9-41e0-bbcd-5ddf1d10ac41 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:59.824349 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97f4a-a4f9-41e0-bbcd-5ddf1d10ac41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:59.848470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1ec97f4a-a4f9-41e0-bbcd-5ddf1d10ac41 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:24:59.850029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1ec97f4a-a4f9-41e0-bbcd-5ddf1d10ac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:24:59.870277 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:24:59.925611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74605749-143d-4d45-910f-ba73bb235fcc None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:24:59.952732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 211/431] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:24:59.958430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec97f4a-a4f9-41e0-bbcd-5ddf1d10ac41 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:24:59.976262 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f8f49-a04e-415c-bf43-e5311aac8fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:24:59.976868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f8f49-a04e-415c-bf43-e5311aac8fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:24:59.977142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f8f49-a04e-415c-bf43-e5311aac8fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:24:59.977430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f8f49-a04e-415c-bf43-e5311aac8fb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:24:59.978154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f8f49-a04e-415c-bf43-e5311aac8fb0 None admin] RBAC: Adding query filter params (group.id=889110c984344dc4a14699b61f2310f8, role.id=64f2951b9ce444bcad20c61347224196, scope.project.id=caf2c8ab542845ae9205702525b855e2) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:24:59.978524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f8f49-a04e-415c-bf43-e5311aac8fb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:24:59.979935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f8f49-a04e-415c-bf43-e5311aac8fb0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:24:59.993456 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 221/432] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 31 04:24:59 2022] GET /identity/v3/role_assignments?group.id=889110c984344dc4a14699b61f2310f8&scope.project.id=caf2c8ab542845ae9205702525b855e2&role.id=64f2951b9ce444bcad20c61347224196 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:00.026627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d77d-6a84-468b-ae8f-07a45a28ffd3 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:00.026962 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d77d-6a84-468b-ae8f-07a45a28ffd3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:00.027178 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64d77d-6a84-468b-ae8f-07a45a28ffd3 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:00.028766 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 222/433] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:25:00.034387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ccd37-7d7e-4ba0-8176-14de3cf932c6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:00.034679 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ccd37-7d7e-4ba0-8176-14de3cf932c6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:00.034933 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ccd37-7d7e-4ba0-8176-14de3cf932c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:00.055359 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f03ccd37-7d7e-4ba0-8176-14de3cf932c6 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:00.056186 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f03ccd37-7d7e-4ba0-8176-14de3cf932c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:00.199245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec97f4a-a4f9-41e0-bbcd-5ddf1d10ac41 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:00.200354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 223/434] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:00.259497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1980c-39cc-4913-8908-1d4ae3c41ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:00.260121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1980c-39cc-4913-8908-1d4ae3c41ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:00.260445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1980c-39cc-4913-8908-1d4ae3c41ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:00.260673 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1980c-39cc-4913-8908-1d4ae3c41ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:00.261494 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1980c-39cc-4913-8908-1d4ae3c41ea8 None admin] RBAC: Adding query filter params (group.id=889110c984344dc4a14699b61f2310f8, role.id=0c9ebbeca1134eb4914025ef4cf80f5c, scope.project.id=caf2c8ab542845ae9205702525b855e2) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:00.261801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1980c-39cc-4913-8908-1d4ae3c41ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:00.263315 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1980c-39cc-4913-8908-1d4ae3c41ea8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:00.274734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 212/435] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 31 04:24:59 2022] GET /identity/v3/role_assignments?group.id=889110c984344dc4a14699b61f2310f8&scope.project.id=caf2c8ab542845ae9205702525b855e2&role.id=0c9ebbeca1134eb4914025ef4cf80f5c => generated 611 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:00.305190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ccd37-7d7e-4ba0-8176-14de3cf932c6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:00.307918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:00.425569 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ccd37-7d7e-4ba0-8176-14de3cf932c6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:00.468427 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffa772-d316-46bd-a02e-bee05feb1a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:00.468989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffa772-d316-46bd-a02e-bee05feb1a7f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:00.469319 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffa772-d316-46bd-a02e-bee05feb1a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:00.469593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffa772-d316-46bd-a02e-bee05feb1a7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:00.483672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffa772-d316-46bd-a02e-bee05feb1a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-94ffa772-d316-46bd-a02e-bee05feb1a7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:00.489469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:00.490421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:00.491285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:00.491285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:00.491285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:00.491285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:00.491285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:00.491285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:00.491285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:00.491285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:00.491285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:00.491285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:00.491285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:25:00.491285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:00.491285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 224/436] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:25:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:00.497615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1980c-39cc-4913-8908-1d4ae3c41ea8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:00.517388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:00.521423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffa772-d316-46bd-a02e-bee05feb1a7f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:00.609588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:00.632647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1980c-39cc-4913-8908-1d4ae3c41ea8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:00.655940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffa772-d316-46bd-a02e-bee05feb1a7f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:00.678565 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05825f3c-a4a2-4402-9396-5fbe8c91ebbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:00.679722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05825f3c-a4a2-4402-9396-5fbe8c91ebbf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:00.682804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05825f3c-a4a2-4402-9396-5fbe8c91ebbf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:00.682804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05825f3c-a4a2-4402-9396-5fbe8c91ebbf None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:00.682804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05825f3c-a4a2-4402-9396-5fbe8c91ebbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:00.682804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05825f3c-a4a2-4402-9396-5fbe8c91ebbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:00.682804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05825f3c-a4a2-4402-9396-5fbe8c91ebbf None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:00.691721 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 213/437] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:00.693175 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000188-b917-4678-b0f0-eff485daa0a7 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:00.693743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000188-b917-4678-b0f0-eff485daa0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:00.694216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000188-b917-4678-b0f0-eff485daa0a7 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:00.695643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 214/438] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:00.697999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88000188-b917-4678-b0f0-eff485daa0a7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:00.700667 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da622c9e-7109-4c13-b976-6dcc033aa2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:00.701543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da622c9e-7109-4c13-b976-6dcc033aa2eb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:00.701824 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da622c9e-7109-4c13-b976-6dcc033aa2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:00.702090 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da622c9e-7109-4c13-b976-6dcc033aa2eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:00.713878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da622c9e-7109-4c13-b976-6dcc033aa2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-da622c9e-7109-4c13-b976-6dcc033aa2eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:00.719432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:00.720449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:00.721342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:00.721342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:00.721342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:00.721342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:00.721342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:00.721342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:00.721342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:00.721342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:00.721342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:00.721342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:00.721342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 04:25:00.721342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:00.721342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 225/439] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:25:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:00.721342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0f162-1135-4276-b4d9-3c949153a9de None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:00.722166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0f162-1135-4276-b4d9-3c949153a9de None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:00.722166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0f162-1135-4276-b4d9-3c949153a9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:00.740948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ddf0f162-1135-4276-b4d9-3c949153a9de None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:00.742170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ddf0f162-1135-4276-b4d9-3c949153a9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:00.798270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:00.822232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 226/440] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:00.823162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0f162-1135-4276-b4d9-3c949153a9de None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:00.829190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88000188-b917-4678-b0f0-eff485daa0a7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:00.869692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fccb70-d003-4c2c-a2ac-eeab36442a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:00.870392 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fccb70-d003-4c2c-a2ac-eeab36442a6a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:00.870671 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fccb70-d003-4c2c-a2ac-eeab36442a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:00.870942 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fccb70-d003-4c2c-a2ac-eeab36442a6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:00.885123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:00.936768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0f162-1135-4276-b4d9-3c949153a9de None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:00.940972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fccb70-d003-4c2c-a2ac-eeab36442a6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:00.942444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fccb70-d003-4c2c-a2ac-eeab36442a6a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:00.973272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690aaa7e-ad09-4cb9-b5e0-06fa06fd1ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:00.973953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aaa7e-ad09-4cb9-b5e0-06fa06fd1ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:00.974063 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aaa7e-ad09-4cb9-b5e0-06fa06fd1ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:00.974327 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aaa7e-ad09-4cb9-b5e0-06fa06fd1ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:00.974993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690aaa7e-ad09-4cb9-b5e0-06fa06fd1ff1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:00.975332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690aaa7e-ad09-4cb9-b5e0-06fa06fd1ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:00.976652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690aaa7e-ad09-4cb9-b5e0-06fa06fd1ff1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:00.986811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 227/441] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:25:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:00.992704 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690aaa7e-ad09-4cb9-b5e0-06fa06fd1ff1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:01.021314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:01.048189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 215/442] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:25:01.054317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fccb70-d003-4c2c-a2ac-eeab36442a6a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:01.109815 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690aaa7e-ad09-4cb9-b5e0-06fa06fd1ff1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:01.123773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:01.144173 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3e1e-bc4d-4f34-895e-fb4f7d330f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:01.144774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3e1e-bc4d-4f34-895e-fb4f7d330f6b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:01.145054 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3e1e-bc4d-4f34-895e-fb4f7d330f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:01.145360 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3e1e-bc4d-4f34-895e-fb4f7d330f6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:01.162944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fccb70-d003-4c2c-a2ac-eeab36442a6a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:01.196405 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528aa032-f2d9-4dc1-a522-10417994d425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:01.197032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aa032-f2d9-4dc1-a522-10417994d425 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:01.197341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aa032-f2d9-4dc1-a522-10417994d425 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:01.197615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aa032-f2d9-4dc1-a522-10417994d425 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:01.198740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528aa032-f2d9-4dc1-a522-10417994d425 None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:01.200164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528aa032-f2d9-4dc1-a522-10417994d425 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:01.201796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 216/443] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:25:01 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:01.207042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528aa032-f2d9-4dc1-a522-10417994d425 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:01.219573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f3e1e-bc4d-4f34-895e-fb4f7d330f6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:01.221028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f3e1e-bc4d-4f34-895e-fb4f7d330f6b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:01.245708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:01.302214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528aa032-f2d9-4dc1-a522-10417994d425 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:01.317588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 228/444] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 04:25:01.322437 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3e1e-bc4d-4f34-895e-fb4f7d330f6b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:01.333058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:01.339241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba1b3b-ae37-437b-8306-575e014a34b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:01.339863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba1b3b-ae37-437b-8306-575e014a34b4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:01.340137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba1b3b-ae37-437b-8306-575e014a34b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:01.340402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba1b3b-ae37-437b-8306-575e014a34b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:01.350444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba1b3b-ae37-437b-8306-575e014a34b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1dba1b3b-ae37-437b-8306-575e014a34b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:01.355728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:01.356720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:01.357698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:01.357698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:01.357698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:01.357698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:01.357698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:01.357698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:01.357698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:01.357698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:01.357698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:01.357698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:01.357698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:25:01.357698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:01.357698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 217/445] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:25:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:01.357698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba1b3b-ae37-437b-8306-575e014a34b4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:01.415654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3e1e-bc4d-4f34-895e-fb4f7d330f6b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:01.450717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00df75b-6265-4f03-9ca9-363cfa526b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:01.451362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00df75b-6265-4f03-9ca9-363cfa526b7f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:01.451638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00df75b-6265-4f03-9ca9-363cfa526b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:01.451911 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00df75b-6265-4f03-9ca9-363cfa526b7f None admin] PATH_INFO: `/v3/groups/889110c984344dc4a14699b61f2310f8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:01.453014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00df75b-6265-4f03-9ca9-363cfa526b7f None admin] RBAC: Authorizing `identity:get_group(group_id=889110c984344dc4a14699b61f2310f8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:01.454506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00df75b-6265-4f03-9ca9-363cfa526b7f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:01.456345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 229/446] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:25:01 2022] GET /identity/v3/groups/889110c984344dc4a14699b61f2310f8 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:01.457118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00df75b-6265-4f03-9ca9-363cfa526b7f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:01.461302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba1b3b-ae37-437b-8306-575e014a34b4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:01.462661 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:01.495085 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c0f6e-8b28-4e8b-9acf-04397d78ef45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:01.495759 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c0f6e-8b28-4e8b-9acf-04397d78ef45 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:01.495988 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c0f6e-8b28-4e8b-9acf-04397d78ef45 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:01.496260 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c0f6e-8b28-4e8b-9acf-04397d78ef45 None admin] PATH_INFO: `/v3/projects/5d510566458c49848cdbe57fbe030354` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:01.497666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c0f6e-8b28-4e8b-9acf-04397d78ef45 None admin] RBAC: Authorizing `identity:get_project(project_id=5d510566458c49848cdbe57fbe030354)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:01.499104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c0f6e-8b28-4e8b-9acf-04397d78ef45 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:01.501333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 218/447] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:25:01 2022] GET /identity/v3/projects/5d510566458c49848cdbe57fbe030354 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:01.502488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c0f6e-8b28-4e8b-9acf-04397d78ef45 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:01.539126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:01.557070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00df75b-6265-4f03-9ca9-363cfa526b7f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:01.591357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21a09-f778-4c26-a739-32caf46c5bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:01.591951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21a09-f778-4c26-a739-32caf46c5bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:01.592228 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21a09-f778-4c26-a739-32caf46c5bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:01.592501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21a09-f778-4c26-a739-32caf46c5bf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:01.593160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c21a09-f778-4c26-a739-32caf46c5bf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:01.593495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c21a09-f778-4c26-a739-32caf46c5bf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:01.594850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c21a09-f778-4c26-a739-32caf46c5bf0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:01.600549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c0f6e-8b28-4e8b-9acf-04397d78ef45 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:01.602932 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 230/448] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:25:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:01.603507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21a09-f778-4c26-a739-32caf46c5bf0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:01.634510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371061c-37f8-45e1-a7d1-c189edb1f3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:01.635104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371061c-37f8-45e1-a7d1-c189edb1f3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:01.635382 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371061c-37f8-45e1-a7d1-c189edb1f3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:01.635653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371061c-37f8-45e1-a7d1-c189edb1f3d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:01.636371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371061c-37f8-45e1-a7d1-c189edb1f3d1 None admin] RBAC: Adding query filter params (group.id=889110c984344dc4a14699b61f2310f8, role.id=0c9ebbeca1134eb4914025ef4cf80f5c, scope.project.id=5d510566458c49848cdbe57fbe030354) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:01.636679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371061c-37f8-45e1-a7d1-c189edb1f3d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:01.638130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371061c-37f8-45e1-a7d1-c189edb1f3d1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:01.644255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 219/449] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 31 04:25:01 2022] GET /identity/v3/role_assignments?group.id=889110c984344dc4a14699b61f2310f8&scope.project.id=5d510566458c49848cdbe57fbe030354&role.id=0c9ebbeca1134eb4914025ef4cf80f5c => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:01.645021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371061c-37f8-45e1-a7d1-c189edb1f3d1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:01.683871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:01.713838 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21a09-f778-4c26-a739-32caf46c5bf0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:01.756196 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158c878-0dff-4afe-a737-03cf3c3e7a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:01.756851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158c878-0dff-4afe-a737-03cf3c3e7a10 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:01.757137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158c878-0dff-4afe-a737-03cf3c3e7a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:01.757441 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158c878-0dff-4afe-a737-03cf3c3e7a10 None admin] PATH_INFO: `/v3/groups/889110c984344dc4a14699b61f2310f8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:01.758661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158c878-0dff-4afe-a737-03cf3c3e7a10 None admin] RBAC: Authorizing `identity:get_group(group_id=889110c984344dc4a14699b61f2310f8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:01.759149 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371061c-37f8-45e1-a7d1-c189edb1f3d1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:01.760129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158c878-0dff-4afe-a737-03cf3c3e7a10 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:01.762540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 231/450] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:25:01 2022] GET /identity/v3/groups/889110c984344dc4a14699b61f2310f8 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:01.768059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158c878-0dff-4afe-a737-03cf3c3e7a10 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:01.785820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:01.800968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff85b0a-855f-40a3-be27-ce6eb959e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:01.801733 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85b0a-855f-40a3-be27-ce6eb959e527 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:01.802105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85b0a-855f-40a3-be27-ce6eb959e527 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:01.802463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85b0a-855f-40a3-be27-ce6eb959e527 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:01.887029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff85b0a-855f-40a3-be27-ce6eb959e527 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:01.888490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff85b0a-855f-40a3-be27-ce6eb959e527 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:01.889316 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158c878-0dff-4afe-a737-03cf3c3e7a10 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:01.921139 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:01.924095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834e5a1-a31d-40aa-befb-3968878eb5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:01.924754 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e5a1-a31d-40aa-befb-3968878eb5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:01.925028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e5a1-a31d-40aa-befb-3968878eb5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:01.925334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e5a1-a31d-40aa-befb-3968878eb5d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:01.926063 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834e5a1-a31d-40aa-befb-3968878eb5d6 None admin] RBAC: Adding query filter params (group.id=889110c984344dc4a14699b61f2310f8, role.id=64f2951b9ce444bcad20c61347224196, scope.project.id=5d510566458c49848cdbe57fbe030354) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:01.926373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834e5a1-a31d-40aa-befb-3968878eb5d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:01.927792 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834e5a1-a31d-40aa-befb-3968878eb5d6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:01.933597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 232/451] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 31 04:25:01 2022] GET /identity/v3/role_assignments?group.id=889110c984344dc4a14699b61f2310f8&scope.project.id=5d510566458c49848cdbe57fbe030354&role.id=64f2951b9ce444bcad20c61347224196 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:01.992644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 220/452] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:25:01.998489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834e5a1-a31d-40aa-befb-3968878eb5d6 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:02.083955 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:02.119669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834e5a1-a31d-40aa-befb-3968878eb5d6 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:02.158626 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076f03a-1696-460f-9e0a-ee9c32ea6f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:02.159411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076f03a-1696-460f-9e0a-ee9c32ea6f4a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:02.159719 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076f03a-1696-460f-9e0a-ee9c32ea6f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:02.159974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076f03a-1696-460f-9e0a-ee9c32ea6f4a None admin] PATH_INFO: `/v3/projects/c036297280a949b589ef447a76452691` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:02.161106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076f03a-1696-460f-9e0a-ee9c32ea6f4a None admin] RBAC: Authorizing `identity:get_project(project_id=c036297280a949b589ef447a76452691)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:02.162630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076f03a-1696-460f-9e0a-ee9c32ea6f4a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:02.164256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 233/453] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:25:01 2022] GET /identity/v3/projects/c036297280a949b589ef447a76452691 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:02.169947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff85b0a-855f-40a3-be27-ce6eb959e527 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:02.278145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff85b0a-855f-40a3-be27-ce6eb959e527 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:02.312214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91330dd0-0846-4cc9-a310-d0d33c4900f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:02.312766 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91330dd0-0846-4cc9-a310-d0d33c4900f9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:02.313039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91330dd0-0846-4cc9-a310-d0d33c4900f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:02.313343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91330dd0-0846-4cc9-a310-d0d33c4900f9 None admin] PATH_INFO: `/v3/groups/0637f88a19b64f8da7af70432ff0a159` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:02.314466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91330dd0-0846-4cc9-a310-d0d33c4900f9 None admin] RBAC: Authorizing `identity:get_group(group_id=0637f88a19b64f8da7af70432ff0a159)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:02.316218 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91330dd0-0846-4cc9-a310-d0d33c4900f9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:02.317795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 221/454] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 31 04:25:02 2022] GET /identity/v3/groups/0637f88a19b64f8da7af70432ff0a159 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:02.323653 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076f03a-1696-460f-9e0a-ee9c32ea6f4a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:02.428590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076f03a-1696-460f-9e0a-ee9c32ea6f4a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:02.462770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d19c2a-6dfb-4772-a1dc-152171369d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:02.463362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d19c2a-6dfb-4772-a1dc-152171369d1c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:02.463645 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d19c2a-6dfb-4772-a1dc-152171369d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:02.463917 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d19c2a-6dfb-4772-a1dc-152171369d1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:02.464641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d19c2a-6dfb-4772-a1dc-152171369d1c None admin] RBAC: Adding query filter params (group.id=0637f88a19b64f8da7af70432ff0a159, role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=c036297280a949b589ef447a76452691) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:02.464950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d19c2a-6dfb-4772-a1dc-152171369d1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:02.466425 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d19c2a-6dfb-4772-a1dc-152171369d1c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:02.472682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 234/455] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 31 04:25:02 2022] GET /identity/v3/role_assignments?group.id=0637f88a19b64f8da7af70432ff0a159&scope.project.id=c036297280a949b589ef447a76452691&role.id=1896db68dc754d5293037ab100ce46d9 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:04.720366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5983-e7b9-4b2c-bb47-94eea5a7fa2a None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:04.720885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5983-e7b9-4b2c-bb47-94eea5a7fa2a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:04.720885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5983-e7b9-4b2c-bb47-94eea5a7fa2a None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:04.723072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 222/456] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:04.728979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3818ea-1a1d-4163-b061-3d10c70359a9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:04.729881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3818ea-1a1d-4163-b061-3d10c70359a9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:04.730348 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3818ea-1a1d-4163-b061-3d10c70359a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:04.758301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ea3818ea-1a1d-4163-b061-3d10c70359a9 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:04.759517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ea3818ea-1a1d-4163-b061-3d10c70359a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:04.761671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:04.850167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 235/457] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:05.127831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8752991-56e0-4bba-98fc-1f405c74cea8 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:05.128175 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8752991-56e0-4bba-98fc-1f405c74cea8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:05.128459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8752991-56e0-4bba-98fc-1f405c74cea8 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:05.130082 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 223/458] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:05.134911 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01dded-9010-465a-898e-de709da0c6f8 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:05.135194 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01dded-9010-465a-898e-de709da0c6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:05.135463 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01dded-9010-465a-898e-de709da0c6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:05.158247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-0b01dded-9010-465a-898e-de709da0c6f8 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:05.159586 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0b01dded-9010-465a-898e-de709da0c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:05.243681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 236/459] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:05.253232 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2407c-2550-412b-ae9b-c30c46d48d39 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:05.253526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2407c-2550-412b-ae9b-c30c46d48d39 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:05.253800 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2407c-2550-412b-ae9b-c30c46d48d39 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:05.255361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 224/460] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:05.260419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89d5e3-9347-4c6a-9602-6b6f51a30621 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:05.260705 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89d5e3-9347-4c6a-9602-6b6f51a30621 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:05.260974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89d5e3-9347-4c6a-9602-6b6f51a30621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:05.286247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9f89d5e3-9347-4c6a-9602-6b6f51a30621 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:05.287441 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9f89d5e3-9347-4c6a-9602-6b6f51a30621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:05.321683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2407c-2550-412b-ae9b-c30c46d48d39 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:05.337554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:05.397421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:05.404917 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 237/461] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:05.500695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2407c-2550-412b-ae9b-c30c46d48d39 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:05.540588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89d5e3-9347-4c6a-9602-6b6f51a30621 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:05.548838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eee6d-eb6c-4b62-a79e-e4813b60eec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:05.549561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eee6d-eb6c-4b62-a79e-e4813b60eec2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:05.550019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eee6d-eb6c-4b62-a79e-e4813b60eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:05.550464 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eee6d-eb6c-4b62-a79e-e4813b60eec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:05.572976 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5eee6d-eb6c-4b62-a79e-e4813b60eec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:05.574371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5eee6d-eb6c-4b62-a79e-e4813b60eec2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-ee5eee6d-eb6c-4b62-a79e-e4813b60eec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:05.598672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:05.599675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:05.605528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:05.605528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:05.605528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:05.605528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 225/462] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:05.607820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eee6d-eb6c-4b62-a79e-e4813b60eec2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:05.672329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89d5e3-9347-4c6a-9602-6b6f51a30621 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:05.709429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:05.713312 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5d31c-c7f0-40b1-a23b-2cf233c45f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:05.713940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d31c-c7f0-40b1-a23b-2cf233c45f20 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:05.714216 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d31c-c7f0-40b1-a23b-2cf233c45f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:05.714487 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d31c-c7f0-40b1-a23b-2cf233c45f20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:05.725431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5d31c-c7f0-40b1-a23b-2cf233c45f20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:05.726877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5d31c-c7f0-40b1-a23b-2cf233c45f20 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-3ca5d31c-c7f0-40b1-a23b-2cf233c45f20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:05.742113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:05.743633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:05.744717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:05.744717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:05.744717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:05.744717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 238/463] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:05.744961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f25a7-57a9-4111-a6df-a6c40e833a2f None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:05.745490 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f25a7-57a9-4111-a6df-a6c40e833a2f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:05.745828 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f25a7-57a9-4111-a6df-a6c40e833a2f None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:05.747124 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 239/464] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:05.751871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f25a7-57a9-4111-a6df-a6c40e833a2f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:05.766752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eee6d-eb6c-4b62-a79e-e4813b60eec2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:05.803954 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:05.806257 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7d2f2-88e4-4d28-80fb-aa8157d4a611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:05.807483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7d2f2-88e4-4d28-80fb-aa8157d4a611 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:05.807999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7d2f2-88e4-4d28-80fb-aa8157d4a611 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:05.808455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7d2f2-88e4-4d28-80fb-aa8157d4a611 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:05.809312 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7d2f2-88e4-4d28-80fb-aa8157d4a611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:05.809789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7d2f2-88e4-4d28-80fb-aa8157d4a611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:05.811331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7d2f2-88e4-4d28-80fb-aa8157d4a611 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:05.835430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 226/465] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:05.835430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7d2f2-88e4-4d28-80fb-aa8157d4a611 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:05.865965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f25a7-57a9-4111-a6df-a6c40e833a2f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:05.908239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc7bb3-3872-4f75-b7f5-65c015583337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:05.909162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc7bb3-3872-4f75-b7f5-65c015583337 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:05.909503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc7bb3-3872-4f75-b7f5-65c015583337 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:05.909845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc7bb3-3872-4f75-b7f5-65c015583337 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:05.910567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc7bb3-3872-4f75-b7f5-65c015583337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:05.910938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc7bb3-3872-4f75-b7f5-65c015583337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:05.912314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc7bb3-3872-4f75-b7f5-65c015583337 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:05.930551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 240/466] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:05.930551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11507ee-c061-4090-ac1f-d56a0c970c44 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:05.930551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11507ee-c061-4090-ac1f-d56a0c970c44 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:05.930551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11507ee-c061-4090-ac1f-d56a0c970c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:05.947546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b11507ee-c061-4090-ac1f-d56a0c970c44 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:05.948500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7d2f2-88e4-4d28-80fb-aa8157d4a611 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:05.948737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b11507ee-c061-4090-ac1f-d56a0c970c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:05.967607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:05.988091 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864911f-290c-4b5c-987a-50d442894932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:05.988757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864911f-290c-4b5c-987a-50d442894932 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:05.989035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864911f-290c-4b5c-987a-50d442894932 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:05.989328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864911f-290c-4b5c-987a-50d442894932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:06.000449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864911f-290c-4b5c-987a-50d442894932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:06.001966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864911f-290c-4b5c-987a-50d442894932 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-a864911f-290c-4b5c-987a-50d442894932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:06.016457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:06.017381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:06.018770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:06.018770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:06.018770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:06.018770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 227/467] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:06.019801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864911f-290c-4b5c-987a-50d442894932 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:06.026220 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 241/468] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:06.030313 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11507ee-c061-4090-ac1f-d56a0c970c44 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:06.093407 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:06.152345 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864911f-290c-4b5c-987a-50d442894932 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:06.172368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11507ee-c061-4090-ac1f-d56a0c970c44 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:06.190487 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44dc0-1d8c-40b0-97cd-0a56af0e0491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:06.191100 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44dc0-1d8c-40b0-97cd-0a56af0e0491 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:06.191385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44dc0-1d8c-40b0-97cd-0a56af0e0491 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:06.191655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44dc0-1d8c-40b0-97cd-0a56af0e0491 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:06.192300 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e44dc0-1d8c-40b0-97cd-0a56af0e0491 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:06.193868 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e44dc0-1d8c-40b0-97cd-0a56af0e0491 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:06.214495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9d093-9659-4876-a514-10abdf3ea844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:06.220580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9d093-9659-4876-a514-10abdf3ea844 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:06.220580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9d093-9659-4876-a514-10abdf3ea844 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:06.220580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9d093-9659-4876-a514-10abdf3ea844 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:06.220580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9d093-9659-4876-a514-10abdf3ea844 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:06.220580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9d093-9659-4876-a514-10abdf3ea844 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:06.302597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 228/469] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:25:06 2022] POST /identity/v3/users => generated 246 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:06.303831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44dc0-1d8c-40b0-97cd-0a56af0e0491 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:06.332231 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 242/470] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:25:06 2022] POST /identity/v3/users => generated 248 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:06.333935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24763e-f5fe-4918-a057-9b0bd5f83484 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:06.336215 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24763e-f5fe-4918-a057-9b0bd5f83484 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:06.336215 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24763e-f5fe-4918-a057-9b0bd5f83484 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:06.336817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 243/471] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:06.337988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24763e-f5fe-4918-a057-9b0bd5f83484 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:06.341964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:06.467748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44dc0-1d8c-40b0-97cd-0a56af0e0491 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:06.478507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:06.485833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24763e-f5fe-4918-a057-9b0bd5f83484 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:06.520700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750d955-26ae-47a0-b9a1-55aafde234b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:06.521636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750d955-26ae-47a0-b9a1-55aafde234b6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:06.521920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750d955-26ae-47a0-b9a1-55aafde234b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:06.522242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750d955-26ae-47a0-b9a1-55aafde234b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:06.522900 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750d955-26ae-47a0-b9a1-55aafde234b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:06.523213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750d955-26ae-47a0-b9a1-55aafde234b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:06.524644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750d955-26ae-47a0-b9a1-55aafde234b6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:06.534464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272127ee-910d-4cd0-90f5-8b19f0ecfa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:06.535936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272127ee-910d-4cd0-90f5-8b19f0ecfa44 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:06.536387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272127ee-910d-4cd0-90f5-8b19f0ecfa44 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:06.536851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272127ee-910d-4cd0-90f5-8b19f0ecfa44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:06.539786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 229/472] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:06.541332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc5a16-a586-4c71-8734-1f9b6712e2cf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:06.541844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc5a16-a586-4c71-8734-1f9b6712e2cf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:06.542319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc5a16-a586-4c71-8734-1f9b6712e2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:06.553584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272127ee-910d-4cd0-90f5-8b19f0ecfa44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:06.555622 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272127ee-910d-4cd0-90f5-8b19f0ecfa44 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:06.565925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a1bc5a16-a586-4c71-8734-1f9b6712e2cf None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:06.567154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a1bc5a16-a586-4c71-8734-1f9b6712e2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-272127ee-910d-4cd0-90f5-8b19f0ecfa44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:06.577368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:06.578322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:06.579192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:06.579192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:06.579192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:06.579192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 244/473] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:06.579192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272127ee-910d-4cd0-90f5-8b19f0ecfa44 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:06.656185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 230/474] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:06.657115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc5a16-a586-4c71-8734-1f9b6712e2cf None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:06.674813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:06.716739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272127ee-910d-4cd0-90f5-8b19f0ecfa44 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:06.772531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc5a16-a586-4c71-8734-1f9b6712e2cf None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:06.774814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b5591-ea31-4901-aa29-ea885b98f183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:06.775433 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b5591-ea31-4901-aa29-ea885b98f183 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:06.775711 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b5591-ea31-4901-aa29-ea885b98f183 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:06.775982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b5591-ea31-4901-aa29-ea885b98f183 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:06.776643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b5591-ea31-4901-aa29-ea885b98f183 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:06.778114 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b5591-ea31-4901-aa29-ea885b98f183 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:06.807430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b598bd5-ab49-4a97-bff9-fcf59411e65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:06.808038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598bd5-ab49-4a97-bff9-fcf59411e65a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:06.812627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598bd5-ab49-4a97-bff9-fcf59411e65a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:06.812627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598bd5-ab49-4a97-bff9-fcf59411e65a None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:06.812627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b598bd5-ab49-4a97-bff9-fcf59411e65a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:06.812627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b598bd5-ab49-4a97-bff9-fcf59411e65a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:06.812627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b598bd5-ab49-4a97-bff9-fcf59411e65a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:06.823480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 231/475] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:06.828926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b598bd5-ab49-4a97-bff9-fcf59411e65a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:06.905792 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:06.926237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 245/476] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:25:06 2022] POST /identity/v3/users => generated 248 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:06.949328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b598bd5-ab49-4a97-bff9-fcf59411e65a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:06.994273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b5591-ea31-4901-aa29-ea885b98f183 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:06.995538 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5df094-b703-44c4-9c95-b8846f4afac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:06.996332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5df094-b703-44c4-9c95-b8846f4afac2 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:06.996764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5df094-b703-44c4-9c95-b8846f4afac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:06.997429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5df094-b703-44c4-9c95-b8846f4afac2 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:06.999162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5df094-b703-44c4-9c95-b8846f4afac2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:06.999614 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:07.000800 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5df094-b703-44c4-9c95-b8846f4afac2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:07.109502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 232/477] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:25:06 2022] POST /identity/v3/users => generated 249 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:07.140715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b5591-ea31-4901-aa29-ea885b98f183 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:07.182281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8c15a-f5c9-43e9-be05-89cd20a78178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:07.182894 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c15a-f5c9-43e9-be05-89cd20a78178 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:07.183174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c15a-f5c9-43e9-be05-89cd20a78178 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:07.183448 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c15a-f5c9-43e9-be05-89cd20a78178 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:07.184130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8c15a-f5c9-43e9-be05-89cd20a78178 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:07.185558 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8c15a-f5c9-43e9-be05-89cd20a78178 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:07.252166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.sql.core [None req-60f8c15a-f5c9-43e9-be05-89cd20a78178 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 04:25:07.252166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 04:25:07.252166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [parameters: {'id': '39706eb020dd4390a25785311b708f7f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 04:25:07.252166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81645) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-60f8c15a-f5c9-43e9-be05-89cd20a78178 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application conn.query(q) Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result.read() Aug 31 04:25:07.272279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 04:25:07.273239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application next(self.gen) Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application yield resource Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application next(self.gen) Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise self.value Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application session.commit() Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 04:25:07.274163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.session.flush() Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application compat.raise_( Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 04:25:07.275053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 04:25:07.275961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application conn.query(q) Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application result.read() Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 04:25:07.276789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [parameters: {'id': '39706eb020dd4390a25785311b708f7f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:07.279500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 04:25:07.281590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:07.284233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 246/478] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 31 04:25:06 2022] POST /identity/v3/roles => generated 144 bytes in 280 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:07.284395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5df094-b703-44c4-9c95-b8846f4afac2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:07.393991 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5df094-b703-44c4-9c95-b8846f4afac2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:07.422855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:07.431896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526554f0-902a-4b60-a273-9234c82cc0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:07.432773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526554f0-902a-4b60-a273-9234c82cc0ea None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:07.439002 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526554f0-902a-4b60-a273-9234c82cc0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:07.439002 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526554f0-902a-4b60-a273-9234c82cc0ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:07.444843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526554f0-902a-4b60-a273-9234c82cc0ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-526554f0-902a-4b60-a273-9234c82cc0ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:07.449930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:07.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:07.451588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:07.451588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:07.451588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:07.451588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:07.451588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:07.451588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:07.451588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:07.451588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:07.451588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:07.451588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:07.451588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 04:25:07.451588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:07.453842 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 233/479] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:25:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:07.460310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8c15a-f5c9-43e9-be05-89cd20a78178 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:07.540832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:07.579101 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8c15a-f5c9-43e9-be05-89cd20a78178 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:07.620840 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabcaad-bd21-40d7-a1ae-237f897cdab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:07.621481 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabcaad-bd21-40d7-a1ae-237f897cdab4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:07.621762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabcaad-bd21-40d7-a1ae-237f897cdab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:07.622033 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabcaad-bd21-40d7-a1ae-237f897cdab4 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:07.622708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabcaad-bd21-40d7-a1ae-237f897cdab4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:07.623012 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabcaad-bd21-40d7-a1ae-237f897cdab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:07.624391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabcaad-bd21-40d7-a1ae-237f897cdab4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:07.641714 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 247/480] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:08.637663 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533120f2-98d9-4757-965b-1fb3af1ad117 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:08.638672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533120f2-98d9-4757-965b-1fb3af1ad117 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:08.639146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533120f2-98d9-4757-965b-1fb3af1ad117 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:08.640956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 234/481] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:08.647494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6074cb-aefa-4c9b-b872-4c7c8f9e4c9d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:08.648323 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6074cb-aefa-4c9b-b872-4c7c8f9e4c9d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:08.648789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6074cb-aefa-4c9b-b872-4c7c8f9e4c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:08.667355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-eb6074cb-aefa-4c9b-b872-4c7c8f9e4c9d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:08.668835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-eb6074cb-aefa-4c9b-b872-4c7c8f9e4c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:08.700994 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff479425-37dc-494e-80b5-bbcd7ab9ebc7 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:08.700994 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff479425-37dc-494e-80b5-bbcd7ab9ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:08.700994 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff479425-37dc-494e-80b5-bbcd7ab9ebc7 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:08.701934 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 235/482] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:08.708294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd3d50-e884-4373-8531-b562e7bcc73d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:08.708582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd3d50-e884-4373-8531-b562e7bcc73d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:08.708858 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd3d50-e884-4373-8531-b562e7bcc73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:08.739936 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-10cd3d50-e884-4373-8531-b562e7bcc73d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:08.741739 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-10cd3d50-e884-4373-8531-b562e7bcc73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:08.783446 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 248/483] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:25:08.834787 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 236/484] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:25:09.109428 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6074cb-aefa-4c9b-b872-4c7c8f9e4c9d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:09.173599 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:09.217020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6074cb-aefa-4c9b-b872-4c7c8f9e4c9d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:09.253119 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d3826-b4e9-4dfd-9b85-4a009dae2bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:09.254133 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d3826-b4e9-4dfd-9b85-4a009dae2bed None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:09.254607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d3826-b4e9-4dfd-9b85-4a009dae2bed None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:09.255065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d3826-b4e9-4dfd-9b85-4a009dae2bed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:09.255260 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd3d50-e884-4373-8531-b562e7bcc73d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:09.266528 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d3826-b4e9-4dfd-9b85-4a009dae2bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-1e7d3826-b4e9-4dfd-9b85-4a009dae2bed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:09.272945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:09.273897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:09.274684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:09.274684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:09.274684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:09.274684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:09.274684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:09.274684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:09.274684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:09.274684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:09.274684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:09.274684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:09.274684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:09.274684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:09.281464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 249/485] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:09.284589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d3826-b4e9-4dfd-9b85-4a009dae2bed None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:09.391673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d3826-b4e9-4dfd-9b85-4a009dae2bed None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:09.417968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:09.429465 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8951e0c-0da3-4ee7-b5ba-ce35751366e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:09.430478 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8951e0c-0da3-4ee7-b5ba-ce35751366e1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:09.432619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8951e0c-0da3-4ee7-b5ba-ce35751366e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:09.432619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8951e0c-0da3-4ee7-b5ba-ce35751366e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:09.432619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8951e0c-0da3-4ee7-b5ba-ce35751366e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:09.432619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8951e0c-0da3-4ee7-b5ba-ce35751366e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:09.434258 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8951e0c-0da3-4ee7-b5ba-ce35751366e1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:09.444135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 250/486] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:09.450110 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8951e0c-0da3-4ee7-b5ba-ce35751366e1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:09.465348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd3d50-e884-4373-8531-b562e7bcc73d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:09.486753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:09.511513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37d907-de39-4619-90f8-049404c0897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:09.512147 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37d907-de39-4619-90f8-049404c0897c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:09.512431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37d907-de39-4619-90f8-049404c0897c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:09.512956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37d907-de39-4619-90f8-049404c0897c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:09.529148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37d907-de39-4619-90f8-049404c0897c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-bd37d907-de39-4619-90f8-049404c0897c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:09.535013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:09.535897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:09.536704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:09.536704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:09.536704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:09.536704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:09.536704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:09.536704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:09.536704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:09.536704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:09.536704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:09.536704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:09.536704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:09.536704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:09.536704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 237/487] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:09.538225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e851d62-31c4-4d03-a0d1-b1215d603575 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:09.538508 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e851d62-31c4-4d03-a0d1-b1215d603575 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:09.538778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e851d62-31c4-4d03-a0d1-b1215d603575 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:09.540654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 238/488] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:09.545830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e851d62-31c4-4d03-a0d1-b1215d603575 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:09.567613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8951e0c-0da3-4ee7-b5ba-ce35751366e1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:09.608727 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b7d07-6a3d-4df0-a46d-d30e8e06fd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:09.609382 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7d07-6a3d-4df0-a46d-d30e8e06fd7d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:09.609922 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7d07-6a3d-4df0-a46d-d30e8e06fd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:09.610200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7d07-6a3d-4df0-a46d-d30e8e06fd7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:09.624103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b7d07-6a3d-4df0-a46d-d30e8e06fd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:09.625913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b7d07-6a3d-4df0-a46d-d30e8e06fd7d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-ec4b7d07-6a3d-4df0-a46d-d30e8e06fd7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:09.646907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:09.648298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:09.649143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:09.649143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:09.649143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:09.652850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 251/489] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:09.654502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84cb97-ec07-4cfb-ba08-79e50014e972 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:09.654792 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84cb97-ec07-4cfb-ba08-79e50014e972 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:09.655095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84cb97-ec07-4cfb-ba08-79e50014e972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:09.679150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-aa84cb97-ec07-4cfb-ba08-79e50014e972 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:09.680365 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-aa84cb97-ec07-4cfb-ba08-79e50014e972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:09.681980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e851d62-31c4-4d03-a0d1-b1215d603575 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:09.715149 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:09.728376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c457935-ab1e-4f53-b163-57837244d52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:09.728589 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c457935-ab1e-4f53-b163-57837244d52e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:09.728850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c457935-ab1e-4f53-b163-57837244d52e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:09.729228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c457935-ab1e-4f53-b163-57837244d52e None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:09.729905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c457935-ab1e-4f53-b163-57837244d52e None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:09.730203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c457935-ab1e-4f53-b163-57837244d52e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:09.731617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c457935-ab1e-4f53-b163-57837244d52e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:09.740739 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 239/490] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:09.741587 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c457935-ab1e-4f53-b163-57837244d52e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:09.773950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 252/491] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:09.775940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84cb97-ec07-4cfb-ba08-79e50014e972 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:09.789707 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:09.855597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c457935-ab1e-4f53-b163-57837244d52e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:09.894240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43501ea0-88c0-4cda-a181-82342ddc3944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:09.894500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43501ea0-88c0-4cda-a181-82342ddc3944 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:09.894764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43501ea0-88c0-4cda-a181-82342ddc3944 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:09.894974 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43501ea0-88c0-4cda-a181-82342ddc3944 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:09.895611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43501ea0-88c0-4cda-a181-82342ddc3944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:09.895907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43501ea0-88c0-4cda-a181-82342ddc3944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:09.897679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43501ea0-88c0-4cda-a181-82342ddc3944 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:09.910757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 240/492] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:09.916386 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f817ad9-598a-4dd8-b7b2-ed5c79fcc79e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:09.916687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f817ad9-598a-4dd8-b7b2-ed5c79fcc79e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:09.916963 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f817ad9-598a-4dd8-b7b2-ed5c79fcc79e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:09.918569 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 241/493] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:09.919244 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84cb97-ec07-4cfb-ba08-79e50014e972 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:09.919517 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f817ad9-598a-4dd8-b7b2-ed5c79fcc79e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:09.964847 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ea079-0520-49e9-b89b-0aa863bfe9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:09.965510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea079-0520-49e9-b89b-0aa863bfe9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:09.965787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea079-0520-49e9-b89b-0aa863bfe9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:09.966058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea079-0520-49e9-b89b-0aa863bfe9c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:09.980858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ea079-0520-49e9-b89b-0aa863bfe9c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:09.982762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ea079-0520-49e9-b89b-0aa863bfe9c2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-6a4ea079-0520-49e9-b89b-0aa863bfe9c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:09.999227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:10.000180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:10.001040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:10.001040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:10.001040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:10.004156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 253/494] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:10.005664 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccae08-acb9-464e-b743-513bac7bfa08 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:10.006141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccae08-acb9-464e-b743-513bac7bfa08 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:10.006651 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccae08-acb9-464e-b743-513bac7bfa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:10.026339 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4bccae08-acb9-464e-b743-513bac7bfa08 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:10.027849 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4bccae08-acb9-464e-b743-513bac7bfa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:10.040149 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:10.042369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:10.045406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f817ad9-598a-4dd8-b7b2-ed5c79fcc79e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:10.099384 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c63968-f79a-42a9-be8d-ea64b6c98b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:10.100025 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c63968-f79a-42a9-be8d-ea64b6c98b0e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:10.100434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c63968-f79a-42a9-be8d-ea64b6c98b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:10.100732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c63968-f79a-42a9-be8d-ea64b6c98b0e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:10.110924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c63968-f79a-42a9-be8d-ea64b6c98b0e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:10.112809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c63968-f79a-42a9-be8d-ea64b6c98b0e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:10.113533 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 254/495] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:10.114776 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccae08-acb9-464e-b743-513bac7bfa08 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-89c63968-f79a-42a9-be8d-ea64b6c98b0e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:10.130999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:10.131997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:10.132905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:10.132905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:10.132905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:10.132905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:10.132905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:10.132905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:10.132905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:10.132905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:10.132905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 04:25:10.132905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:10.132905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 242/496] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:25:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:10.138869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c63968-f79a-42a9-be8d-ea64b6c98b0e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:10.245663 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccae08-acb9-464e-b743-513bac7bfa08 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:10.260152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c63968-f79a-42a9-be8d-ea64b6c98b0e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:10.286090 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234324f-4410-4f90-8610-108faab42686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:10.286701 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234324f-4410-4f90-8610-108faab42686 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:10.286981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234324f-4410-4f90-8610-108faab42686 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:10.287252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234324f-4410-4f90-8610-108faab42686 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:10.287894 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234324f-4410-4f90-8610-108faab42686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:10.288365 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234324f-4410-4f90-8610-108faab42686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:10.289611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234324f-4410-4f90-8610-108faab42686 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:10.295888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873a8a4-b388-4f6d-be39-94acc53f8449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:10.296482 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873a8a4-b388-4f6d-be39-94acc53f8449 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:10.296753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873a8a4-b388-4f6d-be39-94acc53f8449 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:10.297022 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873a8a4-b388-4f6d-be39-94acc53f8449 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:10.297785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873a8a4-b388-4f6d-be39-94acc53f8449 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:10.298097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873a8a4-b388-4f6d-be39-94acc53f8449 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:10.300067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873a8a4-b388-4f6d-be39-94acc53f8449 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:10.302093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 255/497] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:10.303182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234324f-4410-4f90-8610-108faab42686 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:10.316288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:10.342303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 243/498] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 31 04:25:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:10.342303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bea8e-7720-4338-919e-1a832862f8bd None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:10.342303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bea8e-7720-4338-919e-1a832862f8bd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:10.342303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bea8e-7720-4338-919e-1a832862f8bd None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:10.342303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 244/499] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:10.342303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bea8e-7720-4338-919e-1a832862f8bd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:10.361158 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:10.419952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234324f-4410-4f90-8610-108faab42686 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:10.447890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bea8e-7720-4338-919e-1a832862f8bd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:10.455067 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0bae9-5b61-49d9-9fea-db1088641309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:10.456107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0bae9-5b61-49d9-9fea-db1088641309 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:10.456393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0bae9-5b61-49d9-9fea-db1088641309 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:10.456725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0bae9-5b61-49d9-9fea-db1088641309 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:10.466550 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0bae9-5b61-49d9-9fea-db1088641309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-18a0bae9-5b61-49d9-9fea-db1088641309 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:10.471810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:10.472762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:10.473580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:10.473580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:10.473580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:10.473580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:10.473580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:10.473580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:10.473580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:10.473580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:10.473580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:10.473580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:10.473580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:10.473580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:10.473580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 256/500] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:10.474259 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0bae9-5b61-49d9-9fea-db1088641309 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:10.485555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab7061-026b-4559-bea8-67da5601ae25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:10.486175 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7061-026b-4559-bea8-67da5601ae25 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:10.486452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7061-026b-4559-bea8-67da5601ae25 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:10.487257 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7061-026b-4559-bea8-67da5601ae25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:10.494329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab7061-026b-4559-bea8-67da5601ae25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:10.495830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab7061-026b-4559-bea8-67da5601ae25 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-10ab7061-026b-4559-bea8-67da5601ae25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:10.507697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:10.508640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:10.509557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:10.509557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:10.509557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:10.509557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:10.509557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:10.509557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:10.509557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:10.509557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:10.509557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:25:10.509557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:10.509557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 245/501] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 31 04:25:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:10.510121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81b347-d389-405d-9fdf-e551ad3af2af None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:10.510207 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81b347-d389-405d-9fdf-e551ad3af2af None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:10.510865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81b347-d389-405d-9fdf-e551ad3af2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:10.529308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bd81b347-d389-405d-9fdf-e551ad3af2af None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:10.530490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bd81b347-d389-405d-9fdf-e551ad3af2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:10.538585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:10.572508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0bae9-5b61-49d9-9fea-db1088641309 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:10.594955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 246/502] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:10.595845 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81b347-d389-405d-9fdf-e551ad3af2af None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:10.607464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc279eb3-7f7f-40da-95a2-ea76b243b735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:10.608266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279eb3-7f7f-40da-95a2-ea76b243b735 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:10.608544 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279eb3-7f7f-40da-95a2-ea76b243b735 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:10.608813 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279eb3-7f7f-40da-95a2-ea76b243b735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:10.610455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:10.683539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc279eb3-7f7f-40da-95a2-ea76b243b735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:10.685075 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc279eb3-7f7f-40da-95a2-ea76b243b735 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:10.702033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81b347-d389-405d-9fdf-e551ad3af2af None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:10.739309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e1c09-a574-48da-9a21-134c6a3c739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:10.740095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1c09-a574-48da-9a21-134c6a3c739a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:10.740536 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1c09-a574-48da-9a21-134c6a3c739a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:10.740946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1c09-a574-48da-9a21-134c6a3c739a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:10.750081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:10.753120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e1c09-a574-48da-9a21-134c6a3c739a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1b4e1c09-a574-48da-9a21-134c6a3c739a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:10.757955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:10.763554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:10.764343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:10.764343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:10.764343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:10.764343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:10.764343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:10.764343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:10.764343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:10.764343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:10.764343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:10.764343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:10.764343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:10.764343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:10.764343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 247/503] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:10.764343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e1c09-a574-48da-9a21-134c6a3c739a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:10.793267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 257/504] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:25:10.797329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc279eb3-7f7f-40da-95a2-ea76b243b735 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:10.841118 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:10.875076 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e1c09-a574-48da-9a21-134c6a3c739a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:10.898528 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc279eb3-7f7f-40da-95a2-ea76b243b735 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:10.910904 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcefba6-d6a3-483b-812d-416dbba98bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:10.911524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcefba6-d6a3-483b-812d-416dbba98bbd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:10.911793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcefba6-d6a3-483b-812d-416dbba98bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:10.912061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcefba6-d6a3-483b-812d-416dbba98bbd None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:10.912707 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcefba6-d6a3-483b-812d-416dbba98bbd None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:10.913002 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcefba6-d6a3-483b-812d-416dbba98bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:10.914408 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcefba6-d6a3-483b-812d-416dbba98bbd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:10.922353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 248/505] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:10.927818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcefba6-d6a3-483b-812d-416dbba98bbd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:10.932522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf76c16-f589-4481-831d-6a6c3d3719da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:10.933118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76c16-f589-4481-831d-6a6c3d3719da None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:10.933424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76c16-f589-4481-831d-6a6c3d3719da None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:10.933694 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76c16-f589-4481-831d-6a6c3d3719da None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:10.934414 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf76c16-f589-4481-831d-6a6c3d3719da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:10.934713 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf76c16-f589-4481-831d-6a6c3d3719da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:10.936124 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf76c16-f589-4481-831d-6a6c3d3719da None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:10.973127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 258/506] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 31 04:25:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:10.973982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf76c16-f589-4481-831d-6a6c3d3719da None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:10.998485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:11.030200 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcefba6-d6a3-483b-812d-416dbba98bbd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:11.059372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:11.064938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcb7a4-2169-49e3-9e2e-d2063c3e8f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:11.065578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcb7a4-2169-49e3-9e2e-d2063c3e8f91 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:11.065860 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcb7a4-2169-49e3-9e2e-d2063c3e8f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:11.066131 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcb7a4-2169-49e3-9e2e-d2063c3e8f91 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:11.066789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcb7a4-2169-49e3-9e2e-d2063c3e8f91 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:11.067093 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcb7a4-2169-49e3-9e2e-d2063c3e8f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:11.068443 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcb7a4-2169-49e3-9e2e-d2063c3e8f91 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:11.072661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf76c16-f589-4481-831d-6a6c3d3719da None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:11.076788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 249/507] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:11.077621 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcb7a4-2169-49e3-9e2e-d2063c3e8f91 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:11.108838 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227374a-9860-4e8f-9aa3-caf28fb90250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:11.109487 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227374a-9860-4e8f-9aa3-caf28fb90250 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:11.109762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227374a-9860-4e8f-9aa3-caf28fb90250 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:11.110027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227374a-9860-4e8f-9aa3-caf28fb90250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:11.119780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227374a-9860-4e8f-9aa3-caf28fb90250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:11.121247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227374a-9860-4e8f-9aa3-caf28fb90250 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-9227374a-9860-4e8f-9aa3-caf28fb90250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:11.135681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:11.136629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:11.137544 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:11.137544 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:11.137544 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:11.137544 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 259/508] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:11.137544 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227374a-9860-4e8f-9aa3-caf28fb90250 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:11.178622 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcb7a4-2169-49e3-9e2e-d2063c3e8f91 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:11.211887 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a76430-9ae1-4aad-a6e8-c2971d7f98a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:11.212510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a76430-9ae1-4aad-a6e8-c2971d7f98a7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:11.212789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a76430-9ae1-4aad-a6e8-c2971d7f98a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:11.213062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a76430-9ae1-4aad-a6e8-c2971d7f98a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:11.216260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:11.223377 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a76430-9ae1-4aad-a6e8-c2971d7f98a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:11.224825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a76430-9ae1-4aad-a6e8-c2971d7f98a7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:11.238958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227374a-9860-4e8f-9aa3-caf28fb90250 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b9a76430-9ae1-4aad-a6e8-c2971d7f98a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:11.240233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:11.241144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:11.242322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:11.242322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:11.242322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:11.242322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 250/509] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:11.242322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a76430-9ae1-4aad-a6e8-c2971d7f98a7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:11.273541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f56f9-38b7-4650-87df-9f1cc8669419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:11.274164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f56f9-38b7-4650-87df-9f1cc8669419 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:11.274440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f56f9-38b7-4650-87df-9f1cc8669419 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:11.274708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f56f9-38b7-4650-87df-9f1cc8669419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:11.285156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f56f9-38b7-4650-87df-9f1cc8669419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:11.286539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f56f9-38b7-4650-87df-9f1cc8669419 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:11.287440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-859f56f9-38b7-4650-87df-9f1cc8669419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:11.300773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:11.301731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:11.302601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:11.302601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:11.302601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:11.302601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 260/510] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:11.302815 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f56f9-38b7-4650-87df-9f1cc8669419 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:11.347479 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a76430-9ae1-4aad-a6e8-c2971d7f98a7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:11.381685 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db07ac-e78d-4a37-917e-56ccca5a76f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:11.382294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db07ac-e78d-4a37-917e-56ccca5a76f5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:11.382572 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db07ac-e78d-4a37-917e-56ccca5a76f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:11.382852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db07ac-e78d-4a37-917e-56ccca5a76f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:11.400716 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f56f9-38b7-4650-87df-9f1cc8669419 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:11.426949 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:11.434225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fd031-20d2-40a1-ac0f-20cce4a0911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:11.434838 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fd031-20d2-40a1-ac0f-20cce4a0911d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:11.435113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fd031-20d2-40a1-ac0f-20cce4a0911d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:11.437776 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fd031-20d2-40a1-ac0f-20cce4a0911d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:11.446163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fd031-20d2-40a1-ac0f-20cce4a0911d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:11.447583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fd031-20d2-40a1-ac0f-20cce4a0911d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:11.450886 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db07ac-e78d-4a37-917e-56ccca5a76f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:11.452311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db07ac-e78d-4a37-917e-56ccca5a76f5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-f76fd031-20d2-40a1-ac0f-20cce4a0911d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:11.462118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:11.463048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:11.464319 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:11.464319 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:11.464319 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:11.464319 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 261/511] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:11.464319 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fd031-20d2-40a1-ac0f-20cce4a0911d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:11.500138 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:11.555358 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 251/512] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:25:11.556440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db07ac-e78d-4a37-917e-56ccca5a76f5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:11.568124 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fd031-20d2-40a1-ac0f-20cce4a0911d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:11.601763 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb440d-2af9-4ebf-849a-5917b05e53b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:11.602353 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb440d-2af9-4ebf-849a-5917b05e53b3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:11.602627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb440d-2af9-4ebf-849a-5917b05e53b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:11.602900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb440d-2af9-4ebf-849a-5917b05e53b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:11.603534 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb440d-2af9-4ebf-849a-5917b05e53b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:11.603831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb440d-2af9-4ebf-849a-5917b05e53b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:11.605190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb440d-2af9-4ebf-849a-5917b05e53b3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:11.616947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 262/513] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:11.617568 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb440d-2af9-4ebf-849a-5917b05e53b3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:11.654295 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db07ac-e78d-4a37-917e-56ccca5a76f5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:11.659498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:11.686844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7cd85-56e4-4f03-b7e7-1e878e5679a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:11.687444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7cd85-56e4-4f03-b7e7-1e878e5679a2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:11.687724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7cd85-56e4-4f03-b7e7-1e878e5679a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:11.688004 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7cd85-56e4-4f03-b7e7-1e878e5679a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:11.688644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7cd85-56e4-4f03-b7e7-1e878e5679a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:11.688945 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7cd85-56e4-4f03-b7e7-1e878e5679a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:11.690904 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7cd85-56e4-4f03-b7e7-1e878e5679a2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:11.701978 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 252/514] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:11.702774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7cd85-56e4-4f03-b7e7-1e878e5679a2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:11.711223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:11.716763 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb440d-2af9-4ebf-849a-5917b05e53b3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:11.750578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502a7c4-4e3f-491d-9572-30290de5655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:11.751169 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502a7c4-4e3f-491d-9572-30290de5655f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:11.751440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502a7c4-4e3f-491d-9572-30290de5655f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:11.751705 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502a7c4-4e3f-491d-9572-30290de5655f None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:11.752868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502a7c4-4e3f-491d-9572-30290de5655f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:11.753170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502a7c4-4e3f-491d-9572-30290de5655f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:11.754562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502a7c4-4e3f-491d-9572-30290de5655f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:11.765483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 263/515] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:11.765483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502a7c4-4e3f-491d-9572-30290de5655f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:11.808375 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7cd85-56e4-4f03-b7e7-1e878e5679a2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:11.840919 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84d537-2902-41f8-a3aa-cd39a0da6b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:11.841540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84d537-2902-41f8-a3aa-cd39a0da6b78 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:11.841822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84d537-2902-41f8-a3aa-cd39a0da6b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:11.842095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84d537-2902-41f8-a3aa-cd39a0da6b78 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:11.842734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84d537-2902-41f8-a3aa-cd39a0da6b78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:11.843039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84d537-2902-41f8-a3aa-cd39a0da6b78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:11.844407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84d537-2902-41f8-a3aa-cd39a0da6b78 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:11.855888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 253/516] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:11.856670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84d537-2902-41f8-a3aa-cd39a0da6b78 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:11.917274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:11.917561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:11.920356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502a7c4-4e3f-491d-9572-30290de5655f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:11.957620 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84d537-2902-41f8-a3aa-cd39a0da6b78 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:11.961027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26cdc8-9ea4-41a9-ae09-dbfb78965286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:11.961677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26cdc8-9ea4-41a9-ae09-dbfb78965286 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:11.961956 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26cdc8-9ea4-41a9-ae09-dbfb78965286 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:11.962227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26cdc8-9ea4-41a9-ae09-dbfb78965286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:11.973804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26cdc8-9ea4-41a9-ae09-dbfb78965286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:11.975264 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26cdc8-9ea4-41a9-ae09-dbfb78965286 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-fe26cdc8-9ea4-41a9-ae09-dbfb78965286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:11.990841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:11.991773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:11.992626 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:11.992626 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:11.992626 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:11.992789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3d07a-6118-4cf0-8882-dde27cc0dd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:11.992885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 264/517] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:11.992954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3d07a-6118-4cf0-8882-dde27cc0dd8d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:11.992954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3d07a-6118-4cf0-8882-dde27cc0dd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:11.993082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26cdc8-9ea4-41a9-ae09-dbfb78965286 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:11.993148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3d07a-6118-4cf0-8882-dde27cc0dd8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:12.003235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3d07a-6118-4cf0-8882-dde27cc0dd8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:12.004695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3d07a-6118-4cf0-8882-dde27cc0dd8d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e0d3d07a-6118-4cf0-8882-dde27cc0dd8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:12.016263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:12.017120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:12.018078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:12.018078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:12.018078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:12.018078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:12.018078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:12.018078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:12.018078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:12.018078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:12.018078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 254/518] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:12.018557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3d07a-6118-4cf0-8882-dde27cc0dd8d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:12.102607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26cdc8-9ea4-41a9-ae09-dbfb78965286 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:12.120306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3d07a-6118-4cf0-8882-dde27cc0dd8d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:12.136105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ac201-4f77-436f-814c-1eb1a783328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:12.136704 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ac201-4f77-436f-814c-1eb1a783328f None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:12.136985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ac201-4f77-436f-814c-1eb1a783328f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:12.137289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ac201-4f77-436f-814c-1eb1a783328f None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:12.137943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ac201-4f77-436f-814c-1eb1a783328f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:12.139370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ac201-4f77-436f-814c-1eb1a783328f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:12.142682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:12.153931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2e2b8-379d-4780-8e84-beecf440334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:12.154548 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2e2b8-379d-4780-8e84-beecf440334b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:12.154824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2e2b8-379d-4780-8e84-beecf440334b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:12.155094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2e2b8-379d-4780-8e84-beecf440334b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:12.162515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2e2b8-379d-4780-8e84-beecf440334b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:12.163932 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2e2b8-379d-4780-8e84-beecf440334b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-24b2e2b8-379d-4780-8e84-beecf440334b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:12.175019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:12.176141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:12.181713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:12.181713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:12.181713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:12.181713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:12.181713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:12.181713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:12.181713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:12.181713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:12.181713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 04:25:12.181713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:12.181713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 255/519] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:25:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:12.181713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2e2b8-379d-4780-8e84-beecf440334b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:12.223763 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 265/520] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:25:11 2022] POST /identity/v3/users => generated 247 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:12.224612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ac201-4f77-436f-814c-1eb1a783328f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:12.236530 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:12.303818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2e2b8-379d-4780-8e84-beecf440334b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:12.341875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b270a2-b382-4e4d-9bef-f923dfa3d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:12.342517 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b270a2-b382-4e4d-9bef-f923dfa3d682 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:12.342794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b270a2-b382-4e4d-9bef-f923dfa3d682 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:12.343068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b270a2-b382-4e4d-9bef-f923dfa3d682 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:12.351588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b270a2-b382-4e4d-9bef-f923dfa3d682 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:12.352441 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ac201-4f77-436f-814c-1eb1a783328f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:12.353104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b270a2-b382-4e4d-9bef-f923dfa3d682 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b2b270a2-b382-4e4d-9bef-f923dfa3d682 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:12.366296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:12.367263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:12.368156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:12.368156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:12.368156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:12.368156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:12.368156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:12.368156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:12.368156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:12.368156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:12.368156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 04:25:12.368156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:12.368156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 256/521] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:12.368739 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b270a2-b382-4e4d-9bef-f923dfa3d682 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:12.400196 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c40ce-96d5-44b7-810f-df64c0704554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:12.401095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c40ce-96d5-44b7-810f-df64c0704554 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:12.401436 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c40ce-96d5-44b7-810f-df64c0704554 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:12.401713 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c40ce-96d5-44b7-810f-df64c0704554 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:12.402528 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c40ce-96d5-44b7-810f-df64c0704554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:12.402843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c40ce-96d5-44b7-810f-df64c0704554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:12.404583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c40ce-96d5-44b7-810f-df64c0704554 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:12.420687 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 266/522] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:12.421553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c40ce-96d5-44b7-810f-df64c0704554 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:12.430221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:12.487150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b270a2-b382-4e4d-9bef-f923dfa3d682 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:12.500168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:12.523761 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e3676-2607-4daf-a8be-7568f25f2034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:12.524374 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e3676-2607-4daf-a8be-7568f25f2034 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:12.524660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e3676-2607-4daf-a8be-7568f25f2034 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:12.524931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e3676-2607-4daf-a8be-7568f25f2034 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:12.525666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e3676-2607-4daf-a8be-7568f25f2034 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:12.525975 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e3676-2607-4daf-a8be-7568f25f2034 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:12.527418 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e3676-2607-4daf-a8be-7568f25f2034 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:12.538951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c40ce-96d5-44b7-810f-df64c0704554 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:12.545406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 257/523] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:12.546229 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e3676-2607-4daf-a8be-7568f25f2034 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:12.579795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba25ae-662f-454c-afa9-bd0a614fcfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:12.581253 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba25ae-662f-454c-afa9-bd0a614fcfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:12.581885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba25ae-662f-454c-afa9-bd0a614fcfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:12.582482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba25ae-662f-454c-afa9-bd0a614fcfc6 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:12.583229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba25ae-662f-454c-afa9-bd0a614fcfc6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:12.583537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba25ae-662f-454c-afa9-bd0a614fcfc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:12.584992 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba25ae-662f-454c-afa9-bd0a614fcfc6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:12.609029 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 267/524] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 31 04:25:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:12.609989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba25ae-662f-454c-afa9-bd0a614fcfc6 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:12.649767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e3676-2607-4daf-a8be-7568f25f2034 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:12.652075 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:12.686114 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b542d-b546-459f-a663-714a79d305b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:12.686724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b542d-b546-459f-a663-714a79d305b7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:12.687003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b542d-b546-459f-a663-714a79d305b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:12.687281 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b542d-b546-459f-a663-714a79d305b7 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:12.688012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b542d-b546-459f-a663-714a79d305b7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:12.688320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b542d-b546-459f-a663-714a79d305b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:12.689815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b542d-b546-459f-a663-714a79d305b7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:12.708325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 258/525] 10.222.0.39 () {56 vars in 1139 bytes} [Wed Aug 31 04:25:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:12.709158 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b542d-b546-459f-a663-714a79d305b7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:12.723578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba25ae-662f-454c-afa9-bd0a614fcfc6 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:12.749812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:12.759710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175adba-129e-4973-a164-c89f79b476be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:12.768871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175adba-129e-4973-a164-c89f79b476be None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:12.768871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175adba-129e-4973-a164-c89f79b476be None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:12.768871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175adba-129e-4973-a164-c89f79b476be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:12.768871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175adba-129e-4973-a164-c89f79b476be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:12.770750 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175adba-129e-4973-a164-c89f79b476be None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-c175adba-129e-4973-a164-c89f79b476be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:12.785395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:12.786363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:12.787222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:12.787222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:12.787222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:12.787222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:12.787222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:12.787222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:12.787222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:12.787222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:12.789022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 268/526] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:12.790097 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175adba-129e-4973-a164-c89f79b476be None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:12.822804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b542d-b546-459f-a663-714a79d305b7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:12.860112 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1b848-e055-4b42-a87a-6d762c0c1e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:12.860676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1b848-e055-4b42-a87a-6d762c0c1e0d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:12.860962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1b848-e055-4b42-a87a-6d762c0c1e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:12.861255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1b848-e055-4b42-a87a-6d762c0c1e0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:12.862539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1b848-e055-4b42-a87a-6d762c0c1e0d None admin] RBAC: Adding query filter params (role.id=8646bae8724e4a26bb49cd7cb1d39593, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=c526760ad8a04bf486d1e7e74e9ffbe3) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:12.863051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1b848-e055-4b42-a87a-6d762c0c1e0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:12.864809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1b848-e055-4b42-a87a-6d762c0c1e0d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:12.869879 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 259/527] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:12 2022] GET /identity/v3/role_assignments?user.id=c526760ad8a04bf486d1e7e74e9ffbe3&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=8646bae8724e4a26bb49cd7cb1d39593 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:12.870675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1b848-e055-4b42-a87a-6d762c0c1e0d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:12.903822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:12.920266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175adba-129e-4973-a164-c89f79b476be None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:12.962137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaadfeb-dfec-4886-89eb-62026718aa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:12.962764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaadfeb-dfec-4886-89eb-62026718aa87 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:12.963046 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaadfeb-dfec-4886-89eb-62026718aa87 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:12.963321 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaadfeb-dfec-4886-89eb-62026718aa87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:13.011071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1b848-e055-4b42-a87a-6d762c0c1e0d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:13.039844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:13.050353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb857c2-acfd-41a2-a5e0-8439563e4645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:13.051097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb857c2-acfd-41a2-a5e0-8439563e4645 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:13.051516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb857c2-acfd-41a2-a5e0-8439563e4645 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:13.051795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb857c2-acfd-41a2-a5e0-8439563e4645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:13.069896 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaadfeb-dfec-4886-89eb-62026718aa87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:13.069896 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaadfeb-dfec-4886-89eb-62026718aa87 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:13.139273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb857c2-acfd-41a2-a5e0-8439563e4645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:13.141113 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb857c2-acfd-41a2-a5e0-8439563e4645 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:13.172151 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:13.196574 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 269/528] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:25:13.197657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaadfeb-dfec-4886-89eb-62026718aa87 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:13.256682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 260/529] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:25:13.257873 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb857c2-acfd-41a2-a5e0-8439563e4645 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:13.289563 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:13.304280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaadfeb-dfec-4886-89eb-62026718aa87 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:13.339615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b1645-54f1-44b5-80ef-3358fb5f4082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:13.340310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b1645-54f1-44b5-80ef-3358fb5f4082 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:13.340653 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b1645-54f1-44b5-80ef-3358fb5f4082 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:13.341009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b1645-54f1-44b5-80ef-3358fb5f4082 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:13.341823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b1645-54f1-44b5-80ef-3358fb5f4082 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:13.343238 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b1645-54f1-44b5-80ef-3358fb5f4082 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:13.344725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b1645-54f1-44b5-80ef-3358fb5f4082 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:13.365130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 270/530] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:13.366223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b1645-54f1-44b5-80ef-3358fb5f4082 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:13.377126 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb857c2-acfd-41a2-a5e0-8439563e4645 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:13.405909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:13.416647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b88db-6a6e-42fe-9728-d4f4023973e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:13.417794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b88db-6a6e-42fe-9728-d4f4023973e0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:13.418422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b88db-6a6e-42fe-9728-d4f4023973e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:13.419040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b88db-6a6e-42fe-9728-d4f4023973e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:13.432801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b88db-6a6e-42fe-9728-d4f4023973e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:13.434641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b88db-6a6e-42fe-9728-d4f4023973e0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f96b88db-6a6e-42fe-9728-d4f4023973e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:13.450958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:13.452094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:13.453060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:13.453060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:13.453060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:13.454864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 261/531] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:13.456726 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b88db-6a6e-42fe-9728-d4f4023973e0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:13.481843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b1645-54f1-44b5-80ef-3358fb5f4082 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:13.522034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3117d66-a96f-47e0-a9f5-bfb7fc4043f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:13.522681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3117d66-a96f-47e0-a9f5-bfb7fc4043f7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:13.523254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3117d66-a96f-47e0-a9f5-bfb7fc4043f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:13.523373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3117d66-a96f-47e0-a9f5-bfb7fc4043f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:13.534666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3117d66-a96f-47e0-a9f5-bfb7fc4043f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:13.536124 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3117d66-a96f-47e0-a9f5-bfb7fc4043f7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:13.543396 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-c3117d66-a96f-47e0-a9f5-bfb7fc4043f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:13.556236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:13.560762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:13.561674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:13.561674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:13.561674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:13.561674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 271/532] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:13.561674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3117d66-a96f-47e0-a9f5-bfb7fc4043f7 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:13.576971 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b88db-6a6e-42fe-9728-d4f4023973e0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:13.621319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d572c-c0d9-4962-b1fc-c15c9e4ffbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:13.622222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d572c-c0d9-4962-b1fc-c15c9e4ffbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:13.622516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d572c-c0d9-4962-b1fc-c15c9e4ffbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:13.622795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d572c-c0d9-4962-b1fc-c15c9e4ffbd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:13.623694 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d572c-c0d9-4962-b1fc-c15c9e4ffbd3 None admin] RBAC: Adding query filter params (role.id=8646bae8724e4a26bb49cd7cb1d39593, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=4877b72a6cea410dbb31a35c7acbd5f9) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:13.624102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d572c-c0d9-4962-b1fc-c15c9e4ffbd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:13.625710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d572c-c0d9-4962-b1fc-c15c9e4ffbd3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:13.638050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 262/533] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:13 2022] GET /identity/v3/role_assignments?user.id=4877b72a6cea410dbb31a35c7acbd5f9&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=8646bae8724e4a26bb49cd7cb1d39593 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:13.638050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d572c-c0d9-4962-b1fc-c15c9e4ffbd3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:13.734325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:13.751477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3117d66-a96f-47e0-a9f5-bfb7fc4043f7 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:13.806564 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d572c-c0d9-4962-b1fc-c15c9e4ffbd3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:13.837314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383b91f-a2ad-4bb7-a7cb-5fa9c52dc1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:13.839067 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383b91f-a2ad-4bb7-a7cb-5fa9c52dc1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:13.839577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383b91f-a2ad-4bb7-a7cb-5fa9c52dc1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:13.840302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383b91f-a2ad-4bb7-a7cb-5fa9c52dc1b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:13.841778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383b91f-a2ad-4bb7-a7cb-5fa9c52dc1b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:13.842388 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383b91f-a2ad-4bb7-a7cb-5fa9c52dc1b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:13.844815 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383b91f-a2ad-4bb7-a7cb-5fa9c52dc1b8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:13.850061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6aef38-9bfc-4856-bcc8-ed67894ee182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:13.850680 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aef38-9bfc-4856-bcc8-ed67894ee182 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:13.850958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aef38-9bfc-4856-bcc8-ed67894ee182 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:13.851232 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aef38-9bfc-4856-bcc8-ed67894ee182 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:13.851883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6aef38-9bfc-4856-bcc8-ed67894ee182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:13.852184 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6aef38-9bfc-4856-bcc8-ed67894ee182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:13.853563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6aef38-9bfc-4856-bcc8-ed67894ee182 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:13.863424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 272/534] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:13.870702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383b91f-a2ad-4bb7-a7cb-5fa9c52dc1b8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:13.876169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 263/535] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:13.881911 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6aef38-9bfc-4856-bcc8-ed67894ee182 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:13.995501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:14.047166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6aef38-9bfc-4856-bcc8-ed67894ee182 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:14.048884 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:14.077713 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383b91f-a2ad-4bb7-a7cb-5fa9c52dc1b8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:14.114518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abe051-af67-45ae-9232-c1efe527270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:14.115158 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abe051-af67-45ae-9232-c1efe527270b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:14.115441 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abe051-af67-45ae-9232-c1efe527270b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:14.115714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abe051-af67-45ae-9232-c1efe527270b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:14.124600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abe051-af67-45ae-9232-c1efe527270b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:14.126090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abe051-af67-45ae-9232-c1efe527270b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-86abe051-af67-45ae-9232-c1efe527270b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:14.142814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:14.144867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:14.146378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:14.146378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:14.146378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:14.146378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:14.146378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:14.146378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:14.146378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:14.146378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:14.147731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b7dfc-2cd5-4606-a44f-44567d140c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:14.148358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b7dfc-2cd5-4606-a44f-44567d140c54 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:14.148635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b7dfc-2cd5-4606-a44f-44567d140c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:14.148908 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b7dfc-2cd5-4606-a44f-44567d140c54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:14.154392 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 264/536] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:14.157368 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abe051-af67-45ae-9232-c1efe527270b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:14.165243 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b7dfc-2cd5-4606-a44f-44567d140c54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:14.166614 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b7dfc-2cd5-4606-a44f-44567d140c54 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-147b7dfc-2cd5-4606-a44f-44567d140c54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:14.188829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:14.191997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:14.194624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:14.194624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:14.194624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:14.194624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:14.194624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:14.194624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:14.194624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:14.194624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:14.194624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 273/537] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:14.198856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b7dfc-2cd5-4606-a44f-44567d140c54 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:14.307776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abe051-af67-45ae-9232-c1efe527270b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:14.346922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0513326-8eb5-4906-a78d-a6a4bb4523b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:14.347128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b7dfc-2cd5-4606-a44f-44567d140c54 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:14.347461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0513326-8eb5-4906-a78d-a6a4bb4523b8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:14.347737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0513326-8eb5-4906-a78d-a6a4bb4523b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:14.348061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0513326-8eb5-4906-a78d-a6a4bb4523b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:14.348859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0513326-8eb5-4906-a78d-a6a4bb4523b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:14.349320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0513326-8eb5-4906-a78d-a6a4bb4523b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:14.350751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0513326-8eb5-4906-a78d-a6a4bb4523b8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:14.365481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 265/538] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:14.366741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf760-612c-49fa-a809-a3e794a5f120 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:14.367021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf760-612c-49fa-a809-a3e794a5f120 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:14.367291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf760-612c-49fa-a809-a3e794a5f120 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:14.372923 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:14.373399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 266/539] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:14.374695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23f25e-fb61-4cca-add5-a43e226bcfe4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:14.375148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23f25e-fb61-4cca-add5-a43e226bcfe4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:14.375584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23f25e-fb61-4cca-add5-a43e226bcfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:14.393141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddaa9d-a7ee-4295-a3b7-043f67e30875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:14.394018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddaa9d-a7ee-4295-a3b7-043f67e30875 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:14.394113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddaa9d-a7ee-4295-a3b7-043f67e30875 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:14.394312 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddaa9d-a7ee-4295-a3b7-043f67e30875 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:14.395015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddaa9d-a7ee-4295-a3b7-043f67e30875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:14.395330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddaa9d-a7ee-4295-a3b7-043f67e30875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:14.396622 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7f23f25e-fb61-4cca-add5-a43e226bcfe4 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:14.397037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddaa9d-a7ee-4295-a3b7-043f67e30875 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:14.398193 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7f23f25e-fb61-4cca-add5-a43e226bcfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:14.413451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 274/540] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:14.414682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddaa9d-a7ee-4295-a3b7-043f67e30875 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:14.418847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:14.481432 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 267/541] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:14.482752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23f25e-fb61-4cca-add5-a43e226bcfe4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:14.543805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddaa9d-a7ee-4295-a3b7-043f67e30875 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:14.596765 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760de830-95dc-4f47-8eca-f3b6d8ccef2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:14.600095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de830-95dc-4f47-8eca-f3b6d8ccef2c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:14.600578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de830-95dc-4f47-8eca-f3b6d8ccef2c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:14.601038 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de830-95dc-4f47-8eca-f3b6d8ccef2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:14.601973 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760de830-95dc-4f47-8eca-f3b6d8ccef2c None admin] RBAC: Adding query filter params (role.id=8646bae8724e4a26bb49cd7cb1d39593, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=2c63e7e4105b41d1abfe58bf13c6125d) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:14.603550 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760de830-95dc-4f47-8eca-f3b6d8ccef2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:14.607065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760de830-95dc-4f47-8eca-f3b6d8ccef2c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:14.620638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 275/542] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:14 2022] GET /identity/v3/role_assignments?user.id=2c63e7e4105b41d1abfe58bf13c6125d&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=8646bae8724e4a26bb49cd7cb1d39593 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:14.649148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23f25e-fb61-4cca-add5-a43e226bcfe4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:14.693373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa194a-228a-48bc-9eb8-73c697a2f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:14.694360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa194a-228a-48bc-9eb8-73c697a2f581 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:14.694846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa194a-228a-48bc-9eb8-73c697a2f581 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:14.695307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa194a-228a-48bc-9eb8-73c697a2f581 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:14.696223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa194a-228a-48bc-9eb8-73c697a2f581 None admin] RBAC: Adding query filter params (role.id=8646bae8724e4a26bb49cd7cb1d39593, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=4455f4e327184c69aead4a7ae9737961) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:14.696722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa194a-228a-48bc-9eb8-73c697a2f581 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:14.698404 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa194a-228a-48bc-9eb8-73c697a2f581 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:14.705339 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 268/543] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:14 2022] GET /identity/v3/role_assignments?user.id=4455f4e327184c69aead4a7ae9737961&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=8646bae8724e4a26bb49cd7cb1d39593 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:14.864477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760de830-95dc-4f47-8eca-f3b6d8ccef2c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:14.922454 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:14.984159 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760de830-95dc-4f47-8eca-f3b6d8ccef2c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:15.018613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de5d3-66c0-432d-8785-6f9716fa9b1b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:15.019302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de5d3-66c0-432d-8785-6f9716fa9b1b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:15.019302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de5d3-66c0-432d-8785-6f9716fa9b1b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:15.020621 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 269/544] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:15.026660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de218f04-6208-4817-9b51-e4893075262d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:15.026936 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de218f04-6208-4817-9b51-e4893075262d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:15.027211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de218f04-6208-4817-9b51-e4893075262d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:15.046895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09143df8-0e99-4207-a259-360ad3659f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:15.047537 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-de218f04-6208-4817-9b51-e4893075262d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:15.048076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09143df8-0e99-4207-a259-360ad3659f11 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:15.048525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09143df8-0e99-4207-a259-360ad3659f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:15.048742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-de218f04-6208-4817-9b51-e4893075262d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:15.049741 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09143df8-0e99-4207-a259-360ad3659f11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:15.072434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:15.072745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09143df8-0e99-4207-a259-360ad3659f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-09143df8-0e99-4207-a259-360ad3659f11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:15.078106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:15.085572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:15.086377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:15.086377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:15.086377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:15.086377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:15.086377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:15.086377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:15.086377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:15.086377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:15.086377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:15.086377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:15.086377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:15.086377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:15.086377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 276/545] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:15.086377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09143df8-0e99-4207-a259-360ad3659f11 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:15.194277 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 270/546] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:25:15.234699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09143df8-0e99-4207-a259-360ad3659f11 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:15.236267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:15.288605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706882ff-470d-46c6-9eb8-62c898e2f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:15.289547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706882ff-470d-46c6-9eb8-62c898e2f839 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:15.289993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706882ff-470d-46c6-9eb8-62c898e2f839 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:15.290442 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706882ff-470d-46c6-9eb8-62c898e2f839 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:15.291317 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706882ff-470d-46c6-9eb8-62c898e2f839 None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:15.291804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706882ff-470d-46c6-9eb8-62c898e2f839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:15.293380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706882ff-470d-46c6-9eb8-62c898e2f839 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:15.303907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 277/547] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:15.314309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de218f04-6208-4817-9b51-e4893075262d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:15.456238 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de218f04-6208-4817-9b51-e4893075262d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:15.504958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb756255-bb13-4e47-b670-b616c130cbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:15.505625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb756255-bb13-4e47-b670-b616c130cbfe None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:15.505907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb756255-bb13-4e47-b670-b616c130cbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:15.506179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb756255-bb13-4e47-b670-b616c130cbfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:15.519203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb756255-bb13-4e47-b670-b616c130cbfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:15.520646 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb756255-bb13-4e47-b670-b616c130cbfe None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:15.531519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-cb756255-bb13-4e47-b670-b616c130cbfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:15.541071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:15.542284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:15.543312 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:15.543312 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:15.543312 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:15.548370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 271/548] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:15.550450 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706882ff-470d-46c6-9eb8-62c898e2f839 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:15.580327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb756255-bb13-4e47-b670-b616c130cbfe None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:15.785223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706882ff-470d-46c6-9eb8-62c898e2f839 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:15.789236 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb756255-bb13-4e47-b670-b616c130cbfe None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:15.834429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ff716-0a8b-4d76-8057-cb2938d6d95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:15.835027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ff716-0a8b-4d76-8057-cb2938d6d95a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:15.837928 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ff716-0a8b-4d76-8057-cb2938d6d95a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:15.837928 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ff716-0a8b-4d76-8057-cb2938d6d95a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:15.857459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ff716-0a8b-4d76-8057-cb2938d6d95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-468ff716-0a8b-4d76-8057-cb2938d6d95a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:15.868924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:15.870074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:15.870888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:15.870888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:15.870888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:15.870888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:15.870888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:15.870888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:15.870888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:15.870888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:15.870888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:15.870888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:15.870888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:15.870888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:15.870888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 272/549] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:15.878549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ff716-0a8b-4d76-8057-cb2938d6d95a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:15.879605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214ace1-f4ab-469f-b985-f4e417d7a04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:15.881785 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214ace1-f4ab-469f-b985-f4e417d7a04f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:15.881785 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214ace1-f4ab-469f-b985-f4e417d7a04f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:15.881785 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214ace1-f4ab-469f-b985-f4e417d7a04f None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:15.882266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214ace1-f4ab-469f-b985-f4e417d7a04f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:15.882266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214ace1-f4ab-469f-b985-f4e417d7a04f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:15.883621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214ace1-f4ab-469f-b985-f4e417d7a04f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:15.917352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 278/550] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:15.922144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214ace1-f4ab-469f-b985-f4e417d7a04f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:15.966314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:15.984617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:16.072197 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ff716-0a8b-4d76-8057-cb2938d6d95a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:16.123274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214ace1-f4ab-469f-b985-f4e417d7a04f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:16.125855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6471c7f-eee5-41ae-a9b2-bd4b8c8b5846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:16.126709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6471c7f-eee5-41ae-a9b2-bd4b8c8b5846 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:16.128504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6471c7f-eee5-41ae-a9b2-bd4b8c8b5846 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:16.129224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6471c7f-eee5-41ae-a9b2-bd4b8c8b5846 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:16.131396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6471c7f-eee5-41ae-a9b2-bd4b8c8b5846 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:16.133566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6471c7f-eee5-41ae-a9b2-bd4b8c8b5846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:16.135189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6471c7f-eee5-41ae-a9b2-bd4b8c8b5846 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:16.156138 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 273/551] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:16.157893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a4111-72aa-458c-a0bc-b92a0fd1345e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:16.159984 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a4111-72aa-458c-a0bc-b92a0fd1345e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:16.161540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a4111-72aa-458c-a0bc-b92a0fd1345e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:16.165523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 274/552] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:16.166470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a4111-72aa-458c-a0bc-b92a0fd1345e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:16.204997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2fc8f-74f7-4aef-bf6e-86900fe0c611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:16.206203 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2fc8f-74f7-4aef-bf6e-86900fe0c611 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:16.206595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2fc8f-74f7-4aef-bf6e-86900fe0c611 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:16.206965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2fc8f-74f7-4aef-bf6e-86900fe0c611 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:16.214977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2fc8f-74f7-4aef-bf6e-86900fe0c611 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:16.216523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2fc8f-74f7-4aef-bf6e-86900fe0c611 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-65e2fc8f-74f7-4aef-bf6e-86900fe0c611 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:16.247605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:16.248822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:16.249900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:16.249900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:16.249900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:16.249900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:16.249900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:16.249900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:16.249900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:16.249900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:16.249900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 04:25:16.249900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:16.252113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 279/553] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:25:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:16.254000 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a8990-2dda-4d3b-9afe-520dbeeb3365 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:16.254578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a8990-2dda-4d3b-9afe-520dbeeb3365 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:16.254952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a8990-2dda-4d3b-9afe-520dbeeb3365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:16.274229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-da8a8990-2dda-4d3b-9afe-520dbeeb3365 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:16.275563 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-da8a8990-2dda-4d3b-9afe-520dbeeb3365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:16.325610 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a4111-72aa-458c-a0bc-b92a0fd1345e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:16.350776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:16.360653 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 280/554] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:16.362048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a8990-2dda-4d3b-9afe-520dbeeb3365 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:16.389567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:16.390076 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee5b2-5e3f-455e-9a1e-9e856007f5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:16.390697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee5b2-5e3f-455e-9a1e-9e856007f5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:16.390977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee5b2-5e3f-455e-9a1e-9e856007f5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:16.395522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee5b2-5e3f-455e-9a1e-9e856007f5d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:16.419791 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beee5b2-5e3f-455e-9a1e-9e856007f5d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:16.421273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beee5b2-5e3f-455e-9a1e-9e856007f5d7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1beee5b2-5e3f-455e-9a1e-9e856007f5d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:16.457699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:16.458870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:16.460054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:16.460054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:16.460054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:16.460054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 275/555] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:16.465798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee5b2-5e3f-455e-9a1e-9e856007f5d7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:16.555835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a8990-2dda-4d3b-9afe-520dbeeb3365 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:16.611610 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854de4d8-786d-4c07-8303-80811d7696ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:16.612708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854de4d8-786d-4c07-8303-80811d7696ed None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:16.612967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854de4d8-786d-4c07-8303-80811d7696ed None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:16.613294 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854de4d8-786d-4c07-8303-80811d7696ed None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:16.613980 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854de4d8-786d-4c07-8303-80811d7696ed None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:16.614283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854de4d8-786d-4c07-8303-80811d7696ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:16.615722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854de4d8-786d-4c07-8303-80811d7696ed None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:16.653712 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 281/556] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 31 04:25:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:16.654579 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854de4d8-786d-4c07-8303-80811d7696ed None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:16.675118 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee5b2-5e3f-455e-9a1e-9e856007f5d7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:16.722129 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860258de-151c-4d41-a3f1-3ac0889578c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:16.722802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860258de-151c-4d41-a3f1-3ac0889578c9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:16.723516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860258de-151c-4d41-a3f1-3ac0889578c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:16.723930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860258de-151c-4d41-a3f1-3ac0889578c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:16.724711 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860258de-151c-4d41-a3f1-3ac0889578c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:16.725013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860258de-151c-4d41-a3f1-3ac0889578c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:16.726677 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860258de-151c-4d41-a3f1-3ac0889578c9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:16.732195 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:16.744033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 276/557] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:16.745383 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860258de-151c-4d41-a3f1-3ac0889578c9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:16.765660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854de4d8-786d-4c07-8303-80811d7696ed None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:16.790676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:16.816051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adb45e-f0f8-43e3-ba8d-fe9aecedd25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:16.817277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adb45e-f0f8-43e3-ba8d-fe9aecedd25a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:16.817725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adb45e-f0f8-43e3-ba8d-fe9aecedd25a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:16.818302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adb45e-f0f8-43e3-ba8d-fe9aecedd25a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:16.832576 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adb45e-f0f8-43e3-ba8d-fe9aecedd25a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-b4adb45e-f0f8-43e3-ba8d-fe9aecedd25a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:16.838640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:16.840225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:16.841273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:16.841273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:16.841273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:16.841273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:16.841273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:16.841273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:16.841273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:16.841273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:16.841273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:16.841273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:16.841273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:16.841273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:16.842429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 282/558] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:16.843218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adb45e-f0f8-43e3-ba8d-fe9aecedd25a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:16.876295 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860258de-151c-4d41-a3f1-3ac0889578c9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:16.924981 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be909dbd-72ab-4944-be86-fc34bcedb9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:16.926595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be909dbd-72ab-4944-be86-fc34bcedb9fb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:16.926595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be909dbd-72ab-4944-be86-fc34bcedb9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:16.926595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be909dbd-72ab-4944-be86-fc34bcedb9fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:16.968193 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adb45e-f0f8-43e3-ba8d-fe9aecedd25a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:16.998786 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:17.005305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be909dbd-72ab-4944-be86-fc34bcedb9fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:17.006285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d40f9-c074-48be-9fb4-0769b7797d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:17.006773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be909dbd-72ab-4944-be86-fc34bcedb9fb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:17.007404 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d40f9-c074-48be-9fb4-0769b7797d4c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:17.007859 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d40f9-c074-48be-9fb4-0769b7797d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:17.008321 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d40f9-c074-48be-9fb4-0769b7797d4c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:17.017709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d40f9-c074-48be-9fb4-0769b7797d4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:17.019560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d40f9-c074-48be-9fb4-0769b7797d4c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-572d40f9-c074-48be-9fb4-0769b7797d4c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:17.032918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:17.034689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:17.035624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:17.035624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:17.035624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:17.035624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:17.035624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:17.035624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:17.035624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:17.035624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:17.035624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 04:25:17.035624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:17.035624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 283/559] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:25:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:17.036208 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d40f9-c074-48be-9fb4-0769b7797d4c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:17.043957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:17.119141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 277/560] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:25:17.120394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b465a58-1217-43ce-a32e-75482eaed44f None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:17.120675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b465a58-1217-43ce-a32e-75482eaed44f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:17.120949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b465a58-1217-43ce-a32e-75482eaed44f None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:17.122226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 278/561] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:17.122914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b465a58-1217-43ce-a32e-75482eaed44f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:17.148980 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d40f9-c074-48be-9fb4-0769b7797d4c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:17.183640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b1fd0-d003-4072-9f99-d3d6c4011885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:17.184234 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b1fd0-d003-4072-9f99-d3d6c4011885 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:17.184507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b1fd0-d003-4072-9f99-d3d6c4011885 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:17.184773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b1fd0-d003-4072-9f99-d3d6c4011885 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:17.185473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b1fd0-d003-4072-9f99-d3d6c4011885 None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:17.185772 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b1fd0-d003-4072-9f99-d3d6c4011885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:17.187123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b1fd0-d003-4072-9f99-d3d6c4011885 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:17.194913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 284/562] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:17.196148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22a61-1ff7-48e8-99e8-9ef312dff43e None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:17.196439 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22a61-1ff7-48e8-99e8-9ef312dff43e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:17.196718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22a61-1ff7-48e8-99e8-9ef312dff43e None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:17.198107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 285/563] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:17.202862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a22a61-1ff7-48e8-99e8-9ef312dff43e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:17.226767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b465a58-1217-43ce-a32e-75482eaed44f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:17.256095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:17.261691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f36844-52a9-486e-b9df-d1d4647a250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:17.262295 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36844-52a9-486e-b9df-d1d4647a250e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:17.262576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36844-52a9-486e-b9df-d1d4647a250e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:17.262846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36844-52a9-486e-b9df-d1d4647a250e None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:17.263568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f36844-52a9-486e-b9df-d1d4647a250e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:17.264274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:17.264385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f36844-52a9-486e-b9df-d1d4647a250e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:17.265285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f36844-52a9-486e-b9df-d1d4647a250e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:17.283531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 279/564] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 31 04:25:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:17.284738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aba5af-6e12-44d6-bb63-05f56a67b14f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:17.285015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aba5af-6e12-44d6-bb63-05f56a67b14f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:17.285312 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aba5af-6e12-44d6-bb63-05f56a67b14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:17.303366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c9aba5af-6e12-44d6-bb63-05f56a67b14f None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:17.304558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c9aba5af-6e12-44d6-bb63-05f56a67b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:17.315425 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a22a61-1ff7-48e8-99e8-9ef312dff43e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:17.344002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b88887-d4ad-4a37-b3a8-903fc66a0ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:17.344619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b88887-d4ad-4a37-b3a8-903fc66a0ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:17.344891 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b88887-d4ad-4a37-b3a8-903fc66a0ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:17.345161 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b88887-d4ad-4a37-b3a8-903fc66a0ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:17.355639 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b88887-d4ad-4a37-b3a8-903fc66a0ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:17.357077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b88887-d4ad-4a37-b3a8-903fc66a0ac6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:17.370041 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 280/565] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:17.370867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aba5af-6e12-44d6-bb63-05f56a67b14f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-58b88887-d4ad-4a37-b3a8-903fc66a0ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:17.371491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:17.372408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:17.378722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:17.378722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:17.378722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:17.378722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 286/566] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:17.378722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dec8b-79be-42cb-a724-09aa66604728 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:17.378722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dec8b-79be-42cb-a724-09aa66604728 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:17.378722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dec8b-79be-42cb-a724-09aa66604728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:17.394341 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f21dec8b-79be-42cb-a724-09aa66604728 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:17.395526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f21dec8b-79be-42cb-a724-09aa66604728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:17.470416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 287/567] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:17.472357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dec8b-79be-42cb-a724-09aa66604728 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:17.493950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aba5af-6e12-44d6-bb63-05f56a67b14f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:17.515942 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:17.532700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f7334-b652-41ec-8c65-2ac3d253ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:17.533390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f7334-b652-41ec-8c65-2ac3d253ec60 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:17.533720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f7334-b652-41ec-8c65-2ac3d253ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:17.533988 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f7334-b652-41ec-8c65-2ac3d253ec60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:17.534540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:17.545409 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f7334-b652-41ec-8c65-2ac3d253ec60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:17.546971 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f7334-b652-41ec-8c65-2ac3d253ec60 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-613f7334-b652-41ec-8c65-2ac3d253ec60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:17.564157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:17.567628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:17.568547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:17.568547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:17.568547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:17.568547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 281/568] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:17.568547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f7334-b652-41ec-8c65-2ac3d253ec60 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:17.580021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dec8b-79be-42cb-a724-09aa66604728 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:17.615090 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366aa0c-c4f4-49c3-a54c-8b23e5c3e385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:17.615977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366aa0c-c4f4-49c3-a54c-8b23e5c3e385 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:17.616422 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366aa0c-c4f4-49c3-a54c-8b23e5c3e385 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:17.616831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366aa0c-c4f4-49c3-a54c-8b23e5c3e385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:17.628919 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366aa0c-c4f4-49c3-a54c-8b23e5c3e385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:17.631027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366aa0c-c4f4-49c3-a54c-8b23e5c3e385 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-5366aa0c-c4f4-49c3-a54c-8b23e5c3e385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:17.649105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:17.650278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:17.651372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:17.651372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:17.651372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:17.652738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 288/569] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:17.653671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366aa0c-c4f4-49c3-a54c-8b23e5c3e385 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:17.683403 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f7334-b652-41ec-8c65-2ac3d253ec60 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:17.722024 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ae5ae-11e7-4749-9080-63b16875a6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:17.722549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae5ae-11e7-4749-9080-63b16875a6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:17.722827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae5ae-11e7-4749-9080-63b16875a6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:17.723099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae5ae-11e7-4749-9080-63b16875a6f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:17.723741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ae5ae-11e7-4749-9080-63b16875a6f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:17.724029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ae5ae-11e7-4749-9080-63b16875a6f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:17.725413 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ae5ae-11e7-4749-9080-63b16875a6f8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:17.738514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 282/570] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:17.739600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ae5ae-11e7-4749-9080-63b16875a6f8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:17.750053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:17.763026 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366aa0c-c4f4-49c3-a54c-8b23e5c3e385 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:17.770997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:17.798547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ad6dc-a1a5-4f58-bfbd-7296b8e7fce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:17.799242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ad6dc-a1a5-4f58-bfbd-7296b8e7fce2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:17.799675 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ad6dc-a1a5-4f58-bfbd-7296b8e7fce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:17.799901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ad6dc-a1a5-4f58-bfbd-7296b8e7fce2 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:17.800542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ad6dc-a1a5-4f58-bfbd-7296b8e7fce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:17.800861 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ad6dc-a1a5-4f58-bfbd-7296b8e7fce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:17.802260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ad6dc-a1a5-4f58-bfbd-7296b8e7fce2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:17.813645 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 289/571] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:17.814424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ad6dc-a1a5-4f58-bfbd-7296b8e7fce2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:17.843471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ae5ae-11e7-4749-9080-63b16875a6f8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:17.876535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a6a44-f0aa-4eab-943c-8bab45f80ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:17.877146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a6a44-f0aa-4eab-943c-8bab45f80ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:17.878066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a6a44-f0aa-4eab-943c-8bab45f80ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:17.878370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a6a44-f0aa-4eab-943c-8bab45f80ef2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:17.888452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a6a44-f0aa-4eab-943c-8bab45f80ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-a25a6a44-f0aa-4eab-943c-8bab45f80ef2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:17.893241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:17.894310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:17.895582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:17.895582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:17.895582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:17.895582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:17.895582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:17.895582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:17.895582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:17.895582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:17.895582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:17.895582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:17.895582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:17.895582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:17.895582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 283/572] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:17.895582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a6a44-f0aa-4eab-943c-8bab45f80ef2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:17.915681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ad6dc-a1a5-4f58-bfbd-7296b8e7fce2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:17.949664 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a66a7-cf99-435f-84d9-eb9e804fee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:17.950256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a66a7-cf99-435f-84d9-eb9e804fee9c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:17.950529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a66a7-cf99-435f-84d9-eb9e804fee9c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:17.950793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a66a7-cf99-435f-84d9-eb9e804fee9c None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:17.951433 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a66a7-cf99-435f-84d9-eb9e804fee9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:17.951728 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a66a7-cf99-435f-84d9-eb9e804fee9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:17.953072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a66a7-cf99-435f-84d9-eb9e804fee9c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:17.964562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 290/573] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:17.965179 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a66a7-cf99-435f-84d9-eb9e804fee9c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:17.976131 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:17.986134 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:17.995121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a6a44-f0aa-4eab-943c-8bab45f80ef2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:18.029555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3444eef-493e-4436-955f-2c633790ab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:18.030216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3444eef-493e-4436-955f-2c633790ab32 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:18.030495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3444eef-493e-4436-955f-2c633790ab32 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:18.030760 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3444eef-493e-4436-955f-2c633790ab32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:18.038321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3444eef-493e-4436-955f-2c633790ab32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:18.039749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3444eef-493e-4436-955f-2c633790ab32 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-a3444eef-493e-4436-955f-2c633790ab32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:18.051160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:18.052596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:18.054341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:18.054341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:18.054341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:18.054341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:18.054341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:18.054341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:18.054341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:18.054341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:18.054341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 284/574] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:18.054341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3444eef-493e-4436-955f-2c633790ab32 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:18.072897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a66a7-cf99-435f-84d9-eb9e804fee9c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:18.107486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded2211-5fe4-42ad-857b-04297726d25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:18.108106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded2211-5fe4-42ad-857b-04297726d25e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:18.108393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded2211-5fe4-42ad-857b-04297726d25e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:18.108669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded2211-5fe4-42ad-857b-04297726d25e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:18.119829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded2211-5fe4-42ad-857b-04297726d25e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-8ded2211-5fe4-42ad-857b-04297726d25e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:18.125020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:18.126122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:18.127010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:18.127010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:18.127010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:18.127010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:18.127010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:18.127010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:18.127010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:18.127010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:18.127010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:18.127010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:18.127010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:18.127010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:18.127010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 291/575] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:18.127010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded2211-5fe4-42ad-857b-04297726d25e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:18.164026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3444eef-493e-4436-955f-2c633790ab32 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:18.195386 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:18.198529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878501e-0ce9-4deb-8e47-c1ad886e9aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:18.199158 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878501e-0ce9-4deb-8e47-c1ad886e9aeb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:18.199437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878501e-0ce9-4deb-8e47-c1ad886e9aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:18.199710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878501e-0ce9-4deb-8e47-c1ad886e9aeb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:18.206689 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878501e-0ce9-4deb-8e47-c1ad886e9aeb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:18.208171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878501e-0ce9-4deb-8e47-c1ad886e9aeb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e878501e-0ce9-4deb-8e47-c1ad886e9aeb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:18.220632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:18.222217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:18.223179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:18.223179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:18.223179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:18.223179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:18.223179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:18.223179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:18.223179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:18.223179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:18.223179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:25:18.223179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:18.223179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 285/576] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 31 04:25:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:18.223810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878501e-0ce9-4deb-8e47-c1ad886e9aeb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:18.233378 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded2211-5fe4-42ad-857b-04297726d25e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:18.241314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:18.267344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13753e28-fa7f-4955-9c56-673c2e6ab11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:18.268281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13753e28-fa7f-4955-9c56-673c2e6ab11a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:18.268776 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13753e28-fa7f-4955-9c56-673c2e6ab11a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:18.269065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13753e28-fa7f-4955-9c56-673c2e6ab11a None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:18.269759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13753e28-fa7f-4955-9c56-673c2e6ab11a None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:18.270136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13753e28-fa7f-4955-9c56-673c2e6ab11a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:18.271782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13753e28-fa7f-4955-9c56-673c2e6ab11a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:18.279803 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 292/577] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:18.280597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13753e28-fa7f-4955-9c56-673c2e6ab11a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:18.335266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878501e-0ce9-4deb-8e47-c1ad886e9aeb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:18.376036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16400-499a-4f44-88d3-99b1b79a3a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:18.376661 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16400-499a-4f44-88d3-99b1b79a3a54 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:18.376942 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16400-499a-4f44-88d3-99b1b79a3a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:18.377918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16400-499a-4f44-88d3-99b1b79a3a54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:18.384485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d16400-499a-4f44-88d3-99b1b79a3a54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:18.385965 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d16400-499a-4f44-88d3-99b1b79a3a54 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:18.386235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13753e28-fa7f-4955-9c56-673c2e6ab11a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e4d16400-499a-4f44-88d3-99b1b79a3a54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:18.397918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:18.398832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:18.399737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:18.399737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:18.399737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:18.399737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:18.399737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:18.399737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:18.399737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:18.399737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:18.399737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 286/578] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:18.400227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16400-499a-4f44-88d3-99b1b79a3a54 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:18.419419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:18.425529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69cf906-2401-47ec-a6db-f34f54c253d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:18.426134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cf906-2401-47ec-a6db-f34f54c253d6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:18.426406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cf906-2401-47ec-a6db-f34f54c253d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:18.426673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cf906-2401-47ec-a6db-f34f54c253d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:18.427366 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69cf906-2401-47ec-a6db-f34f54c253d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:18.427668 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69cf906-2401-47ec-a6db-f34f54c253d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:18.429092 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69cf906-2401-47ec-a6db-f34f54c253d6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:18.441127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 293/579] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:18.441946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69cf906-2401-47ec-a6db-f34f54c253d6 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:18.477398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:18.507484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16400-499a-4f44-88d3-99b1b79a3a54 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:18.540854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accad71-a317-419f-ab0e-a80a893785a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:18.541435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69cf906-2401-47ec-a6db-f34f54c253d6 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:18.541552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accad71-a317-419f-ab0e-a80a893785a0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:18.541752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accad71-a317-419f-ab0e-a80a893785a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:18.542018 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accad71-a317-419f-ab0e-a80a893785a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:18.542671 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accad71-a317-419f-ab0e-a80a893785a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:18.542970 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accad71-a317-419f-ab0e-a80a893785a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:18.544309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accad71-a317-419f-ab0e-a80a893785a0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:18.553146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 287/580] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:18.554025 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accad71-a317-419f-ab0e-a80a893785a0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:18.600199 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5cc33-2a2b-4d55-8ec9-ba40f47019e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:18.600801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5cc33-2a2b-4d55-8ec9-ba40f47019e8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:18.601081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5cc33-2a2b-4d55-8ec9-ba40f47019e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:18.601386 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5cc33-2a2b-4d55-8ec9-ba40f47019e8 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:18.602117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5cc33-2a2b-4d55-8ec9-ba40f47019e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:18.602425 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5cc33-2a2b-4d55-8ec9-ba40f47019e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:18.603863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5cc33-2a2b-4d55-8ec9-ba40f47019e8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:18.631472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 294/581] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 31 04:25:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:18.632299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5cc33-2a2b-4d55-8ec9-ba40f47019e8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:18.652426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accad71-a317-419f-ab0e-a80a893785a0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:18.684079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:18.687765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc7044-928f-40de-b525-7ab493b0fcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:18.688394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc7044-928f-40de-b525-7ab493b0fcfe None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:18.688672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc7044-928f-40de-b525-7ab493b0fcfe None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:18.688948 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc7044-928f-40de-b525-7ab493b0fcfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:18.691721 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:18.700590 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc7044-928f-40de-b525-7ab493b0fcfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:18.702034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc7044-928f-40de-b525-7ab493b0fcfe None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b3fc7044-928f-40de-b525-7ab493b0fcfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:18.716263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:18.717396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:18.718278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:18.718278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:18.718278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:18.718278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 288/582] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:18.718278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc7044-928f-40de-b525-7ab493b0fcfe None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:18.740265 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5cc33-2a2b-4d55-8ec9-ba40f47019e8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:18.774534 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c251ee9-7182-472d-afca-447a81d1c124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:18.775138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c251ee9-7182-472d-afca-447a81d1c124 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:18.775507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c251ee9-7182-472d-afca-447a81d1c124 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:18.775781 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c251ee9-7182-472d-afca-447a81d1c124 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:18.776508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c251ee9-7182-472d-afca-447a81d1c124 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:18.776812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c251ee9-7182-472d-afca-447a81d1c124 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:18.778254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c251ee9-7182-472d-afca-447a81d1c124 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:18.794637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 295/583] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:18.794637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c251ee9-7182-472d-afca-447a81d1c124 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:18.846415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc7044-928f-40de-b525-7ab493b0fcfe None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:18.880227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c8fd5-38f6-4d02-91c2-18ded9875607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:18.880832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c8fd5-38f6-4d02-91c2-18ded9875607 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:18.881106 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c8fd5-38f6-4d02-91c2-18ded9875607 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:18.881415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c8fd5-38f6-4d02-91c2-18ded9875607 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:18.882148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c8fd5-38f6-4d02-91c2-18ded9875607 None admin] RBAC: Adding query filter params (role.id=8646bae8724e4a26bb49cd7cb1d39593, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=98c52ca121d34ce6bbeb414c31f5d2fb) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:18.882458 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c8fd5-38f6-4d02-91c2-18ded9875607 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:18.883881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c8fd5-38f6-4d02-91c2-18ded9875607 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:18.889256 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 289/584] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:18 2022] GET /identity/v3/role_assignments?user.id=98c52ca121d34ce6bbeb414c31f5d2fb&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=8646bae8724e4a26bb49cd7cb1d39593 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:18.890038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c8fd5-38f6-4d02-91c2-18ded9875607 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:18.935232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c251ee9-7182-472d-afca-447a81d1c124 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:18.948475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:18.954519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:18.977691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60134a6-73ac-43b2-a1c9-eefb1a0bff71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:18.978333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60134a6-73ac-43b2-a1c9-eefb1a0bff71 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:18.978602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60134a6-73ac-43b2-a1c9-eefb1a0bff71 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:18.978867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60134a6-73ac-43b2-a1c9-eefb1a0bff71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:18.991900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60134a6-73ac-43b2-a1c9-eefb1a0bff71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:18.993405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60134a6-73ac-43b2-a1c9-eefb1a0bff71 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:19.009125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c8fd5-38f6-4d02-91c2-18ded9875607 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d60134a6-73ac-43b2-a1c9-eefb1a0bff71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:19.009400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:19.010467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:19.011385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:19.011385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:19.011385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:19.011385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 296/585] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:19.011385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60134a6-73ac-43b2-a1c9-eefb1a0bff71 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:19.055376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44978606-4269-442b-8675-475690b7a6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:19.056149 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44978606-4269-442b-8675-475690b7a6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:19.056323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44978606-4269-442b-8675-475690b7a6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:19.056700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44978606-4269-442b-8675-475690b7a6c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:19.068633 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44978606-4269-442b-8675-475690b7a6c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:19.070118 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44978606-4269-442b-8675-475690b7a6c2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-44978606-4269-442b-8675-475690b7a6c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:19.089291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:19.090341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:19.091247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:19.091247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:19.091247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:19.091247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 290/586] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:19.091247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44978606-4269-442b-8675-475690b7a6c2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:19.127899 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60134a6-73ac-43b2-a1c9-eefb1a0bff71 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:19.164446 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c862bc3-4a98-4300-ada3-cd139cdc4255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:19.165047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c862bc3-4a98-4300-ada3-cd139cdc4255 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:19.165354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c862bc3-4a98-4300-ada3-cd139cdc4255 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:19.165634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c862bc3-4a98-4300-ada3-cd139cdc4255 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:19.166393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c862bc3-4a98-4300-ada3-cd139cdc4255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:19.166713 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c862bc3-4a98-4300-ada3-cd139cdc4255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:19.168229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c862bc3-4a98-4300-ada3-cd139cdc4255 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:19.185273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 297/587] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:19.185273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c862bc3-4a98-4300-ada3-cd139cdc4255 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:19.203310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44978606-4269-442b-8675-475690b7a6c2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:19.204969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:19.211048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:19.241422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc9b7e-de22-4787-b7eb-ad45d5730146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:19.242084 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc9b7e-de22-4787-b7eb-ad45d5730146 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:19.242370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc9b7e-de22-4787-b7eb-ad45d5730146 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:19.242643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc9b7e-de22-4787-b7eb-ad45d5730146 None admin] PATH_INFO: `/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/c526760ad8a04bf486d1e7e74e9ffbe3/roles/8646bae8724e4a26bb49cd7cb1d39593` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:19.261900 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc9b7e-de22-4787-b7eb-ad45d5730146 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff768fb064ce4d53b2e46ea611d3d103, user_id=c526760ad8a04bf486d1e7e74e9ffbe3, role_id=8646bae8724e4a26bb49cd7cb1d39593)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:19.263334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc9b7e-de22-4787-b7eb-ad45d5730146 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:19.296346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c862bc3-4a98-4300-ada3-cd139cdc4255 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:19.332646 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d444c-d16d-4935-8946-6d6f96ac2ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:19.333163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d444c-d16d-4935-8946-6d6f96ac2ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:19.333463 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d444c-d16d-4935-8946-6d6f96ac2ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:19.333728 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d444c-d16d-4935-8946-6d6f96ac2ee2 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:19.334365 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d444c-d16d-4935-8946-6d6f96ac2ee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:19.334666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d444c-d16d-4935-8946-6d6f96ac2ee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:19.336097 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d444c-d16d-4935-8946-6d6f96ac2ee2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:19.343730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 291/588] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:25:19 2022] PUT /identity/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/c526760ad8a04bf486d1e7e74e9ffbe3/roles/8646bae8724e4a26bb49cd7cb1d39593 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:25:19.343730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc9b7e-de22-4787-b7eb-ad45d5730146 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:19.358447 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 298/589] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:19.359768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d444c-d16d-4935-8946-6d6f96ac2ee2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:19.469705 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:19.479496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc9b7e-de22-4787-b7eb-ad45d5730146 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:19.496051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d444c-d16d-4935-8946-6d6f96ac2ee2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:19.528280 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6f386-dbbd-4c6e-b455-a845155fb4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:19.528885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6f386-dbbd-4c6e-b455-a845155fb4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:19.529245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6f386-dbbd-4c6e-b455-a845155fb4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:19.529533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6f386-dbbd-4c6e-b455-a845155fb4d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:19.530175 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6f386-dbbd-4c6e-b455-a845155fb4d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:19.530473 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6f386-dbbd-4c6e-b455-a845155fb4d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:19.531823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6f386-dbbd-4c6e-b455-a845155fb4d7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:19.537114 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cea10-a15b-4b4a-a93d-a9d1dd38ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:19.537781 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cea10-a15b-4b4a-a93d-a9d1dd38ac44 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:19.538062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cea10-a15b-4b4a-a93d-a9d1dd38ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:19.538334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cea10-a15b-4b4a-a93d-a9d1dd38ac44 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:19.545641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 292/590] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:19.545952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6f386-dbbd-4c6e-b455-a845155fb4d7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:19.556178 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cea10-a15b-4b4a-a93d-a9d1dd38ac44 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:19.556178 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cea10-a15b-4b4a-a93d-a9d1dd38ac44 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:19.570625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-812cea10-a15b-4b4a-a93d-a9d1dd38ac44 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:19.571387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:19.572464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:19.573841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:19.573841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:19.573841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:19.573841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:19.573841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:19.573841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:19.573841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:19.573841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:19.573841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 04:25:19.573841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:19.576207 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 299/591] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:25:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:19.577540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cea10-a15b-4b4a-a93d-a9d1dd38ac44 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:19.674731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6f386-dbbd-4c6e-b455-a845155fb4d7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:19.691721 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cea10-a15b-4b4a-a93d-a9d1dd38ac44 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:19.718595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398ef49-b522-4014-9c4a-3d1c3da3b314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:19.719818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398ef49-b522-4014-9c4a-3d1c3da3b314 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:19.720378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398ef49-b522-4014-9c4a-3d1c3da3b314 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:19.720891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398ef49-b522-4014-9c4a-3d1c3da3b314 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:19.728202 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc2a51-45e2-4e7b-b940-a1aa93cba7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:19.728938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc2a51-45e2-4e7b-b940-a1aa93cba7fa None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:19.729357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc2a51-45e2-4e7b-b940-a1aa93cba7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:19.729843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc2a51-45e2-4e7b-b940-a1aa93cba7fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:19.730933 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398ef49-b522-4014-9c4a-3d1c3da3b314 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:19.732976 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398ef49-b522-4014-9c4a-3d1c3da3b314 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:19.737778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc2a51-45e2-4e7b-b940-a1aa93cba7fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:19.739327 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc2a51-45e2-4e7b-b940-a1aa93cba7fa None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:19.742081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1398ef49-b522-4014-9c4a-3d1c3da3b314 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:19.747521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:19.748625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:19.749814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:19.749814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:19.749814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:19.749814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:19.749814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:19.749814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:19.749814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:19.749814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:19.749814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 04:25:19.749814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:19.751866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 293/592] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:19.753326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398ef49-b522-4014-9c4a-3d1c3da3b314 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-a7dc2a51-45e2-4e7b-b940-a1aa93cba7fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:19.759680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:19.766539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:19.767624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:19.767624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:19.767624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:19.767624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:19.767624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:19.767624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:19.767624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:19.767624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:19.767624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 300/593] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:19.767624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc2a51-45e2-4e7b-b940-a1aa93cba7fa None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:19.862481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:19.882150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc2a51-45e2-4e7b-b940-a1aa93cba7fa None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:19.886019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398ef49-b522-4014-9c4a-3d1c3da3b314 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:19.921545 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d3b4c-3c6a-43fc-90f0-19e4d15e969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:19.922606 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d3b4c-3c6a-43fc-90f0-19e4d15e969c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:19.923126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d3b4c-3c6a-43fc-90f0-19e4d15e969c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:19.923591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d3b4c-3c6a-43fc-90f0-19e4d15e969c None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:19.925418 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d3b4c-3c6a-43fc-90f0-19e4d15e969c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:19.925992 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d3b4c-3c6a-43fc-90f0-19e4d15e969c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:19.927860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d3b4c-3c6a-43fc-90f0-19e4d15e969c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:19.928115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b381275-277a-4d85-9923-8b4227289513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:19.928716 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381275-277a-4d85-9923-8b4227289513 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:19.928989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381275-277a-4d85-9923-8b4227289513 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:19.929284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381275-277a-4d85-9923-8b4227289513 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:19.930009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b381275-277a-4d85-9923-8b4227289513 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:19.930309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b381275-277a-4d85-9923-8b4227289513 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:19.931918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b381275-277a-4d85-9923-8b4227289513 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:19.953186 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 294/594] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 31 04:25:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:19.953602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b381275-277a-4d85-9923-8b4227289513 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:19.954045 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 301/595] 10.222.0.39 () {56 vars in 1139 bytes} [Wed Aug 31 04:25:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:19.955115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d3b4c-3c6a-43fc-90f0-19e4d15e969c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:20.035519 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:20.087036 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d3b4c-3c6a-43fc-90f0-19e4d15e969c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:20.099540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b381275-277a-4d85-9923-8b4227289513 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:20.132975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a958ce-1a71-47bd-8ae8-f08efd65457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:20.133865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a958ce-1a71-47bd-8ae8-f08efd65457e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:20.134165 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a958ce-1a71-47bd-8ae8-f08efd65457e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:20.134805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a958ce-1a71-47bd-8ae8-f08efd65457e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:20.136782 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:20.143835 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9211b68-87dd-493b-bccc-d6d684b7d368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:20.145116 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9211b68-87dd-493b-bccc-d6d684b7d368 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:20.145497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9211b68-87dd-493b-bccc-d6d684b7d368 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:20.145829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9211b68-87dd-493b-bccc-d6d684b7d368 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:20.151047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9211b68-87dd-493b-bccc-d6d684b7d368 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:20.151047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9211b68-87dd-493b-bccc-d6d684b7d368 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:20.151230 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a958ce-1a71-47bd-8ae8-f08efd65457e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:20.151366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9211b68-87dd-493b-bccc-d6d684b7d368 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:20.151482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a958ce-1a71-47bd-8ae8-f08efd65457e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:20.164220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 295/596] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:20.165160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9211b68-87dd-493b-bccc-d6d684b7d368 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d1a958ce-1a71-47bd-8ae8-f08efd65457e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:20.170739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:20.171799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:20.172671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:20.172671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:20.172671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:20.174410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 302/597] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:20.175349 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a958ce-1a71-47bd-8ae8-f08efd65457e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:20.290724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a958ce-1a71-47bd-8ae8-f08efd65457e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:20.305674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9211b68-87dd-493b-bccc-d6d684b7d368 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:20.308639 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:20.336329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73dd8f-3ff8-4a31-ad00-cc6cd077e1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:20.337612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73dd8f-3ff8-4a31-ad00-cc6cd077e1b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:20.338314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73dd8f-3ff8-4a31-ad00-cc6cd077e1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:20.338764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73dd8f-3ff8-4a31-ad00-cc6cd077e1b2 None admin] PATH_INFO: `/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/4877b72a6cea410dbb31a35c7acbd5f9/roles/8646bae8724e4a26bb49cd7cb1d39593` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:20.348075 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3242163-46ff-4be9-9798-225023ba18b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:20.348793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242163-46ff-4be9-9798-225023ba18b2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:20.349140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242163-46ff-4be9-9798-225023ba18b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:20.349510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242163-46ff-4be9-9798-225023ba18b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:20.363920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3242163-46ff-4be9-9798-225023ba18b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:20.365458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73dd8f-3ff8-4a31-ad00-cc6cd077e1b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff768fb064ce4d53b2e46ea611d3d103, user_id=4877b72a6cea410dbb31a35c7acbd5f9, role_id=8646bae8724e4a26bb49cd7cb1d39593)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:20.365597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3242163-46ff-4be9-9798-225023ba18b2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:20.367696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73dd8f-3ff8-4a31-ad00-cc6cd077e1b2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c3242163-46ff-4be9-9798-225023ba18b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:20.381616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:20.387174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:20.388251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:20.388251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:20.388251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:20.388251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 296/598] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:20.388251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3242163-46ff-4be9-9798-225023ba18b2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:20.432707 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:20.497523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 303/599] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:25:20 2022] PUT /identity/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/4877b72a6cea410dbb31a35c7acbd5f9/roles/8646bae8724e4a26bb49cd7cb1d39593 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:25:20.498969 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73dd8f-3ff8-4a31-ad00-cc6cd077e1b2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:20.503710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3242163-46ff-4be9-9798-225023ba18b2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:20.568858 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aaff1-2566-42e5-a54a-e590b6eca7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:20.569545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aaff1-2566-42e5-a54a-e590b6eca7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:20.569820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aaff1-2566-42e5-a54a-e590b6eca7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:20.570087 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aaff1-2566-42e5-a54a-e590b6eca7f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:20.570750 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40aaff1-2566-42e5-a54a-e590b6eca7f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:20.571047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40aaff1-2566-42e5-a54a-e590b6eca7f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:20.572455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40aaff1-2566-42e5-a54a-e590b6eca7f2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:20.602785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 297/600] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:20.609276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aaff1-2566-42e5-a54a-e590b6eca7f2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:20.664774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73dd8f-3ff8-4a31-ad00-cc6cd077e1b2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:20.701995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e605c9-e453-4a4c-ac37-32138d8d0cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:20.702990 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e605c9-e453-4a4c-ac37-32138d8d0cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:20.703474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e605c9-e453-4a4c-ac37-32138d8d0cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:20.703939 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e605c9-e453-4a4c-ac37-32138d8d0cb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:20.704820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e605c9-e453-4a4c-ac37-32138d8d0cb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:20.705489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e605c9-e453-4a4c-ac37-32138d8d0cb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:20.707142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e605c9-e453-4a4c-ac37-32138d8d0cb1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:20.719671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 304/601] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:20.726252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e605c9-e453-4a4c-ac37-32138d8d0cb1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:20.750895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:20.782854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aaff1-2566-42e5-a54a-e590b6eca7f2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:20.786013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:20.832185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3d6d9-76fb-4f80-b79b-094d67cacc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:20.833340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3d6d9-76fb-4f80-b79b-094d67cacc15 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:20.833870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3d6d9-76fb-4f80-b79b-094d67cacc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:20.834360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3d6d9-76fb-4f80-b79b-094d67cacc15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:20.841717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3d6d9-76fb-4f80-b79b-094d67cacc15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:20.843602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3d6d9-76fb-4f80-b79b-094d67cacc15 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-79a3d6d9-76fb-4f80-b79b-094d67cacc15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:20.859343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:20.860302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:20.861240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:20.861240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:20.861240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:20.861240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:20.861240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:20.861240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:20.861240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:20.861240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:20.861240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 298/602] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:20.862776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2c675-2bf3-4952-8b75-13bec09677f6 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:20.862776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2c675-2bf3-4952-8b75-13bec09677f6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:20.862776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2c675-2bf3-4952-8b75-13bec09677f6 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:20.869288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e605c9-e453-4a4c-ac37-32138d8d0cb1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:20.869426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 299/603] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:20.869426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f7831-a8d9-42de-81d7-f51544efcf02 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:20.869683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f7831-a8d9-42de-81d7-f51544efcf02 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:20.870205 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f7831-a8d9-42de-81d7-f51544efcf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:20.888566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3d2f7831-a8d9-42de-81d7-f51544efcf02 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:20.889797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3d2f7831-a8d9-42de-81d7-f51544efcf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:20.915036 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4a53a-8d98-475f-8b5f-1c5422283543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:20.916242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4a53a-8d98-475f-8b5f-1c5422283543 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:20.917069 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4a53a-8d98-475f-8b5f-1c5422283543 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:20.917836 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4a53a-8d98-475f-8b5f-1c5422283543 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:20.928302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4a53a-8d98-475f-8b5f-1c5422283543 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:20.930964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4a53a-8d98-475f-8b5f-1c5422283543 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-f5d4a53a-8d98-475f-8b5f-1c5422283543 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:20.946822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:20.947773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:20.948685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:20.948685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:20.948685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:20.948685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:20.948685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:20.948685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:20.948685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:20.948685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:20.948685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 305/604] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:20.951636 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4a53a-8d98-475f-8b5f-1c5422283543 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:20.975934 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 300/605] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:25:20.977220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f7831-a8d9-42de-81d7-f51544efcf02 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:21.080056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:21.095546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f7831-a8d9-42de-81d7-f51544efcf02 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:21.099343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:21.130175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4a53a-8d98-475f-8b5f-1c5422283543 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:21.139818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa871b-b58c-48ea-8ec4-77f179a162a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:21.143969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa871b-b58c-48ea-8ec4-77f179a162a1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:21.143969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa871b-b58c-48ea-8ec4-77f179a162a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:21.143969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa871b-b58c-48ea-8ec4-77f179a162a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:21.143969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa871b-b58c-48ea-8ec4-77f179a162a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:21.143969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa871b-b58c-48ea-8ec4-77f179a162a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:21.143969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa871b-b58c-48ea-8ec4-77f179a162a1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:21.167152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec0cf4-ff64-4e72-ab88-dc99415ae716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:21.167840 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 301/606] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:21.167956 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec0cf4-ff64-4e72-ab88-dc99415ae716 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:21.168134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec0cf4-ff64-4e72-ab88-dc99415ae716 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:21.168371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec0cf4-ff64-4e72-ab88-dc99415ae716 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:21.169154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec0cf4-ff64-4e72-ab88-dc99415ae716 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:21.169492 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec0cf4-ff64-4e72-ab88-dc99415ae716 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:21.170914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec0cf4-ff64-4e72-ab88-dc99415ae716 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:21.173370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa871b-b58c-48ea-8ec4-77f179a162a1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:21.183305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 306/607] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:21.189010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec0cf4-ff64-4e72-ab88-dc99415ae716 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:21.293232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec0cf4-ff64-4e72-ab88-dc99415ae716 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:21.328106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f40a7-ce5b-49c0-9e5f-73d37a0db42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:21.328766 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f40a7-ce5b-49c0-9e5f-73d37a0db42c None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:21.329047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f40a7-ce5b-49c0-9e5f-73d37a0db42c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:21.329373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f40a7-ce5b-49c0-9e5f-73d37a0db42c None admin] PATH_INFO: `/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/2c63e7e4105b41d1abfe58bf13c6125d/roles/8646bae8724e4a26bb49cd7cb1d39593` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:21.335595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa871b-b58c-48ea-8ec4-77f179a162a1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:21.367639 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:21.375236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f40a7-ce5b-49c0-9e5f-73d37a0db42c None admin] RBAC: Authorizing `identity:create_grant(project_id=ff768fb064ce4d53b2e46ea611d3d103, user_id=2c63e7e4105b41d1abfe58bf13c6125d, role_id=8646bae8724e4a26bb49cd7cb1d39593)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:21.376708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f40a7-ce5b-49c0-9e5f-73d37a0db42c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:21.400690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f98205-4b42-4d06-a2e6-622b68f5643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:21.401411 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f98205-4b42-4d06-a2e6-622b68f5643b None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:21.401811 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f98205-4b42-4d06-a2e6-622b68f5643b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:21.401811 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f98205-4b42-4d06-a2e6-622b68f5643b None admin] PATH_INFO: `/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/4455f4e327184c69aead4a7ae9737961/roles/8646bae8724e4a26bb49cd7cb1d39593` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:21.422012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f98205-4b42-4d06-a2e6-622b68f5643b None admin] RBAC: Authorizing `identity:create_grant(project_id=ff768fb064ce4d53b2e46ea611d3d103, user_id=4455f4e327184c69aead4a7ae9737961, role_id=8646bae8724e4a26bb49cd7cb1d39593)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:21.423549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f98205-4b42-4d06-a2e6-622b68f5643b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:21.503420 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 307/608] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:25:21 2022] PUT /identity/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/2c63e7e4105b41d1abfe58bf13c6125d/roles/8646bae8724e4a26bb49cd7cb1d39593 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:25:21.504663 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b2e73-de80-4628-849b-703682eb9e2a None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:21.504946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b2e73-de80-4628-849b-703682eb9e2a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:21.505239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b2e73-de80-4628-849b-703682eb9e2a None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:21.506612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 308/609] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:21.511447 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b2e73-de80-4628-849b-703682eb9e2a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:21.546251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 302/610] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:25:21 2022] PUT /identity/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/4455f4e327184c69aead4a7ae9737961/roles/8646bae8724e4a26bb49cd7cb1d39593 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:25:21.548786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846e98c-254f-465a-984c-8e4bc5addfc1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:21.550447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846e98c-254f-465a-984c-8e4bc5addfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:21.551330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846e98c-254f-465a-984c-8e4bc5addfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:21.562909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:21.584900 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f846e98c-254f-465a-984c-8e4bc5addfc1 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:21.587979 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f846e98c-254f-465a-984c-8e4bc5addfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:21.701004 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b2e73-de80-4628-849b-703682eb9e2a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:21.725443 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 303/611] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:21.749263 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e3816-69ce-41f9-810a-e41d494bbdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:21.750359 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e3816-69ce-41f9-810a-e41d494bbdd3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:21.750842 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e3816-69ce-41f9-810a-e41d494bbdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:21.751313 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e3816-69ce-41f9-810a-e41d494bbdd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:21.767266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e3816-69ce-41f9-810a-e41d494bbdd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-294e3816-69ce-41f9-810a-e41d494bbdd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:21.773334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:21.779904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:21.780801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:21.780801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:21.780801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:21.780801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:21.780801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:21.780801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:21.780801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:21.780801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:21.780801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:21.780801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:21.780801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:21.780801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:21.780801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 309/612] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:21.784075 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846e98c-254f-465a-984c-8e4bc5addfc1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:21.947892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846e98c-254f-465a-984c-8e4bc5addfc1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:22.003020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:22.012607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b9c47-a463-4a72-a9dc-ddd339ed4ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:22.014288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b9c47-a463-4a72-a9dc-ddd339ed4ebb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:22.014288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b9c47-a463-4a72-a9dc-ddd339ed4ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:22.014288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b9c47-a463-4a72-a9dc-ddd339ed4ebb None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:22.014729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b9c47-a463-4a72-a9dc-ddd339ed4ebb None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:22.015092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b9c47-a463-4a72-a9dc-ddd339ed4ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:22.016966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b9c47-a463-4a72-a9dc-ddd339ed4ebb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:22.035315 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 304/613] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:22.041729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e3816-69ce-41f9-810a-e41d494bbdd3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:22.106566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b9c47-a463-4a72-a9dc-ddd339ed4ebb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:22.121611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:22.188657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e3816-69ce-41f9-810a-e41d494bbdd3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:22.233354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94182000-378e-4487-8165-1819faab13d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:22.234540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94182000-378e-4487-8165-1819faab13d3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:22.235122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94182000-378e-4487-8165-1819faab13d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:22.235722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94182000-378e-4487-8165-1819faab13d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:22.251954 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94182000-378e-4487-8165-1819faab13d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:22.254416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94182000-378e-4487-8165-1819faab13d3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-94182000-378e-4487-8165-1819faab13d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:22.272491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:22.274820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:22.275769 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:22.275769 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:22.275769 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:22.276657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 310/614] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:22.282777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94182000-378e-4487-8165-1819faab13d3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:22.404782 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b9c47-a463-4a72-a9dc-ddd339ed4ebb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:22.471939 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94182000-378e-4487-8165-1819faab13d3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:22.474842 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:22.492199 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f11c5-07e0-409b-9fa2-1b6c5e0211ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:22.492846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f11c5-07e0-409b-9fa2-1b6c5e0211ea None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:22.493120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f11c5-07e0-409b-9fa2-1b6c5e0211ea None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:22.493414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f11c5-07e0-409b-9fa2-1b6c5e0211ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:22.511831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f11c5-07e0-409b-9fa2-1b6c5e0211ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-585f11c5-07e0-409b-9fa2-1b6c5e0211ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:22.520394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:22.521709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:22.522563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:22.522563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:22.522563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:22.522563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:22.522563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:22.522563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:22.522563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:22.522563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:22.522563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:22.522563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:22.522563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:22.522563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:22.522563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 305/615] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:22.532106 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f11c5-07e0-409b-9fa2-1b6c5e0211ea None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:22.549970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e23d5-ae31-4d20-991b-04239ae2ec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:22.550585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e23d5-ae31-4d20-991b-04239ae2ec2d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:22.550862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e23d5-ae31-4d20-991b-04239ae2ec2d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:22.551131 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e23d5-ae31-4d20-991b-04239ae2ec2d None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:22.551787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e23d5-ae31-4d20-991b-04239ae2ec2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:22.552086 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e23d5-ae31-4d20-991b-04239ae2ec2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:22.553485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e23d5-ae31-4d20-991b-04239ae2ec2d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:22.566467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 311/616] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:22.571480 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e23d5-ae31-4d20-991b-04239ae2ec2d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:22.667289 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:22.679818 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e23d5-ae31-4d20-991b-04239ae2ec2d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:22.718207 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02af109-1740-409d-b127-f82d00a3e752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:22.719253 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02af109-1740-409d-b127-f82d00a3e752 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:22.719732 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02af109-1740-409d-b127-f82d00a3e752 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:22.720225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02af109-1740-409d-b127-f82d00a3e752 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:22.729640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02af109-1740-409d-b127-f82d00a3e752 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:22.731321 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02af109-1740-409d-b127-f82d00a3e752 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-a02af109-1740-409d-b127-f82d00a3e752 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:22.743470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:22.744432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:22.745796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:22.745796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:22.745796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:22.745796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:22.745796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:22.745796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:22.745796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:22.745796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:22.745796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 04:25:22.745796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:22.748163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 312/617] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:25:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:22.751327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f11c5-07e0-409b-9fa2-1b6c5e0211ea None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:22.753843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02af109-1740-409d-b127-f82d00a3e752 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:22.813573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:22.834737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a612bb6-e829-42b5-bcef-7a8d82eb558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:22.835405 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a612bb6-e829-42b5-bcef-7a8d82eb558f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:22.835683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a612bb6-e829-42b5-bcef-7a8d82eb558f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:22.835941 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a612bb6-e829-42b5-bcef-7a8d82eb558f None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:22.836604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a612bb6-e829-42b5-bcef-7a8d82eb558f None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:22.836962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a612bb6-e829-42b5-bcef-7a8d82eb558f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:22.838360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a612bb6-e829-42b5-bcef-7a8d82eb558f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:22.852361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 306/618] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:22.854558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a612bb6-e829-42b5-bcef-7a8d82eb558f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:22.968874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a612bb6-e829-42b5-bcef-7a8d82eb558f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:22.988139 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:23.009236 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0ab37-72cb-4343-8873-08bd2807a1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:23.010213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ab37-72cb-4343-8873-08bd2807a1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:23.010498 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ab37-72cb-4343-8873-08bd2807a1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:23.010770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ab37-72cb-4343-8873-08bd2807a1c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:23.023379 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0ab37-72cb-4343-8873-08bd2807a1c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:23.024961 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0ab37-72cb-4343-8873-08bd2807a1c8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:23.036021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02af109-1740-409d-b127-f82d00a3e752 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6cc0ab37-72cb-4343-8873-08bd2807a1c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:23.042311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:23.043347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:23.044271 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:23.044271 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:23.044271 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:23.049504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 307/619] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:23.051754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0ab37-72cb-4343-8873-08bd2807a1c8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:23.145291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af611ab-1a02-44df-9b0a-827101b4c2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:23.145815 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af611ab-1a02-44df-9b0a-827101b4c2dd None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:23.146096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af611ab-1a02-44df-9b0a-827101b4c2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:23.146626 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af611ab-1a02-44df-9b0a-827101b4c2dd None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:23.147375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af611ab-1a02-44df-9b0a-827101b4c2dd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:23.147684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af611ab-1a02-44df-9b0a-827101b4c2dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:23.149270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af611ab-1a02-44df-9b0a-827101b4c2dd None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:23.169890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 313/620] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 31 04:25:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:23.170682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0ab37-72cb-4343-8873-08bd2807a1c8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:23.171129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96838e6-4125-4604-b9e6-0a64f5192729 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:23.171420 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96838e6-4125-4604-b9e6-0a64f5192729 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:23.171702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96838e6-4125-4604-b9e6-0a64f5192729 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:23.177785 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 314/621] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:23.181776 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96838e6-4125-4604-b9e6-0a64f5192729 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:23.217421 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d0c80-d059-44a3-86f8-d8658d0ea32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:23.218301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d0c80-d059-44a3-86f8-d8658d0ea32e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:23.218754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d0c80-d059-44a3-86f8-d8658d0ea32e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:23.219196 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d0c80-d059-44a3-86f8-d8658d0ea32e None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:23.220026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d0c80-d059-44a3-86f8-d8658d0ea32e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:23.220501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d0c80-d059-44a3-86f8-d8658d0ea32e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:23.222679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d0c80-d059-44a3-86f8-d8658d0ea32e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:23.238491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 308/622] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:23.239892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db786-7b1a-46ed-9606-6f028fa89fc7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:23.240347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db786-7b1a-46ed-9606-6f028fa89fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:23.240814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db786-7b1a-46ed-9606-6f028fa89fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:23.262486 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-397db786-7b1a-46ed-9606-6f028fa89fc7 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:23.264295 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-397db786-7b1a-46ed-9606-6f028fa89fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:23.270378 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:23.291661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96838e6-4125-4604-b9e6-0a64f5192729 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:23.296251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:23.335297 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807d49f-ec39-47ad-bdb6-71cda6e3423b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:23.335939 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807d49f-ec39-47ad-bdb6-71cda6e3423b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:23.338157 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807d49f-ec39-47ad-bdb6-71cda6e3423b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:23.338566 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807d49f-ec39-47ad-bdb6-71cda6e3423b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:23.357443 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 309/623] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:23.359186 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397db786-7b1a-46ed-9606-6f028fa89fc7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:23.360852 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807d49f-ec39-47ad-bdb6-71cda6e3423b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:23.362642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807d49f-ec39-47ad-bdb6-71cda6e3423b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-0807d49f-ec39-47ad-bdb6-71cda6e3423b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:23.391512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:23.392543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:23.394009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:23.394009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:23.394009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:23.394182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 315/624] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:23.400709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807d49f-ec39-47ad-bdb6-71cda6e3423b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:23.554035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397db786-7b1a-46ed-9606-6f028fa89fc7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:23.596615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807d49f-ec39-47ad-bdb6-71cda6e3423b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:23.624263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955e99d-c4e3-4bfc-8921-8c5c38b5ccae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:23.624896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955e99d-c4e3-4bfc-8921-8c5c38b5ccae None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:23.625167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955e99d-c4e3-4bfc-8921-8c5c38b5ccae None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:23.625456 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955e99d-c4e3-4bfc-8921-8c5c38b5ccae None admin] PATH_INFO: `/v3/users/glance` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:23.639390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955e99d-c4e3-4bfc-8921-8c5c38b5ccae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:23.640825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955e99d-c4e3-4bfc-8921-8c5c38b5ccae None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:23.658028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:23.665816 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bc095-7d08-4b13-a955-10edc9c95c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:23.666429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bc095-7d08-4b13-a955-10edc9c95c40 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:23.666704 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bc095-7d08-4b13-a955-10edc9c95c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:23.668022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bc095-7d08-4b13-a955-10edc9c95c40 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:23.668022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bc095-7d08-4b13-a955-10edc9c95c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:23.668022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bc095-7d08-4b13-a955-10edc9c95c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:23.669369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bc095-7d08-4b13-a955-10edc9c95c40 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4955e99d-c4e3-4bfc-8921-8c5c38b5ccae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:23.672221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:23.673211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:23.674859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:23.674859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:23.674859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:23.674859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:23.674859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:23.674859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:23.674859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:23.674859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:23.674859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 04:25:23.674859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:23.680667 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 310/625] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:25:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:23.682285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955e99d-c4e3-4bfc-8921-8c5c38b5ccae None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:23.697386 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 316/626] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:23.701290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bc095-7d08-4b13-a955-10edc9c95c40 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:23.715949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:23.824670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955e99d-c4e3-4bfc-8921-8c5c38b5ccae None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:23.828804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bc095-7d08-4b13-a955-10edc9c95c40 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:23.871735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef223ca-5b0e-4b43-b23c-79627b697a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:23.872563 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef223ca-5b0e-4b43-b23c-79627b697a8f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:23.872897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef223ca-5b0e-4b43-b23c-79627b697a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:23.873363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef223ca-5b0e-4b43-b23c-79627b697a8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:23.875943 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910410ea-832f-4537-91ce-5b4c52c1fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:23.877155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910410ea-832f-4537-91ce-5b4c52c1fcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:23.877661 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910410ea-832f-4537-91ce-5b4c52c1fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:23.878130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910410ea-832f-4537-91ce-5b4c52c1fcf0 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:23.879097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910410ea-832f-4537-91ce-5b4c52c1fcf0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:23.879859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910410ea-832f-4537-91ce-5b4c52c1fcf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:23.881805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910410ea-832f-4537-91ce-5b4c52c1fcf0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:23.886295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef223ca-5b0e-4b43-b23c-79627b697a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2ef223ca-5b0e-4b43-b23c-79627b697a8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:23.891613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:23.892548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:23.894132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:23.894132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:23.894132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:23.894132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:23.894132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:23.894132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:23.894132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:23.894132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:23.894132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:23.894132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:23.894132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:23.894132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:23.894132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 317/627] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:23.894839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef223ca-5b0e-4b43-b23c-79627b697a8f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:23.911773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 311/628] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 31 04:25:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:23.912876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910410ea-832f-4537-91ce-5b4c52c1fcf0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:23.969115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:24.001629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:24.024988 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910410ea-832f-4537-91ce-5b4c52c1fcf0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:24.027136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef223ca-5b0e-4b43-b23c-79627b697a8f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:24.060037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d93eb-ca6f-48de-a609-9b0cafad081e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:24.060646 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d93eb-ca6f-48de-a609-9b0cafad081e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:24.060925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d93eb-ca6f-48de-a609-9b0cafad081e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:24.061214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d93eb-ca6f-48de-a609-9b0cafad081e None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:24.061880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d93eb-ca6f-48de-a609-9b0cafad081e None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:24.062183 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d93eb-ca6f-48de-a609-9b0cafad081e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:24.063545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d93eb-ca6f-48de-a609-9b0cafad081e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:24.064240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec08acf-ce32-4465-bc3f-a8477eee92aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:24.065508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec08acf-ce32-4465-bc3f-a8477eee92aa None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:24.065790 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec08acf-ce32-4465-bc3f-a8477eee92aa None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:24.066061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec08acf-ce32-4465-bc3f-a8477eee92aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:24.072531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 312/629] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:24.072843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec08acf-ce32-4465-bc3f-a8477eee92aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:24.073230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d93eb-ca6f-48de-a609-9b0cafad081e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:24.074332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec08acf-ce32-4465-bc3f-a8477eee92aa None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-4ec08acf-ce32-4465-bc3f-a8477eee92aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:24.085885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:24.086968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:24.087881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:24.087881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:24.087881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:24.087881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:24.087881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:24.087881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:24.087881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:24.087881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:24.087881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 318/630] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:24.088388 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcf887-ebef-4272-b560-b91e12fb6970 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:24.088388 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcf887-ebef-4272-b560-b91e12fb6970 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:24.088663 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcf887-ebef-4272-b560-b91e12fb6970 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:24.089895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 319/631] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:24.090904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcdba9-bd49-4aaa-a1d9-3265810916b6 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:24.091185 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcdba9-bd49-4aaa-a1d9-3265810916b6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:24.091681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcdba9-bd49-4aaa-a1d9-3265810916b6 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:24.092628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 320/632] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:24.093331 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcdba9-bd49-4aaa-a1d9-3265810916b6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:24.182195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d93eb-ca6f-48de-a609-9b0cafad081e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:24.194472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcdba9-bd49-4aaa-a1d9-3265810916b6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:24.207601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:24.216370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba80774-6df1-4e70-aadd-b76043c10365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:24.217259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba80774-6df1-4e70-aadd-b76043c10365 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:24.217371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba80774-6df1-4e70-aadd-b76043c10365 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:24.217647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba80774-6df1-4e70-aadd-b76043c10365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:24.226321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:24.227665 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2cb9c-dd06-4bca-ad10-62789ae68f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:24.228279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2cb9c-dd06-4bca-ad10-62789ae68f84 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:24.228621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2cb9c-dd06-4bca-ad10-62789ae68f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:24.228892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2cb9c-dd06-4bca-ad10-62789ae68f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:24.240181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2cb9c-dd06-4bca-ad10-62789ae68f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:24.241673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2cb9c-dd06-4bca-ad10-62789ae68f84 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-9fa2cb9c-dd06-4bca-ad10-62789ae68f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:24.256607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:24.257643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:24.258553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:24.258553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:24.258553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:24.258553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 321/633] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:24.258553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2cb9c-dd06-4bca-ad10-62789ae68f84 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:24.294430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba80774-6df1-4e70-aadd-b76043c10365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:24.295885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba80774-6df1-4e70-aadd-b76043c10365 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:24.366510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2cb9c-dd06-4bca-ad10-62789ae68f84 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:24.400161 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd063fb2-1c34-46d3-8ffa-0821a07c63b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:24.400760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063fb2-1c34-46d3-8ffa-0821a07c63b4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:24.401040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063fb2-1c34-46d3-8ffa-0821a07c63b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:24.406622 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 313/634] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:25:24.406812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063fb2-1c34-46d3-8ffa-0821a07c63b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:24.406812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd063fb2-1c34-46d3-8ffa-0821a07c63b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:24.406812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd063fb2-1c34-46d3-8ffa-0821a07c63b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:24.407115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330afd77-3c79-49e0-af99-ddd074dca683 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:24.407115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330afd77-3c79-49e0-af99-ddd074dca683 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:24.407115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330afd77-3c79-49e0-af99-ddd074dca683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:24.407342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd063fb2-1c34-46d3-8ffa-0821a07c63b4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:24.421067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-330afd77-3c79-49e0-af99-ddd074dca683 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:24.421619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 322/635] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:24.422306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-330afd77-3c79-49e0-af99-ddd074dca683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:24.423121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb72f0f-3eef-42f9-9917-d9e55d613598 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:24.423411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb72f0f-3eef-42f9-9917-d9e55d613598 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:24.423685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb72f0f-3eef-42f9-9917-d9e55d613598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:24.441485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3bb72f0f-3eef-42f9-9917-d9e55d613598 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:24.442570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3bb72f0f-3eef-42f9-9917-d9e55d613598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:24.454623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:24.459903 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:24.492228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 314/636] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:24.493051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330afd77-3c79-49e0-af99-ddd074dca683 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:24.519304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 323/637] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:24.520660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb72f0f-3eef-42f9-9917-d9e55d613598 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:24.603452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330afd77-3c79-49e0-af99-ddd074dca683 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:24.639664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94288a21-1998-4e8b-a02a-a6a5a09bd943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:24.640430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94288a21-1998-4e8b-a02a-a6a5a09bd943 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:24.640708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94288a21-1998-4e8b-a02a-a6a5a09bd943 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:24.640976 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94288a21-1998-4e8b-a02a-a6a5a09bd943 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:24.641708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94288a21-1998-4e8b-a02a-a6a5a09bd943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:24.642008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94288a21-1998-4e8b-a02a-a6a5a09bd943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:24.643891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94288a21-1998-4e8b-a02a-a6a5a09bd943 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:24.657098 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 315/638] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:24.657773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94288a21-1998-4e8b-a02a-a6a5a09bd943 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:24.660021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb72f0f-3eef-42f9-9917-d9e55d613598 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:24.689586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:24.715946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82a6f2-3c98-41e9-b1b7-38d87402b19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:24.715946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82a6f2-3c98-41e9-b1b7-38d87402b19a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:24.715946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82a6f2-3c98-41e9-b1b7-38d87402b19a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:24.715946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82a6f2-3c98-41e9-b1b7-38d87402b19a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:24.725348 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82a6f2-3c98-41e9-b1b7-38d87402b19a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:24.726932 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82a6f2-3c98-41e9-b1b7-38d87402b19a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-bb82a6f2-3c98-41e9-b1b7-38d87402b19a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:24.749511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:24.750526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:24.751455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:24.751455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:24.751455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:24.754047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 324/639] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:24.755053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82a6f2-3c98-41e9-b1b7-38d87402b19a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:24.768372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94288a21-1998-4e8b-a02a-a6a5a09bd943 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:24.769047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:24.805363 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc460b-6d63-45ec-a513-33acf5f31389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:24.805985 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc460b-6d63-45ec-a513-33acf5f31389 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:24.806263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc460b-6d63-45ec-a513-33acf5f31389 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:24.806536 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc460b-6d63-45ec-a513-33acf5f31389 None admin] PATH_INFO: `/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/98c52ca121d34ce6bbeb414c31f5d2fb/roles/8646bae8724e4a26bb49cd7cb1d39593` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:24.822193 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc460b-6d63-45ec-a513-33acf5f31389 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff768fb064ce4d53b2e46ea611d3d103, user_id=98c52ca121d34ce6bbeb414c31f5d2fb, role_id=8646bae8724e4a26bb49cd7cb1d39593)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:24.823632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc460b-6d63-45ec-a513-33acf5f31389 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:24.863982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82a6f2-3c98-41e9-b1b7-38d87402b19a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:24.880050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 316/640] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:25:24 2022] PUT /identity/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/98c52ca121d34ce6bbeb414c31f5d2fb/roles/8646bae8724e4a26bb49cd7cb1d39593 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:25:24.880887 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc460b-6d63-45ec-a513-33acf5f31389 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:24.907484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1976e-f7b3-49b9-b1d2-0347ebd6d14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:24.908195 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1976e-f7b3-49b9-b1d2-0347ebd6d14d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:24.908552 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1976e-f7b3-49b9-b1d2-0347ebd6d14d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:24.908834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1976e-f7b3-49b9-b1d2-0347ebd6d14d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:24.917378 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1976e-f7b3-49b9-b1d2-0347ebd6d14d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:24.918876 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1976e-f7b3-49b9-b1d2-0347ebd6d14d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-10d1976e-f7b3-49b9-b1d2-0347ebd6d14d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:24.931573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:24.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:24.934015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:24.934015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:24.934015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:24.934015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:24.934015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:24.934015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:24.934015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:24.934015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:24.934015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:25:24.934015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:24.934015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 325/641] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 31 04:25:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:24.934015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1976e-f7b3-49b9-b1d2-0347ebd6d14d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:24.983222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:25.006828 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc460b-6d63-45ec-a513-33acf5f31389 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:25.008187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:25.048356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1976e-f7b3-49b9-b1d2-0347ebd6d14d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:25.050298 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6f447-3e62-44f8-9ca2-cfe7620a31b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:25.050952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6f447-3e62-44f8-9ca2-cfe7620a31b8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:25.051212 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6f447-3e62-44f8-9ca2-cfe7620a31b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:25.051483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6f447-3e62-44f8-9ca2-cfe7620a31b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:25.052126 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6f447-3e62-44f8-9ca2-cfe7620a31b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:25.052427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6f447-3e62-44f8-9ca2-cfe7620a31b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:25.053895 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6f447-3e62-44f8-9ca2-cfe7620a31b8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:25.066091 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 317/642] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:25.066751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6f447-3e62-44f8-9ca2-cfe7620a31b8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:25.099916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5da865-2402-478b-b965-a8a71e5ea04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:25.100852 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5da865-2402-478b-b965-a8a71e5ea04c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:25.101135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5da865-2402-478b-b965-a8a71e5ea04c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:25.101686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5da865-2402-478b-b965-a8a71e5ea04c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:25.114567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5da865-2402-478b-b965-a8a71e5ea04c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-ce5da865-2402-478b-b965-a8a71e5ea04c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:25.122677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:25.123720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:25.130256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:25.130256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:25.130256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:25.130256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:25.130256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:25.130256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:25.130256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:25.130256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:25.130256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:25.130256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:25.130256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:25.130256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:25.130256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 326/643] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:25.130256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5da865-2402-478b-b965-a8a71e5ea04c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:25.173425 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6f447-3e62-44f8-9ca2-cfe7620a31b8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:25.210713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc3762-5b9c-4a80-ad5f-deeae67dc0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:25.212051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc3762-5b9c-4a80-ad5f-deeae67dc0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:25.212521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc3762-5b9c-4a80-ad5f-deeae67dc0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:25.213335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc3762-5b9c-4a80-ad5f-deeae67dc0d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:25.223608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:25.229403 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc3762-5b9c-4a80-ad5f-deeae67dc0d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-75dc3762-5b9c-4a80-ad5f-deeae67dc0d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:25.238841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:25.239790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:25.240682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:25.240682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:25.240682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:25.240682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:25.240682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:25.240682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:25.240682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:25.240682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:25.240682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:25.240682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:25.240682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:25.240682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:25.241458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5da865-2402-478b-b965-a8a71e5ea04c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:25.241960 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 318/644] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:25.241960 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc3762-5b9c-4a80-ad5f-deeae67dc0d6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:25.265804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:25.274875 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1771623-9096-4b60-9e36-13f64f0b7488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:25.275486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771623-9096-4b60-9e36-13f64f0b7488 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:25.275767 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771623-9096-4b60-9e36-13f64f0b7488 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:25.277929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771623-9096-4b60-9e36-13f64f0b7488 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:25.277929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1771623-9096-4b60-9e36-13f64f0b7488 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:25.277929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1771623-9096-4b60-9e36-13f64f0b7488 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:25.278505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1771623-9096-4b60-9e36-13f64f0b7488 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:25.296153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 327/645] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 31 04:25:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:25.297025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1771623-9096-4b60-9e36-13f64f0b7488 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:25.353706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc3762-5b9c-4a80-ad5f-deeae67dc0d6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:25.390700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610ca48-e5be-441a-a07d-0f9ee21242cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:25.391711 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610ca48-e5be-441a-a07d-0f9ee21242cd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:25.392184 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610ca48-e5be-441a-a07d-0f9ee21242cd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:25.392670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610ca48-e5be-441a-a07d-0f9ee21242cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:25.400099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610ca48-e5be-441a-a07d-0f9ee21242cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:25.402050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610ca48-e5be-441a-a07d-0f9ee21242cd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:25.404103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1771623-9096-4b60-9e36-13f64f0b7488 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f610ca48-e5be-441a-a07d-0f9ee21242cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:25.413444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:25.414361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:25.415332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:25.415332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:25.415332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:25.415332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:25.415332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:25.415332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:25.415332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:25.415332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:25.415332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 319/646] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:25.415829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610ca48-e5be-441a-a07d-0f9ee21242cd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:25.446755 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083a029-9b13-47a4-9100-3e417b9d3b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:25.447739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083a029-9b13-47a4-9100-3e417b9d3b4e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:25.448256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083a029-9b13-47a4-9100-3e417b9d3b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:25.448685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083a029-9b13-47a4-9100-3e417b9d3b4e None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:25.449533 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083a029-9b13-47a4-9100-3e417b9d3b4e None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:25.449974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083a029-9b13-47a4-9100-3e417b9d3b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:25.451531 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083a029-9b13-47a4-9100-3e417b9d3b4e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:25.460511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 328/647] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:25.461371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083a029-9b13-47a4-9100-3e417b9d3b4e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:25.480577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:25.514171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:25.525119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610ca48-e5be-441a-a07d-0f9ee21242cd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:25.561679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bf361-27b2-4f6c-a4ba-d530c7303260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:25.562283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf361-27b2-4f6c-a4ba-d530c7303260 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:25.562561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf361-27b2-4f6c-a4ba-d530c7303260 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:25.562833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf361-27b2-4f6c-a4ba-d530c7303260 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:25.563489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bf361-27b2-4f6c-a4ba-d530c7303260 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:25.563792 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bf361-27b2-4f6c-a4ba-d530c7303260 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:25.565308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bf361-27b2-4f6c-a4ba-d530c7303260 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:25.571119 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083a029-9b13-47a4-9100-3e417b9d3b4e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:25.578071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 320/648] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:25.578904 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bf361-27b2-4f6c-a4ba-d530c7303260 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:25.606723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513eeb5-e011-4239-a7db-0d5fe489d674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:25.607318 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513eeb5-e011-4239-a7db-0d5fe489d674 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:25.607588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513eeb5-e011-4239-a7db-0d5fe489d674 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:25.607851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513eeb5-e011-4239-a7db-0d5fe489d674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:25.679260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513eeb5-e011-4239-a7db-0d5fe489d674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:25.680703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513eeb5-e011-4239-a7db-0d5fe489d674 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:25.684337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bf361-27b2-4f6c-a4ba-d530c7303260 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:25.706674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:25.720440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105664eb-0def-41da-9db3-937d4f39d18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:25.721603 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105664eb-0def-41da-9db3-937d4f39d18b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:25.721968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105664eb-0def-41da-9db3-937d4f39d18b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:25.722329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105664eb-0def-41da-9db3-937d4f39d18b None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:25.723027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105664eb-0def-41da-9db3-937d4f39d18b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:25.723331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105664eb-0def-41da-9db3-937d4f39d18b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:25.724740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105664eb-0def-41da-9db3-937d4f39d18b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:25.731547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:25.742488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 321/649] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:25.743466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105664eb-0def-41da-9db3-937d4f39d18b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:25.796358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 329/650] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:25:25.797277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513eeb5-e011-4239-a7db-0d5fe489d674 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:25.853012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105664eb-0def-41da-9db3-937d4f39d18b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:25.890102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c9333-8d93-4bdc-8065-ec5b9ee7f1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:25.890736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c9333-8d93-4bdc-8065-ec5b9ee7f1ee None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:25.891015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c9333-8d93-4bdc-8065-ec5b9ee7f1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:25.891285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c9333-8d93-4bdc-8065-ec5b9ee7f1ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:25.902881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c9333-8d93-4bdc-8065-ec5b9ee7f1ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:25.904330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c9333-8d93-4bdc-8065-ec5b9ee7f1ee None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:25.904498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513eeb5-e011-4239-a7db-0d5fe489d674 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-fe1c9333-8d93-4bdc-8065-ec5b9ee7f1ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:25.920931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:25.921958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:25.922856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:25.922856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:25.922856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:25.922856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 322/651] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:25.923105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c9333-8d93-4bdc-8065-ec5b9ee7f1ee None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:25.945378 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de8cd4-314d-4e41-a10c-e508f0571bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:25.946005 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de8cd4-314d-4e41-a10c-e508f0571bca None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:25.946281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de8cd4-314d-4e41-a10c-e508f0571bca None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:25.946548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de8cd4-314d-4e41-a10c-e508f0571bca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:25.957180 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:25.957477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de8cd4-314d-4e41-a10c-e508f0571bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:25.959032 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de8cd4-314d-4e41-a10c-e508f0571bca None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:25.966781 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d5de8cd4-314d-4e41-a10c-e508f0571bca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:25.975460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:25.976582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:25.977529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:25.977529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:25.977529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:25.977529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 330/652] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:25.977529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de8cd4-314d-4e41-a10c-e508f0571bca None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:26.043031 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c9333-8d93-4bdc-8065-ec5b9ee7f1ee None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:26.078627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de8cd4-314d-4e41-a10c-e508f0571bca None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:26.084948 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8ebfb-c031-4d6f-8664-f318c8e67a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:26.085580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8ebfb-c031-4d6f-8664-f318c8e67a68 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:26.086253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8ebfb-c031-4d6f-8664-f318c8e67a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:26.086554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8ebfb-c031-4d6f-8664-f318c8e67a68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:26.087283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8ebfb-c031-4d6f-8664-f318c8e67a68 None admin] RBAC: Adding query filter params (role.id=8646bae8724e4a26bb49cd7cb1d39593, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=c526760ad8a04bf486d1e7e74e9ffbe3) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:26.087588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8ebfb-c031-4d6f-8664-f318c8e67a68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:26.089686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8ebfb-c031-4d6f-8664-f318c8e67a68 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:26.095892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 323/653] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:25 2022] GET /identity/v3/role_assignments?user.id=c526760ad8a04bf486d1e7e74e9ffbe3&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=8646bae8724e4a26bb49cd7cb1d39593 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:26.096735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8ebfb-c031-4d6f-8664-f318c8e67a68 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:26.133825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1202690-0913-4bb0-b657-249d0cc6102d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:26.134483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1202690-0913-4bb0-b657-249d0cc6102d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:26.134766 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1202690-0913-4bb0-b657-249d0cc6102d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:26.135039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1202690-0913-4bb0-b657-249d0cc6102d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:26.152085 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1202690-0913-4bb0-b657-249d0cc6102d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:26.153816 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1202690-0913-4bb0-b657-249d0cc6102d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-a1202690-0913-4bb0-b657-249d0cc6102d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:26.176935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:26.178041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:26.178970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:26.178970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:26.178970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:26.178970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 331/654] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:26.178970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1202690-0913-4bb0-b657-249d0cc6102d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:26.217407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:26.224846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8ebfb-c031-4d6f-8664-f318c8e67a68 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:26.251008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:26.270720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973174a-56cc-4151-a43b-84867bc07c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:26.271594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973174a-56cc-4151-a43b-84867bc07c59 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:26.271888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973174a-56cc-4151-a43b-84867bc07c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:26.272165 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973174a-56cc-4151-a43b-84867bc07c59 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:26.272821 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973174a-56cc-4151-a43b-84867bc07c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:26.273130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973174a-56cc-4151-a43b-84867bc07c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:26.275461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973174a-56cc-4151-a43b-84867bc07c59 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:26.289883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 324/655] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:26.290749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973174a-56cc-4151-a43b-84867bc07c59 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:26.322894 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1202690-0913-4bb0-b657-249d0cc6102d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:26.375091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c438d-efef-4d45-bc21-961c95b111f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:26.375091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c438d-efef-4d45-bc21-961c95b111f1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:26.375364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c438d-efef-4d45-bc21-961c95b111f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:26.375464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c438d-efef-4d45-bc21-961c95b111f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:26.376108 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c438d-efef-4d45-bc21-961c95b111f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:26.376413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c438d-efef-4d45-bc21-961c95b111f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:26.378294 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c438d-efef-4d45-bc21-961c95b111f1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:26.394023 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 332/656] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:26.394764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c438d-efef-4d45-bc21-961c95b111f1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:26.420533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973174a-56cc-4151-a43b-84867bc07c59 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:26.459096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43220fb8-751d-4607-9448-ae6db52d98fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:26.459710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220fb8-751d-4607-9448-ae6db52d98fe None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:26.460044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220fb8-751d-4607-9448-ae6db52d98fe None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:26.460322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220fb8-751d-4607-9448-ae6db52d98fe None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:26.461015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43220fb8-751d-4607-9448-ae6db52d98fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:26.461360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43220fb8-751d-4607-9448-ae6db52d98fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:26.462827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43220fb8-751d-4607-9448-ae6db52d98fe None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:26.477055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 325/657] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:26.477727 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43220fb8-751d-4607-9448-ae6db52d98fe None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:26.497184 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:26.514654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c438d-efef-4d45-bc21-961c95b111f1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:26.526916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:26.554597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dc5a7-b82c-499e-a216-00bea023633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:26.555344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dc5a7-b82c-499e-a216-00bea023633a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:26.555773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dc5a7-b82c-499e-a216-00bea023633a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:26.556123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dc5a7-b82c-499e-a216-00bea023633a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:26.565308 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dc5a7-b82c-499e-a216-00bea023633a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:26.567229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dc5a7-b82c-499e-a216-00bea023633a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-476dc5a7-b82c-499e-a216-00bea023633a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:26.579964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:26.581245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:26.582505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:26.582505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:26.582505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:26.582505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:26.582505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:26.582505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:26.582505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:26.582505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:26.582505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 04:25:26.582505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:26.587979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 333/658] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:25:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:26.589158 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dc5a7-b82c-499e-a216-00bea023633a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:26.594495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43220fb8-751d-4607-9448-ae6db52d98fe None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:26.633059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782a13d-8ae1-49b2-8b0f-1d9059a5e61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:26.634054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782a13d-8ae1-49b2-8b0f-1d9059a5e61a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:26.634518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782a13d-8ae1-49b2-8b0f-1d9059a5e61a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:26.635071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782a13d-8ae1-49b2-8b0f-1d9059a5e61a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:26.643794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782a13d-8ae1-49b2-8b0f-1d9059a5e61a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:26.645561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782a13d-8ae1-49b2-8b0f-1d9059a5e61a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8782a13d-8ae1-49b2-8b0f-1d9059a5e61a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:26.659775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:26.660775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:26.661805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:26.661805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:26.661805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:26.661805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:26.661805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:26.661805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:26.661805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:26.661805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:26.661805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 04:25:26.661805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:26.668435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 326/659] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:26.669489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782a13d-8ae1-49b2-8b0f-1d9059a5e61a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:26.699707 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dc5a7-b82c-499e-a216-00bea023633a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:26.737611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cbf6e-ab64-427d-9504-875869605a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:26.738275 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cbf6e-ab64-427d-9504-875869605a9f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:26.738954 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cbf6e-ab64-427d-9504-875869605a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:26.739238 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cbf6e-ab64-427d-9504-875869605a9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:26.748740 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cbf6e-ab64-427d-9504-875869605a9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:26.750222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cbf6e-ab64-427d-9504-875869605a9f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:26.756860 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-630cbf6e-ab64-427d-9504-875869605a9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:26.766806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:26.775508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:26.776466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:26.776466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:26.776466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:26.776466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:26.776466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:26.776466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:26.776466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:26.776466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:26.776466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 334/660] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:26.776466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cbf6e-ab64-427d-9504-875869605a9f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:26.786670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782a13d-8ae1-49b2-8b0f-1d9059a5e61a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:26.806665 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:26.824129 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b5185-69d3-484e-ad7d-d167988a72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:26.824738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b5185-69d3-484e-ad7d-d167988a72a0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:26.825030 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b5185-69d3-484e-ad7d-d167988a72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:26.825323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b5185-69d3-484e-ad7d-d167988a72a0 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:26.826254 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b5185-69d3-484e-ad7d-d167988a72a0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:26.826378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b5185-69d3-484e-ad7d-d167988a72a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:26.827749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b5185-69d3-484e-ad7d-d167988a72a0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:26.850899 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 327/661] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 31 04:25:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:26.850899 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b5185-69d3-484e-ad7d-d167988a72a0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:26.885672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cbf6e-ab64-427d-9504-875869605a9f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:26.923427 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822576a8-6d22-4fbc-9ef8-0854e4cc6a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:26.924245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822576a8-6d22-4fbc-9ef8-0854e4cc6a59 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:26.924476 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822576a8-6d22-4fbc-9ef8-0854e4cc6a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:26.924730 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822576a8-6d22-4fbc-9ef8-0854e4cc6a59 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:26.925484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822576a8-6d22-4fbc-9ef8-0854e4cc6a59 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:26.925786 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822576a8-6d22-4fbc-9ef8-0854e4cc6a59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:26.927200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822576a8-6d22-4fbc-9ef8-0854e4cc6a59 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:26.944557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 335/662] 10.222.0.39 () {56 vars in 1139 bytes} [Wed Aug 31 04:25:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:26.945588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d2344-25e2-4765-bc56-b8be47dd2ac2 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:26.945869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d2344-25e2-4765-bc56-b8be47dd2ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:26.946138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d2344-25e2-4765-bc56-b8be47dd2ac2 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:26.947487 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 336/663] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:26.950033 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d2344-25e2-4765-bc56-b8be47dd2ac2 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:26.962108 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b5185-69d3-484e-ad7d-d167988a72a0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:26.999276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8004dd-815f-4e19-b868-8fc83cb435e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:27.000138 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8004dd-815f-4e19-b868-8fc83cb435e6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:27.000657 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8004dd-815f-4e19-b868-8fc83cb435e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:27.000935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8004dd-815f-4e19-b868-8fc83cb435e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:27.001726 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8004dd-815f-4e19-b868-8fc83cb435e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:27.002049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8004dd-815f-4e19-b868-8fc83cb435e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:27.003495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8004dd-815f-4e19-b868-8fc83cb435e6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:27.005078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:27.020575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 328/664] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:27.020575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8004dd-815f-4e19-b868-8fc83cb435e6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:27.050430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:27.065676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d2344-25e2-4765-bc56-b8be47dd2ac2 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:27.101730 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5412292-c33c-43db-89a9-d774d006907e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:27.102256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5412292-c33c-43db-89a9-d774d006907e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:27.102534 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5412292-c33c-43db-89a9-d774d006907e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:27.102803 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5412292-c33c-43db-89a9-d774d006907e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:27.131708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8004dd-815f-4e19-b868-8fc83cb435e6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:27.166825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef6f4e-be9d-4ffb-9db1-c444692018ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:27.167676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef6f4e-be9d-4ffb-9db1-c444692018ce None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:27.167676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef6f4e-be9d-4ffb-9db1-c444692018ce None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:27.167972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef6f4e-be9d-4ffb-9db1-c444692018ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:27.174379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5412292-c33c-43db-89a9-d774d006907e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:27.175918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5412292-c33c-43db-89a9-d774d006907e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:27.234717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:27.242305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef6f4e-be9d-4ffb-9db1-c444692018ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:27.243875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef6f4e-be9d-4ffb-9db1-c444692018ce None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:27.268296 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:27.281300 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 337/665] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:25:27.282708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ae101-aa0d-4cd4-9ffb-974cdebd87ab None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:27.283220 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ae101-aa0d-4cd4-9ffb-974cdebd87ab None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:27.284278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ae101-aa0d-4cd4-9ffb-974cdebd87ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:27.301844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2c4ae101-aa0d-4cd4-9ffb-974cdebd87ab None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:27.303042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2c4ae101-aa0d-4cd4-9ffb-974cdebd87ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:27.364267 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 329/666] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:25:27.364267 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef6f4e-be9d-4ffb-9db1-c444692018ce None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:27.381421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 338/667] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:27.381421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ae101-aa0d-4cd4-9ffb-974cdebd87ab None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:27.471077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:27.478738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef6f4e-be9d-4ffb-9db1-c444692018ce None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:27.520219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6a869-fdba-4c13-86ed-3825d39b0f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:27.521100 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a869-fdba-4c13-86ed-3825d39b0f87 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:27.521804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a869-fdba-4c13-86ed-3825d39b0f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:27.522113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ae101-aa0d-4cd4-9ffb-974cdebd87ab None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:27.522405 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a869-fdba-4c13-86ed-3825d39b0f87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:27.523283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6a869-fdba-4c13-86ed-3825d39b0f87 None admin] RBAC: Adding query filter params (role.id=8646bae8724e4a26bb49cd7cb1d39593, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=4877b72a6cea410dbb31a35c7acbd5f9) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:27.523847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6a869-fdba-4c13-86ed-3825d39b0f87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:27.525545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6a869-fdba-4c13-86ed-3825d39b0f87 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:27.539403 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 330/668] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:27 2022] GET /identity/v3/role_assignments?user.id=4877b72a6cea410dbb31a35c7acbd5f9&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=8646bae8724e4a26bb49cd7cb1d39593 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:27.540455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6a869-fdba-4c13-86ed-3825d39b0f87 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:27.547432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:27.579313 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e487a85-fdfb-4740-a2f8-d9f1ff43c372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:27.579996 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e487a85-fdfb-4740-a2f8-d9f1ff43c372 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:27.580796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e487a85-fdfb-4740-a2f8-d9f1ff43c372 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:27.581097 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e487a85-fdfb-4740-a2f8-d9f1ff43c372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:27.603838 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e487a85-fdfb-4740-a2f8-d9f1ff43c372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:27.605370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e487a85-fdfb-4740-a2f8-d9f1ff43c372 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-0e487a85-fdfb-4740-a2f8-d9f1ff43c372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:27.632762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:27.633802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:27.634729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:27.634729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:27.634729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:27.641751 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 339/669] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:27.649053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e487a85-fdfb-4740-a2f8-d9f1ff43c372 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:27.666520 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6a869-fdba-4c13-86ed-3825d39b0f87 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:27.703710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e678c-ff97-4939-bfb2-9181437e77f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:27.704721 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e678c-ff97-4939-bfb2-9181437e77f4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:27.705848 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e678c-ff97-4939-bfb2-9181437e77f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:27.706452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e678c-ff97-4939-bfb2-9181437e77f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:27.718437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e678c-ff97-4939-bfb2-9181437e77f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:27.720055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e678c-ff97-4939-bfb2-9181437e77f4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-a27e678c-ff97-4939-bfb2-9181437e77f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:27.736081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:27.737740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:27.738664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:27.738664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:27.738664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:27.738664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 331/670] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:27.744269 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e678c-ff97-4939-bfb2-9181437e77f4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:27.759620 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:27.792967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e487a85-fdfb-4740-a2f8-d9f1ff43c372 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:27.840086 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bcaed-279e-4e76-bae6-043b7e1312bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:27.840692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bcaed-279e-4e76-bae6-043b7e1312bc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:27.840965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bcaed-279e-4e76-bae6-043b7e1312bc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:27.841297 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bcaed-279e-4e76-bae6-043b7e1312bc None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:27.841923 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bcaed-279e-4e76-bae6-043b7e1312bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:27.842214 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bcaed-279e-4e76-bae6-043b7e1312bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:27.843686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bcaed-279e-4e76-bae6-043b7e1312bc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:27.857240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 340/671] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:27.857888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bcaed-279e-4e76-bae6-043b7e1312bc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:27.872949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e678c-ff97-4939-bfb2-9181437e77f4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:27.897766 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:27.915499 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e20a71-e6ac-4613-a606-573570a5c40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:27.916135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e20a71-e6ac-4613-a606-573570a5c40c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:27.916417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e20a71-e6ac-4613-a606-573570a5c40c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:27.916695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e20a71-e6ac-4613-a606-573570a5c40c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:27.929952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e20a71-e6ac-4613-a606-573570a5c40c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-00e20a71-e6ac-4613-a606-573570a5c40c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:27.935714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:27.936651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:27.937535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:27.937535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:27.937535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:27.937535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:27.937535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:27.937535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:27.937535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:27.937535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:27.937535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:27.937535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:27.937535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:27.937535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:27.937535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 332/672] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:27.938324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e20a71-e6ac-4613-a606-573570a5c40c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:27.991292 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bcaed-279e-4e76-bae6-043b7e1312bc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:28.020820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:28.039477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7ed61-67fa-44c5-a055-6e126b63d9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:28.040444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7ed61-67fa-44c5-a055-6e126b63d9dd None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:28.040938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7ed61-67fa-44c5-a055-6e126b63d9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:28.041440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7ed61-67fa-44c5-a055-6e126b63d9dd None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:28.042745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7ed61-67fa-44c5-a055-6e126b63d9dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:28.043251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7ed61-67fa-44c5-a055-6e126b63d9dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:28.045286 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7ed61-67fa-44c5-a055-6e126b63d9dd None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:28.068888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 341/673] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:28.068888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7ed61-67fa-44c5-a055-6e126b63d9dd None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:28.074476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e20a71-e6ac-4613-a606-573570a5c40c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:28.121765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5a808-29ad-4feb-bf07-3cd27e94fc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:28.122763 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5a808-29ad-4feb-bf07-3cd27e94fc25 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:28.123466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5a808-29ad-4feb-bf07-3cd27e94fc25 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:28.124431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5a808-29ad-4feb-bf07-3cd27e94fc25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:28.133603 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5a808-29ad-4feb-bf07-3cd27e94fc25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:28.136031 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5a808-29ad-4feb-bf07-3cd27e94fc25 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-2db5a808-29ad-4feb-bf07-3cd27e94fc25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:28.150805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:28.151745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:28.152645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:28.152645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:28.152645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:28.152645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:28.152645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:28.152645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:28.152645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:28.152645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:28.156014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 333/674] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:28.157070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5a808-29ad-4feb-bf07-3cd27e94fc25 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:28.181340 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:28.195028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7ed61-67fa-44c5-a055-6e126b63d9dd None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:28.238968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517a1bb-86e5-4db3-a85a-281b7512552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:28.239660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517a1bb-86e5-4db3-a85a-281b7512552a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:28.239936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517a1bb-86e5-4db3-a85a-281b7512552a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:28.240924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517a1bb-86e5-4db3-a85a-281b7512552a None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:28.240924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517a1bb-86e5-4db3-a85a-281b7512552a None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:28.241160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517a1bb-86e5-4db3-a85a-281b7512552a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:28.242523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517a1bb-86e5-4db3-a85a-281b7512552a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:28.252514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 342/675] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:28.252866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517a1bb-86e5-4db3-a85a-281b7512552a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:28.273352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5a808-29ad-4feb-bf07-3cd27e94fc25 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:28.302743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:28.309488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d42eb-8592-43e8-9bc8-99cc656b5531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:28.310144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d42eb-8592-43e8-9bc8-99cc656b5531 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:28.310424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d42eb-8592-43e8-9bc8-99cc656b5531 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:28.320871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d42eb-8592-43e8-9bc8-99cc656b5531 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:28.320871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d42eb-8592-43e8-9bc8-99cc656b5531 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:28.320871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d42eb-8592-43e8-9bc8-99cc656b5531 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-316d42eb-8592-43e8-9bc8-99cc656b5531 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:28.329877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:28.331510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:28.332670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:28.332670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:28.332670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:28.332670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:28.332670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:28.332670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:28.332670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:28.332670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:28.336337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 334/676] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:28.337920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee00de-9f10-462d-a067-71a095f084aa None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:28.338514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee00de-9f10-462d-a067-71a095f084aa None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:28.339173 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee00de-9f10-462d-a067-71a095f084aa None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:28.340414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 335/677] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:28.341088 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee00de-9f10-462d-a067-71a095f084aa None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:28.375780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517a1bb-86e5-4db3-a85a-281b7512552a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:28.415441 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a07327-f6c5-46eb-b3c9-bddd1a766ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:28.415956 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a07327-f6c5-46eb-b3c9-bddd1a766ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:28.416229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a07327-f6c5-46eb-b3c9-bddd1a766ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:28.416537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a07327-f6c5-46eb-b3c9-bddd1a766ea8 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:28.417176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a07327-f6c5-46eb-b3c9-bddd1a766ea8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:28.417506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a07327-f6c5-46eb-b3c9-bddd1a766ea8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:28.418917 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a07327-f6c5-46eb-b3c9-bddd1a766ea8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:28.437764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 343/678] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:28.437764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a07327-f6c5-46eb-b3c9-bddd1a766ea8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:28.453433 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:28.465882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee00de-9f10-462d-a067-71a095f084aa None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:28.501320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab9035-05c5-4090-9908-169ca69b333d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:28.501955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab9035-05c5-4090-9908-169ca69b333d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:28.502350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab9035-05c5-4090-9908-169ca69b333d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:28.502636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab9035-05c5-4090-9908-169ca69b333d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:28.513441 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab9035-05c5-4090-9908-169ca69b333d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:28.515301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab9035-05c5-4090-9908-169ca69b333d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8aab9035-05c5-4090-9908-169ca69b333d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:28.530869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:28.532032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:28.532956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:28.532956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:28.532956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:28.532956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 336/679] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:28.533597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c766290-e6e7-4c5a-a8c8-e1389e4e7f18 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:28.533895 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c766290-e6e7-4c5a-a8c8-e1389e4e7f18 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:28.534169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c766290-e6e7-4c5a-a8c8-e1389e4e7f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:28.553922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0c766290-e6e7-4c5a-a8c8-e1389e4e7f18 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:28.554469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a07327-f6c5-46eb-b3c9-bddd1a766ea8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:28.555130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0c766290-e6e7-4c5a-a8c8-e1389e4e7f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:28.591422 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89854030-c8e0-4703-8a74-e1ee83757d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:28.592021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854030-c8e0-4703-8a74-e1ee83757d02 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:28.592300 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854030-c8e0-4703-8a74-e1ee83757d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:28.592571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854030-c8e0-4703-8a74-e1ee83757d02 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:28.593289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89854030-c8e0-4703-8a74-e1ee83757d02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:28.593598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89854030-c8e0-4703-8a74-e1ee83757d02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:28.593856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:28.595020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89854030-c8e0-4703-8a74-e1ee83757d02 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:28.607185 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 344/680] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:28.608033 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89854030-c8e0-4703-8a74-e1ee83757d02 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:28.631968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 337/681] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:28.632817 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c766290-e6e7-4c5a-a8c8-e1389e4e7f18 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:28.721661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:28.726523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89854030-c8e0-4703-8a74-e1ee83757d02 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:28.756053 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c766290-e6e7-4c5a-a8c8-e1389e4e7f18 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:28.775630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7534e-c0f8-436d-84e6-7f5a9c78b070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:28.776347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7534e-c0f8-436d-84e6-7f5a9c78b070 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:28.776634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7534e-c0f8-436d-84e6-7f5a9c78b070 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:28.777028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7534e-c0f8-436d-84e6-7f5a9c78b070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:28.778002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7534e-c0f8-436d-84e6-7f5a9c78b070 None admin] RBAC: Adding query filter params (role.id=8646bae8724e4a26bb49cd7cb1d39593, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=4455f4e327184c69aead4a7ae9737961) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:28.778312 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7534e-c0f8-436d-84e6-7f5a9c78b070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:28.780464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7534e-c0f8-436d-84e6-7f5a9c78b070 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:28.789311 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 345/682] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:28 2022] GET /identity/v3/role_assignments?user.id=4455f4e327184c69aead4a7ae9737961&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=8646bae8724e4a26bb49cd7cb1d39593 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:28.790752 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7534e-c0f8-436d-84e6-7f5a9c78b070 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:28.801511 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aa748-4147-44cc-a501-ce7b8ec99431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:28.803358 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aa748-4147-44cc-a501-ce7b8ec99431 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:28.807336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aa748-4147-44cc-a501-ce7b8ec99431 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:28.807336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aa748-4147-44cc-a501-ce7b8ec99431 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:28.807336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aa748-4147-44cc-a501-ce7b8ec99431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:28.807336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aa748-4147-44cc-a501-ce7b8ec99431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:28.807336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aa748-4147-44cc-a501-ce7b8ec99431 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:28.828624 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 338/683] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:28.834308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aa748-4147-44cc-a501-ce7b8ec99431 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:28.897653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:28.977289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7534e-c0f8-436d-84e6-7f5a9c78b070 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:28.983763 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aa748-4147-44cc-a501-ce7b8ec99431 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:29.020180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bd059-edc0-45e7-863b-3f0981cb5034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:29.020783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bd059-edc0-45e7-863b-3f0981cb5034 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:29.021052 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74f8c2-458b-4bb4-afbc-47970001989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:29.021169 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bd059-edc0-45e7-863b-3f0981cb5034 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:29.021643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bd059-edc0-45e7-863b-3f0981cb5034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:29.021987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74f8c2-458b-4bb4-afbc-47970001989a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:29.022269 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74f8c2-458b-4bb4-afbc-47970001989a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:29.022375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bd059-edc0-45e7-863b-3f0981cb5034 None admin] RBAC: Adding query filter params (role.id=8646bae8724e4a26bb49cd7cb1d39593, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=2c63e7e4105b41d1abfe58bf13c6125d) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:29.022545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74f8c2-458b-4bb4-afbc-47970001989a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:29.022642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bd059-edc0-45e7-863b-3f0981cb5034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:29.024043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bd059-edc0-45e7-863b-3f0981cb5034 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:29.029235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:29.031623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74f8c2-458b-4bb4-afbc-47970001989a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:29.032971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 346/684] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:28 2022] GET /identity/v3/role_assignments?user.id=2c63e7e4105b41d1abfe58bf13c6125d&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=8646bae8724e4a26bb49cd7cb1d39593 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:29.033099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74f8c2-458b-4bb4-afbc-47970001989a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:29.034541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bd059-edc0-45e7-863b-3f0981cb5034 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-ec74f8c2-458b-4bb4-afbc-47970001989a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:29.055428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:29.058028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:29.059227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:29.059227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:29.059227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:29.059227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:29.059227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:29.059227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:29.059227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:29.059227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:29.059227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 04:25:29.059227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:29.060748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 339/685] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:25:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:29.067389 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74f8c2-458b-4bb4-afbc-47970001989a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:29.169793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:29.180987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74f8c2-458b-4bb4-afbc-47970001989a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:29.218728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5031e39-5568-4534-94d8-9693f036cf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:29.219738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5031e39-5568-4534-94d8-9693f036cf06 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:29.220224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5031e39-5568-4534-94d8-9693f036cf06 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:29.220731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5031e39-5568-4534-94d8-9693f036cf06 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:29.221905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5031e39-5568-4534-94d8-9693f036cf06 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:29.222429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5031e39-5568-4534-94d8-9693f036cf06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:29.224153 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5031e39-5568-4534-94d8-9693f036cf06 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:29.231317 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bd059-edc0-45e7-863b-3f0981cb5034 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:29.246028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 340/686] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 31 04:25:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:29.252170 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5031e39-5568-4534-94d8-9693f036cf06 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:29.318558 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a4abb-1ca5-4c87-a564-a023be3b97eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:29.318770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4abb-1ca5-4c87-a564-a023be3b97eb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:29.319038 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4abb-1ca5-4c87-a564-a023be3b97eb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:29.319317 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4abb-1ca5-4c87-a564-a023be3b97eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:29.336528 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a4abb-1ca5-4c87-a564-a023be3b97eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:29.338339 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a4abb-1ca5-4c87-a564-a023be3b97eb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-643a4abb-1ca5-4c87-a564-a023be3b97eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:29.358717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:29.359735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:29.360640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:29.360640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:29.360640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:29.360640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 347/687] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:29.367260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a4abb-1ca5-4c87-a564-a023be3b97eb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:29.379174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5031e39-5568-4534-94d8-9693f036cf06 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:29.419251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af8744-975b-4ce4-94b5-0f30120e7c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:29.420145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af8744-975b-4ce4-94b5-0f30120e7c1c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:29.420578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af8744-975b-4ce4-94b5-0f30120e7c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:29.421053 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af8744-975b-4ce4-94b5-0f30120e7c1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:29.437126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:29.447519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:29.505809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a4abb-1ca5-4c87-a564-a023be3b97eb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:29.520901 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af8744-975b-4ce4-94b5-0f30120e7c1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:29.523516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af8744-975b-4ce4-94b5-0f30120e7c1c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:29.545636 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82fd50-94f4-4042-ab22-75f4cf4c8af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:29.546485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82fd50-94f4-4042-ab22-75f4cf4c8af4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:29.546899 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82fd50-94f4-4042-ab22-75f4cf4c8af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:29.547342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82fd50-94f4-4042-ab22-75f4cf4c8af4 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:29.548144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82fd50-94f4-4042-ab22-75f4cf4c8af4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:29.548592 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82fd50-94f4-4042-ab22-75f4cf4c8af4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:29.550236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82fd50-94f4-4042-ab22-75f4cf4c8af4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:29.564006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 348/688] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:29.574192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82fd50-94f4-4042-ab22-75f4cf4c8af4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:29.645144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 341/689] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 04:25:29.652332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af8744-975b-4ce4-94b5-0f30120e7c1c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:29.731801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:29.787005 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82fd50-94f4-4042-ab22-75f4cf4c8af4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:29.787868 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af8744-975b-4ce4-94b5-0f30120e7c1c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:29.811094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:29.828851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943e8c0-2e25-434f-a5f3-dbde2164a622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:29.829513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943e8c0-2e25-434f-a5f3-dbde2164a622 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:29.829799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943e8c0-2e25-434f-a5f3-dbde2164a622 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:29.830077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943e8c0-2e25-434f-a5f3-dbde2164a622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:29.848433 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943e8c0-2e25-434f-a5f3-dbde2164a622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:29.849911 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943e8c0-2e25-434f-a5f3-dbde2164a622 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:29.853610 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56aba2f-6f75-44a6-88f5-51359b0e3184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:29.854222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aba2f-6f75-44a6-88f5-51359b0e3184 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:29.854505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aba2f-6f75-44a6-88f5-51359b0e3184 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:29.854779 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aba2f-6f75-44a6-88f5-51359b0e3184 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:29.855441 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56aba2f-6f75-44a6-88f5-51359b0e3184 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:29.857818 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56aba2f-6f75-44a6-88f5-51359b0e3184 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e943e8c0-2e25-434f-a5f3-dbde2164a622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:29.878303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:29.879342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:29.880251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:29.880251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:29.880251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:29.882080 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 342/690] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:29.887012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374165f-8fdb-445e-b70d-d4da780f0652 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:29.887012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374165f-8fdb-445e-b70d-d4da780f0652 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:29.887199 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374165f-8fdb-445e-b70d-d4da780f0652 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:29.888627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 343/691] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:29.890000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374165f-8fdb-445e-b70d-d4da780f0652 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:29.956511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 349/692] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:25:29 2022] POST /identity/v3/users => generated 254 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:29.956511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b543b20-668f-41c2-b93a-d86b3aa0bbce None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:29.956511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b543b20-668f-41c2-b93a-d86b3aa0bbce None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:29.956511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b543b20-668f-41c2-b93a-d86b3aa0bbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:29.987574 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2b543b20-668f-41c2-b93a-d86b3aa0bbce None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:29.989042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2b543b20-668f-41c2-b93a-d86b3aa0bbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:30.041889 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374165f-8fdb-445e-b70d-d4da780f0652 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:30.044422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:30.092327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0a0de-f43a-476c-afa9-e26d88660ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:30.093380 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0a0de-f43a-476c-afa9-e26d88660ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:30.093865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0a0de-f43a-476c-afa9-e26d88660ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:30.094335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0a0de-f43a-476c-afa9-e26d88660ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:30.095582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0a0de-f43a-476c-afa9-e26d88660ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:30.096207 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0a0de-f43a-476c-afa9-e26d88660ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:30.099262 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0a0de-f43a-476c-afa9-e26d88660ef6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:30.119861 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 344/693] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:30.121538 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0a0de-f43a-476c-afa9-e26d88660ef6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:30.155951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 350/694] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:30.246706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0a0de-f43a-476c-afa9-e26d88660ef6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:30.285124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68fba1-8ed9-4ecf-888f-1878a2ece92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:30.286186 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68fba1-8ed9-4ecf-888f-1878a2ece92e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:30.286678 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68fba1-8ed9-4ecf-888f-1878a2ece92e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:30.287152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68fba1-8ed9-4ecf-888f-1878a2ece92e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:30.294375 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68fba1-8ed9-4ecf-888f-1878a2ece92e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:30.296065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68fba1-8ed9-4ecf-888f-1878a2ece92e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8e68fba1-8ed9-4ecf-888f-1878a2ece92e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:30.308202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:30.309101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:30.310034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:30.310034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:30.310034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:30.310034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:30.310034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:30.310034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:30.310034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:30.310034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:30.315252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 345/695] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:30.319222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b543b20-668f-41c2-b93a-d86b3aa0bbce None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:30.428892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:30.433169 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b543b20-668f-41c2-b93a-d86b3aa0bbce None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:30.454522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68fba1-8ed9-4ecf-888f-1878a2ece92e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:30.490376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:30.491967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b1b6a-783f-438f-92dd-84d1fa731119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:30.492584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b1b6a-783f-438f-92dd-84d1fa731119 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:30.492863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b1b6a-783f-438f-92dd-84d1fa731119 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:30.493135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b1b6a-783f-438f-92dd-84d1fa731119 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:30.493899 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b1b6a-783f-438f-92dd-84d1fa731119 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:30.494204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b1b6a-783f-438f-92dd-84d1fa731119 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:30.495638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b1b6a-783f-438f-92dd-84d1fa731119 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:30.527010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 351/696] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:30.529332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b1b6a-783f-438f-92dd-84d1fa731119 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:30.659257 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68fba1-8ed9-4ecf-888f-1878a2ece92e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:30.689268 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b1b6a-783f-438f-92dd-84d1fa731119 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:30.724158 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d5fff-5e59-437d-b6f3-b905d48d3f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:30.725374 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d5fff-5e59-437d-b6f3-b905d48d3f35 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:30.725913 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d5fff-5e59-437d-b6f3-b905d48d3f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:30.726399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d5fff-5e59-437d-b6f3-b905d48d3f35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:30.739372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d5fff-5e59-437d-b6f3-b905d48d3f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-da4d5fff-5e59-437d-b6f3-b905d48d3f35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:30.745097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:30.746140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:30.747039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:30.747039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:30.747039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:30.747039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:30.747039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:30.747039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:30.747039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:30.747039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:30.747039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:30.747039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:30.747039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:25:30.747039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:30.750492 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 346/697] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:25:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:30.761334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d5fff-5e59-437d-b6f3-b905d48d3f35 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:30.764030 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a59b8a-292f-49c9-8451-1e9bceeaed20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:30.764642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a59b8a-292f-49c9-8451-1e9bceeaed20 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:30.764919 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a59b8a-292f-49c9-8451-1e9bceeaed20 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:30.765189 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a59b8a-292f-49c9-8451-1e9bceeaed20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:30.766666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a59b8a-292f-49c9-8451-1e9bceeaed20 None admin] RBAC: Adding query filter params (role.id=8646bae8724e4a26bb49cd7cb1d39593, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=98c52ca121d34ce6bbeb414c31f5d2fb) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:30.768229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a59b8a-292f-49c9-8451-1e9bceeaed20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:30.769730 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a59b8a-292f-49c9-8451-1e9bceeaed20 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:30.777027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 352/698] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:30 2022] GET /identity/v3/role_assignments?user.id=98c52ca121d34ce6bbeb414c31f5d2fb&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=8646bae8724e4a26bb49cd7cb1d39593 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:30.869190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:30.888275 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d5fff-5e59-437d-b6f3-b905d48d3f35 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:30.927383 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e6512-327b-402b-8291-f0da3ea7e0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:30.927928 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e6512-327b-402b-8291-f0da3ea7e0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:30.928206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e6512-327b-402b-8291-f0da3ea7e0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:30.928475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e6512-327b-402b-8291-f0da3ea7e0e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:30.929155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e6512-327b-402b-8291-f0da3ea7e0e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:30.929484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e6512-327b-402b-8291-f0da3ea7e0e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:30.930922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e6512-327b-402b-8291-f0da3ea7e0e8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:30.945149 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 347/699] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:30.950835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a59b8a-292f-49c9-8451-1e9bceeaed20 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:30.997482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:31.094107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a59b8a-292f-49c9-8451-1e9bceeaed20 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:31.139277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d769f-1025-4ae4-96cf-d95a9d448dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:31.139915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d769f-1025-4ae4-96cf-d95a9d448dfd None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:31.140194 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d769f-1025-4ae4-96cf-d95a9d448dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:31.140467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d769f-1025-4ae4-96cf-d95a9d448dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:31.153835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d769f-1025-4ae4-96cf-d95a9d448dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:31.155429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d769f-1025-4ae4-96cf-d95a9d448dfd None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-527d769f-1025-4ae4-96cf-d95a9d448dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:31.173672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:31.175043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:31.175960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:31.175960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:31.175960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:31.175960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 353/700] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:31.184334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e6512-327b-402b-8291-f0da3ea7e0e8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:31.187725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d5529-f506-463f-b188-ce4421407738 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:31.188010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d5529-f506-463f-b188-ce4421407738 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:31.188287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d5529-f506-463f-b188-ce4421407738 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:31.190618 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 354/701] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:25:31.196867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ade45f-6f25-4c0d-bfda-647d9792548e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:31.197151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ade45f-6f25-4c0d-bfda-647d9792548e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:31.197454 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ade45f-6f25-4c0d-bfda-647d9792548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:31.223575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f9ade45f-6f25-4c0d-bfda-647d9792548e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:31.225770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f9ade45f-6f25-4c0d-bfda-647d9792548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:31.317002 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e6512-327b-402b-8291-f0da3ea7e0e8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:31.325234 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 355/702] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:25:31.356681 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcddaa0-ed1f-482e-be80-4234e6d81bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:31.357328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcddaa0-ed1f-482e-be80-4234e6d81bbf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:31.357667 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcddaa0-ed1f-482e-be80-4234e6d81bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:31.357941 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcddaa0-ed1f-482e-be80-4234e6d81bbf None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:31.358590 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcddaa0-ed1f-482e-be80-4234e6d81bbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:31.358935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcddaa0-ed1f-482e-be80-4234e6d81bbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:31.360293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcddaa0-ed1f-482e-be80-4234e6d81bbf None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:31.373826 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 348/703] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:31.379980 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ade45f-6f25-4c0d-bfda-647d9792548e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:31.381632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef8fd5-da4d-4d9f-85c8-e478d1ce8625 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:31.381915 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef8fd5-da4d-4d9f-85c8-e478d1ce8625 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:31.382190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef8fd5-da4d-4d9f-85c8-e478d1ce8625 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:31.383724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 349/704] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:31.384299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:31.388790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d124f9-8b96-4a69-aa55-715c9ae9bb5d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:31.389078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d124f9-8b96-4a69-aa55-715c9ae9bb5d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:31.389386 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d124f9-8b96-4a69-aa55-715c9ae9bb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:31.399008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:31.413629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c5d124f9-8b96-4a69-aa55-715c9ae9bb5d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:31.414839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c5d124f9-8b96-4a69-aa55-715c9ae9bb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:31.498312 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 350/705] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:31.531997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ade45f-6f25-4c0d-bfda-647d9792548e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:31.568869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ec6c-8205-4f0c-9f5a-5fd84d312871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:31.569569 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ec6c-8205-4f0c-9f5a-5fd84d312871 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:31.569851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ec6c-8205-4f0c-9f5a-5fd84d312871 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:31.570123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ec6c-8205-4f0c-9f5a-5fd84d312871 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:31.577538 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ec6c-8205-4f0c-9f5a-5fd84d312871 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:31.579079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ec6c-8205-4f0c-9f5a-5fd84d312871 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-de94ec6c-8205-4f0c-9f5a-5fd84d312871 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:31.591696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:31.592746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:31.594175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:31.594175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:31.594175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:31.594175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:31.594175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:31.594175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:31.594175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:31.594175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:31.594175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:25:31.594175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:31.594175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 356/706] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 31 04:25:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:31.598571 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d124f9-8b96-4a69-aa55-715c9ae9bb5d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:31.615782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ec6c-8205-4f0c-9f5a-5fd84d312871 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:31.738567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:31.773166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d124f9-8b96-4a69-aa55-715c9ae9bb5d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:31.789256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ec6c-8205-4f0c-9f5a-5fd84d312871 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:31.826991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2492ea3-8e1e-4ebe-9137-78e7e5fa7e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:31.827897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2492ea3-8e1e-4ebe-9137-78e7e5fa7e54 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:31.828436 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2492ea3-8e1e-4ebe-9137-78e7e5fa7e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:31.828849 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2492ea3-8e1e-4ebe-9137-78e7e5fa7e54 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:31.829621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2492ea3-8e1e-4ebe-9137-78e7e5fa7e54 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:31.831448 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2492ea3-8e1e-4ebe-9137-78e7e5fa7e54 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:31.842979 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d298f-8726-4800-ae0e-82106b546b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-b2492ea3-8e1e-4ebe-9137-78e7e5fa7e54 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:31.843482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:31.844734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:31.846338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:31.846338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:31.846338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:31.846338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:31.846338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:31.846338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:31.846338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:31.846338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:31.846338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:31.846338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:31.846338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:25:31.846338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:31.846338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 04:25:31.846338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:31.847224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d298f-8726-4800-ae0e-82106b546b92 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:31.847224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d298f-8726-4800-ae0e-82106b546b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:31.847224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d298f-8726-4800-ae0e-82106b546b92 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:31.847224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d298f-8726-4800-ae0e-82106b546b92 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:31.847224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d298f-8726-4800-ae0e-82106b546b92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:31.849036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d298f-8726-4800-ae0e-82106b546b92 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:31.849453 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 357/707] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Aug 31 04:25:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:31.850485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2492ea3-8e1e-4ebe-9137-78e7e5fa7e54 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:31.855557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:31.975633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2492ea3-8e1e-4ebe-9137-78e7e5fa7e54 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:32.001614 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 351/708] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 31 04:25:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:32.003214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d298f-8726-4800-ae0e-82106b546b92 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:32.008889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:32.017925 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316b483-f720-4b59-a6be-4496f9640bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:32.021757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b483-f720-4b59-a6be-4496f9640bbb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:32.021757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b483-f720-4b59-a6be-4496f9640bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:32.021757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b483-f720-4b59-a6be-4496f9640bbb None admin] PATH_INFO: `/v3/services/network` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:32.021757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316b483-f720-4b59-a6be-4496f9640bbb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:32.021757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316b483-f720-4b59-a6be-4496f9640bbb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-4316b483-f720-4b59-a6be-4496f9640bbb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:32.031162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:32.032368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:32.033937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:32.033937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:32.033937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:32.033937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:32.033937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:32.033937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:32.033937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:32.033937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:32.033937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:32.033937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:32.033937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:25:32.033937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:32.033937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 04:25:32.033937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:32.040522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 358/709] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:31 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:32.040522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316b483-f720-4b59-a6be-4496f9640bbb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:32.126288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d298f-8726-4800-ae0e-82106b546b92 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:32.161933 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316b483-f720-4b59-a6be-4496f9640bbb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:32.163467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff56ce-89d9-41d2-be23-3cc770ff3937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:32.164389 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff56ce-89d9-41d2-be23-3cc770ff3937 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:32.164744 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff56ce-89d9-41d2-be23-3cc770ff3937 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:32.165893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff56ce-89d9-41d2-be23-3cc770ff3937 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:32.165893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff56ce-89d9-41d2-be23-3cc770ff3937 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:32.166163 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff56ce-89d9-41d2-be23-3cc770ff3937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:32.167702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff56ce-89d9-41d2-be23-3cc770ff3937 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:32.177222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 352/710] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 31 04:25:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:32.177222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff56ce-89d9-41d2-be23-3cc770ff3937 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:32.204543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78685df2-0140-40c4-9369-c67c37c38d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:32.206113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78685df2-0140-40c4-9369-c67c37c38d6e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:32.206621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78685df2-0140-40c4-9369-c67c37c38d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:32.207122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78685df2-0140-40c4-9369-c67c37c38d6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:32.239436 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:32.271917 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:32.283254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78685df2-0140-40c4-9369-c67c37c38d6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:32.285030 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78685df2-0140-40c4-9369-c67c37c38d6e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:32.289931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff56ce-89d9-41d2-be23-3cc770ff3937 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:32.327909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9421c-61ea-4454-b025-ffa5fd48c581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:32.328615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9421c-61ea-4454-b025-ffa5fd48c581 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:32.328978 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9421c-61ea-4454-b025-ffa5fd48c581 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:32.329344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9421c-61ea-4454-b025-ffa5fd48c581 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:32.330176 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9421c-61ea-4454-b025-ffa5fd48c581 None admin] RBAC: Adding query filter params (name=network) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:32.330553 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9421c-61ea-4454-b025-ffa5fd48c581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:32.331969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9421c-61ea-4454-b025-ffa5fd48c581 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:32.341231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 353/711] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 31 04:25:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:32.341231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9421c-61ea-4454-b025-ffa5fd48c581 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:32.405921 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 359/712] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:25:32.407213 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78685df2-0140-40c4-9369-c67c37c38d6e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:32.456031 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9421c-61ea-4454-b025-ffa5fd48c581 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:32.483906 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:32.499856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa20c4-36ad-43bb-a87d-090e4ac9684e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:32.500486 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa20c4-36ad-43bb-a87d-090e4ac9684e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:32.500812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa20c4-36ad-43bb-a87d-090e4ac9684e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:32.501089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa20c4-36ad-43bb-a87d-090e4ac9684e None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:32.501912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa20c4-36ad-43bb-a87d-090e4ac9684e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:32.502891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa20c4-36ad-43bb-a87d-090e4ac9684e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:32.504616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa20c4-36ad-43bb-a87d-090e4ac9684e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:32.517233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 354/713] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 31 04:25:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:32.517233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa20c4-36ad-43bb-a87d-090e4ac9684e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:32.538682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:32.557676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78685df2-0140-40c4-9369-c67c37c38d6e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:32.598073 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497c32d-2eb1-4d06-9f97-4829a1014166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:32.598789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497c32d-2eb1-4d06-9f97-4829a1014166 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:32.599070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497c32d-2eb1-4d06-9f97-4829a1014166 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:32.599338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497c32d-2eb1-4d06-9f97-4829a1014166 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:32.599978 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497c32d-2eb1-4d06-9f97-4829a1014166 None admin] RBAC: Adding query filter params (type=network) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:32.600275 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497c32d-2eb1-4d06-9f97-4829a1014166 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:32.601969 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497c32d-2eb1-4d06-9f97-4829a1014166 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:32.608952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 360/714] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 31 04:25:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:32.610377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07045ce6-633f-425a-901f-a87289391068 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:32.610714 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07045ce6-633f-425a-901f-a87289391068 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:32.610988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07045ce6-633f-425a-901f-a87289391068 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:32.617398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 361/715] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:32.619288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f0b56-add3-4ebb-acd4-895133ef2cb3 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:32.619604 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f0b56-add3-4ebb-acd4-895133ef2cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:32.619887 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f0b56-add3-4ebb-acd4-895133ef2cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:32.639864 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-aa5f0b56-add3-4ebb-acd4-895133ef2cb3 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:32.641226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-aa5f0b56-add3-4ebb-acd4-895133ef2cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:32.659919 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa20c4-36ad-43bb-a87d-090e4ac9684e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:32.709304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88b561-3ebb-4edc-a7bc-9789c12e8d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:32.710125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88b561-3ebb-4edc-a7bc-9789c12e8d8c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:32.710403 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88b561-3ebb-4edc-a7bc-9789c12e8d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:32.710674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88b561-3ebb-4edc-a7bc-9789c12e8d8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:32.729415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 362/716] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 04:25:32.731893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88b561-3ebb-4edc-a7bc-9789c12e8d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:32.733404 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88b561-3ebb-4edc-a7bc-9789c12e8d8c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-7d88b561-3ebb-4edc-a7bc-9789c12e8d8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:32.753226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:32.754307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:32.755271 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:32.755271 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:32.755271 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:32.755271 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 355/717] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:32.760451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f0b56-add3-4ebb-acd4-895133ef2cb3 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:32.917721 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:32.936738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f0b56-add3-4ebb-acd4-895133ef2cb3 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:32.985523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7861875-edba-44ac-b513-ed93b197d422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:32.987031 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7861875-edba-44ac-b513-ed93b197d422 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:32.987543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7861875-edba-44ac-b513-ed93b197d422 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:32.988030 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7861875-edba-44ac-b513-ed93b197d422 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:32.988926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7861875-edba-44ac-b513-ed93b197d422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:32.989468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7861875-edba-44ac-b513-ed93b197d422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:32.991053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7861875-edba-44ac-b513-ed93b197d422 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:33.012052 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 363/718] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:33.017584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88b561-3ebb-4edc-a7bc-9789c12e8d8c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:33.045794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7861875-edba-44ac-b513-ed93b197d422 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:33.096209 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:33.152731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88b561-3ebb-4edc-a7bc-9789c12e8d8c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:33.214046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e155ef-6d2c-413e-ac5e-955624e5a1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:33.214605 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e155ef-6d2c-413e-ac5e-955624e5a1ea None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:33.214884 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e155ef-6d2c-413e-ac5e-955624e5a1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:33.215157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e155ef-6d2c-413e-ac5e-955624e5a1ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:33.223532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7861875-edba-44ac-b513-ed93b197d422 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:33.227078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e155ef-6d2c-413e-ac5e-955624e5a1ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:33.228531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e155ef-6d2c-413e-ac5e-955624e5a1ea None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-d1e155ef-6d2c-413e-ac5e-955624e5a1ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:33.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:33.243127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:33.244361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:33.244361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:33.244361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:33.244361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:33.244361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:33.244361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:33.244361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:33.244361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:33.244361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 356/719] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:33.250109 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e155ef-6d2c-413e-ac5e-955624e5a1ea None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:33.277900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492c418-f12f-49d9-aaec-3c4ba4e64c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:33.278922 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492c418-f12f-49d9-aaec-3c4ba4e64c01 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:33.279408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492c418-f12f-49d9-aaec-3c4ba4e64c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:33.279874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492c418-f12f-49d9-aaec-3c4ba4e64c01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:33.302810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492c418-f12f-49d9-aaec-3c4ba4e64c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-6492c418-f12f-49d9-aaec-3c4ba4e64c01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:33.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:33.318221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:33.319094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:33.319094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:33.319094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:33.319094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:33.319094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:33.319094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:33.319094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:33.319094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:33.319094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:33.319094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:33.319094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:33.319094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:33.321925 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 364/720] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:33.327149 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492c418-f12f-49d9-aaec-3c4ba4e64c01 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:33.336622 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:33.363330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:33.369623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e155ef-6d2c-413e-ac5e-955624e5a1ea None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:33.408988 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501018b-9a5c-4138-9967-243b2d2d467b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:33.410018 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501018b-9a5c-4138-9967-243b2d2d467b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:33.410297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501018b-9a5c-4138-9967-243b2d2d467b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:33.410566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501018b-9a5c-4138-9967-243b2d2d467b None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:33.412157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501018b-9a5c-4138-9967-243b2d2d467b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:33.412540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501018b-9a5c-4138-9967-243b2d2d467b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:33.413986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501018b-9a5c-4138-9967-243b2d2d467b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:33.426731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 357/721] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:33.427959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06477c8f-fbcd-4e81-a206-96a1824288e1 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:33.428246 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06477c8f-fbcd-4e81-a206-96a1824288e1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:33.428522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06477c8f-fbcd-4e81-a206-96a1824288e1 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:33.433833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 358/722] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:33.433833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06477c8f-fbcd-4e81-a206-96a1824288e1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:33.476446 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492c418-f12f-49d9-aaec-3c4ba4e64c01 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:33.524214 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9deb56-64a0-4163-9c42-1ecb7b4f0926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:33.525463 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9deb56-64a0-4163-9c42-1ecb7b4f0926 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:33.525952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9deb56-64a0-4163-9c42-1ecb7b4f0926 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:33.526673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9deb56-64a0-4163-9c42-1ecb7b4f0926 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:33.527959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9deb56-64a0-4163-9c42-1ecb7b4f0926 None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:33.528451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9deb56-64a0-4163-9c42-1ecb7b4f0926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:33.530559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9deb56-64a0-4163-9c42-1ecb7b4f0926 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:33.543296 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 365/723] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:33.544420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06477c8f-fbcd-4e81-a206-96a1824288e1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:33.546186 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3143f-1de0-466d-b98f-4eb10b13f540 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:33.546674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3143f-1de0-466d-b98f-4eb10b13f540 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:33.548062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3143f-1de0-466d-b98f-4eb10b13f540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:33.570011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-15f3143f-1de0-466d-b98f-4eb10b13f540 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:33.571808 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-15f3143f-1de0-466d-b98f-4eb10b13f540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:33.585010 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a9df2-d225-4611-bf01-fc485c3a01a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:33.585811 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9df2-d225-4611-bf01-fc485c3a01a0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:33.586152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9df2-d225-4611-bf01-fc485c3a01a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:33.586496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a9df2-d225-4611-bf01-fc485c3a01a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:33.587297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a9df2-d225-4611-bf01-fc485c3a01a0 None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=4877b72a6cea410dbb31a35c7acbd5f9) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:33.587672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a9df2-d225-4611-bf01-fc485c3a01a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:33.589267 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a9df2-d225-4611-bf01-fc485c3a01a0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:33.595214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 359/724] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:33 2022] GET /identity/v3/role_assignments?user.id=4877b72a6cea410dbb31a35c7acbd5f9&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=1896db68dc754d5293037ab100ce46d9 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:33.596717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a9df2-d225-4611-bf01-fc485c3a01a0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:33.623523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:33.677515 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:33.686498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 366/725] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:33.744500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a9df2-d225-4611-bf01-fc485c3a01a0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:33.792352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e0ab6-f3d4-45cd-adc3-2facc163cd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:33.793020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e0ab6-f3d4-45cd-adc3-2facc163cd4a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:33.793328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e0ab6-f3d4-45cd-adc3-2facc163cd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:33.793606 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e0ab6-f3d4-45cd-adc3-2facc163cd4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:33.812567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e0ab6-f3d4-45cd-adc3-2facc163cd4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:33.814433 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e0ab6-f3d4-45cd-adc3-2facc163cd4a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-d31e0ab6-f3d4-45cd-adc3-2facc163cd4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:33.833325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:33.834437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:33.835360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:33.835360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:33.835360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:33.835360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 360/726] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:33.842290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3143f-1de0-466d-b98f-4eb10b13f540 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:33.964581 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3143f-1de0-466d-b98f-4eb10b13f540 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:34.005065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410965f-1a68-413d-a4af-334ba0300072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:34.005634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410965f-1a68-413d-a4af-334ba0300072 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:34.005918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410965f-1a68-413d-a4af-334ba0300072 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:34.006187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410965f-1a68-413d-a4af-334ba0300072 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:34.006844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410965f-1a68-413d-a4af-334ba0300072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:34.007152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410965f-1a68-413d-a4af-334ba0300072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:34.008523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410965f-1a68-413d-a4af-334ba0300072 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:34.022665 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 367/727] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:34.030615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e0ab6-f3d4-45cd-adc3-2facc163cd4a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:34.144201 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410965f-1a68-413d-a4af-334ba0300072 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:34.219604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:34.258787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:34.282737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e0ab6-f3d4-45cd-adc3-2facc163cd4a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:34.336663 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410965f-1a68-413d-a4af-334ba0300072 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:34.359292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff63020-afa7-43d5-a47c-6e65ee914439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:34.359934 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff63020-afa7-43d5-a47c-6e65ee914439 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:34.360280 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff63020-afa7-43d5-a47c-6e65ee914439 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:34.360468 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff63020-afa7-43d5-a47c-6e65ee914439 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:34.377651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff63020-afa7-43d5-a47c-6e65ee914439 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:34.377651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff63020-afa7-43d5-a47c-6e65ee914439 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:34.387470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d1901-75c5-4f2e-8d3a-8ee8c04e09c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:34.388114 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d1901-75c5-4f2e-8d3a-8ee8c04e09c4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:34.389205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d1901-75c5-4f2e-8d3a-8ee8c04e09c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:34.389205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d1901-75c5-4f2e-8d3a-8ee8c04e09c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-0ff63020-afa7-43d5-a47c-6e65ee914439 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:34.396796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:34.397820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:34.398775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:34.398775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:34.398775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:34.398775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:34.398775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:34.398775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:34.398775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:34.398775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:34.398775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 04:25:34.398775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:34.399321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 361/728] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 31 04:25:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:34.406229 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff63020-afa7-43d5-a47c-6e65ee914439 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:34.414627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d1901-75c5-4f2e-8d3a-8ee8c04e09c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d22d1901-75c5-4f2e-8d3a-8ee8c04e09c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:34.431583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:34.432600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:34.434177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:34.434177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:34.434177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:34.434177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:34.434177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:34.434177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:34.434177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:34.434177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:34.434177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:34.434177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:34.434177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:25:34.434177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:34.443824 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 368/729] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:25:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:34.444775 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d1901-75c5-4f2e-8d3a-8ee8c04e09c4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:34.694973 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d1901-75c5-4f2e-8d3a-8ee8c04e09c4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:34.699019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff63020-afa7-43d5-a47c-6e65ee914439 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:34.725881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:34.734932 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d4df3-d0bd-4c0d-9b97-c9fd13b66e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:34.735548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d4df3-d0bd-4c0d-9b97-c9fd13b66e7a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:34.735830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d4df3-d0bd-4c0d-9b97-c9fd13b66e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:34.736103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d4df3-d0bd-4c0d-9b97-c9fd13b66e7a None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:34.737053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d4df3-d0bd-4c0d-9b97-c9fd13b66e7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:34.737484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d4df3-d0bd-4c0d-9b97-c9fd13b66e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:34.739019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d4df3-d0bd-4c0d-9b97-c9fd13b66e7a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:34.748688 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 369/730] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:25:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:34.755082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d4df3-d0bd-4c0d-9b97-c9fd13b66e7a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:34.790243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:34.802024 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2355c-eea7-4557-8e53-cbb176bcc77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:34.802896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2355c-eea7-4557-8e53-cbb176bcc77a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:34.803356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2355c-eea7-4557-8e53-cbb176bcc77a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:34.803826 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2355c-eea7-4557-8e53-cbb176bcc77a None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:34.804769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2355c-eea7-4557-8e53-cbb176bcc77a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:34.805250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2355c-eea7-4557-8e53-cbb176bcc77a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:34.806884 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2355c-eea7-4557-8e53-cbb176bcc77a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:34.849166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 362/731] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 31 04:25:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:34.856191 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2355c-eea7-4557-8e53-cbb176bcc77a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:34.919657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d4df3-d0bd-4c0d-9b97-c9fd13b66e7a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:34.974242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42431d8d-16b7-4733-a909-1f34b1a11b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:34.974801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42431d8d-16b7-4733-a909-1f34b1a11b8f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:34.975081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42431d8d-16b7-4733-a909-1f34b1a11b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:34.975356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42431d8d-16b7-4733-a909-1f34b1a11b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:35.006622 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42431d8d-16b7-4733-a909-1f34b1a11b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:35.008099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42431d8d-16b7-4733-a909-1f34b1a11b8f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-42431d8d-16b7-4733-a909-1f34b1a11b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:35.036537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:35.037768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:35.038715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:35.038715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:35.038715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:35.040233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 370/732] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:35.041508 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2355c-eea7-4557-8e53-cbb176bcc77a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:35.041965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce1a82-ec79-445e-b4a3-d9ecde567718 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:35.041965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce1a82-ec79-445e-b4a3-d9ecde567718 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:35.042147 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce1a82-ec79-445e-b4a3-d9ecde567718 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:35.047080 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 371/733] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:35.047871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce1a82-ec79-445e-b4a3-d9ecde567718 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:35.077833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71482901-f3ba-4b32-a996-cf293387990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:35.078560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71482901-f3ba-4b32-a996-cf293387990b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:35.078834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71482901-f3ba-4b32-a996-cf293387990b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:35.079201 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71482901-f3ba-4b32-a996-cf293387990b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:35.097312 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:35.141238 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:35.154820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71482901-f3ba-4b32-a996-cf293387990b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:35.156241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71482901-f3ba-4b32-a996-cf293387990b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:35.179789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce1a82-ec79-445e-b4a3-d9ecde567718 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:35.214947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e009301-0ba2-4b08-9d66-b2d516561e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:35.215548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009301-0ba2-4b08-9d66-b2d516561e54 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:35.215823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009301-0ba2-4b08-9d66-b2d516561e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:35.216107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009301-0ba2-4b08-9d66-b2d516561e54 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:35.216749 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e009301-0ba2-4b08-9d66-b2d516561e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:35.217086 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e009301-0ba2-4b08-9d66-b2d516561e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:35.218441 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e009301-0ba2-4b08-9d66-b2d516561e54 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:35.231015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 372/734] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:35.232141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b4333-2849-4a0d-a175-9c4572a8d397 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:35.232424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b4333-2849-4a0d-a175-9c4572a8d397 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:35.232698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b4333-2849-4a0d-a175-9c4572a8d397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:35.250928 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5f8b4333-2849-4a0d-a175-9c4572a8d397 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:35.252328 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5f8b4333-2849-4a0d-a175-9c4572a8d397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:35.267552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 363/735] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:25:35.267552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5876921-59bc-487f-852a-815e87e8599e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:35.267552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5876921-59bc-487f-852a-815e87e8599e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:35.267552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5876921-59bc-487f-852a-815e87e8599e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:35.267552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 364/736] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:35.267552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5876921-59bc-487f-852a-815e87e8599e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:35.333782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 373/737] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:35.342084 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b4333-2849-4a0d-a175-9c4572a8d397 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:35.368731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:35.370304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:35.380736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5876921-59bc-487f-852a-815e87e8599e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:35.418283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b054a-b2e4-4512-83c0-bba4a6d098d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:35.418941 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b054a-b2e4-4512-83c0-bba4a6d098d5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:35.419641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b054a-b2e4-4512-83c0-bba4a6d098d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:35.419641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b054a-b2e4-4512-83c0-bba4a6d098d5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:35.427355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b054a-b2e4-4512-83c0-bba4a6d098d5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:35.429178 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b054a-b2e4-4512-83c0-bba4a6d098d5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3f7b054a-b2e4-4512-83c0-bba4a6d098d5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:35.442955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:35.443947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:35.444917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:35.444917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:35.444917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:35.444917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:35.444917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:35.444917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:35.444917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:35.444917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:35.444917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 04:25:35.444917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:35.448771 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 365/738] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:25:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:35.450100 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28de8e6-0c7f-43e3-92d7-53358c466268 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:35.450384 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28de8e6-0c7f-43e3-92d7-53358c466268 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:35.450655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28de8e6-0c7f-43e3-92d7-53358c466268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:35.462281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b4333-2849-4a0d-a175-9c4572a8d397 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:35.469786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c28de8e6-0c7f-43e3-92d7-53358c466268 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:35.471539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c28de8e6-0c7f-43e3-92d7-53358c466268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:35.501318 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf1462-53de-4085-9008-3a75f9267181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:35.503044 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf1462-53de-4085-9008-3a75f9267181 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:35.503531 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf1462-53de-4085-9008-3a75f9267181 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:35.504064 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf1462-53de-4085-9008-3a75f9267181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:35.515681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf1462-53de-4085-9008-3a75f9267181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:35.517669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf1462-53de-4085-9008-3a75f9267181 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-46bf1462-53de-4085-9008-3a75f9267181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:35.534783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:35.535823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:35.536738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:35.536738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:35.536738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:35.543565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 374/739] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:35.544755 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf1462-53de-4085-9008-3a75f9267181 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:35.545889 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 366/740] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 04:25:35.546970 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28de8e6-0c7f-43e3-92d7-53358c466268 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:35.624815 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:35.637595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:35.652687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28de8e6-0c7f-43e3-92d7-53358c466268 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:35.681119 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf1462-53de-4085-9008-3a75f9267181 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:35.688256 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9575b3-fcd3-49c6-8c6a-feadf3eca5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:35.688876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9575b3-fcd3-49c6-8c6a-feadf3eca5cf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:35.689152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9575b3-fcd3-49c6-8c6a-feadf3eca5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:35.690154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9575b3-fcd3-49c6-8c6a-feadf3eca5cf None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:35.690895 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9575b3-fcd3-49c6-8c6a-feadf3eca5cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:35.691193 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9575b3-fcd3-49c6-8c6a-feadf3eca5cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:35.692537 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9575b3-fcd3-49c6-8c6a-feadf3eca5cf None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:35.704447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 367/741] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:35.705407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9575b3-fcd3-49c6-8c6a-feadf3eca5cf None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:35.737893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd22f16-a550-4a9f-bb6a-7f69de6d62c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:35.738990 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd22f16-a550-4a9f-bb6a-7f69de6d62c2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:35.739274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd22f16-a550-4a9f-bb6a-7f69de6d62c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:35.739817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd22f16-a550-4a9f-bb6a-7f69de6d62c2 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:35.740568 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd22f16-a550-4a9f-bb6a-7f69de6d62c2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:35.741269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd22f16-a550-4a9f-bb6a-7f69de6d62c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:35.743429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd22f16-a550-4a9f-bb6a-7f69de6d62c2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:35.774039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 375/742] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 31 04:25:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:35.774039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd22f16-a550-4a9f-bb6a-7f69de6d62c2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:35.828373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9575b3-fcd3-49c6-8c6a-feadf3eca5cf None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:35.864702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2699e5-2d1d-4d69-98c3-b16b86d16b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:35.865370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2699e5-2d1d-4d69-98c3-b16b86d16b05 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:35.865646 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2699e5-2d1d-4d69-98c3-b16b86d16b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:35.865913 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2699e5-2d1d-4d69-98c3-b16b86d16b05 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:35.866560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2699e5-2d1d-4d69-98c3-b16b86d16b05 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:35.867905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2699e5-2d1d-4d69-98c3-b16b86d16b05 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:35.887040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd22f16-a550-4a9f-bb6a-7f69de6d62c2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:35.916098 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:35.920793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c25000-bf63-4828-a596-2694693c1ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:35.921442 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25000-bf63-4828-a596-2694693c1ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:35.921723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25000-bf63-4828-a596-2694693c1ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:35.921996 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25000-bf63-4828-a596-2694693c1ee0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:35.929161 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c25000-bf63-4828-a596-2694693c1ee0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:35.930619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c25000-bf63-4828-a596-2694693c1ee0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d5c25000-bf63-4828-a596-2694693c1ee0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:35.942074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:35.942991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:35.943926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:35.943926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:35.943926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:35.943926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:35.943926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:35.943926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:35.943926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:35.943926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:35.944352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:35.944439 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 376/743] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:35.944439 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c25000-bf63-4828-a596-2694693c1ee0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:35.952988 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 368/744] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 31 04:25:35 2022] POST /identity/v3/services => generated 240 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:35.954310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875852aa-c001-4bcf-8750-6976562dfe56 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:35.954596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875852aa-c001-4bcf-8750-6976562dfe56 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:35.954864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875852aa-c001-4bcf-8750-6976562dfe56 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:35.957250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 369/745] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:35.957250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875852aa-c001-4bcf-8750-6976562dfe56 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:36.056021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c25000-bf63-4828-a596-2694693c1ee0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:36.103174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875852aa-c001-4bcf-8750-6976562dfe56 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:36.103723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93a0f9-4d36-45b4-bb35-2654572fa505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:36.103982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93a0f9-4d36-45b4-bb35-2654572fa505 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:36.104175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93a0f9-4d36-45b4-bb35-2654572fa505 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:36.104447 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93a0f9-4d36-45b4-bb35-2654572fa505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:36.142264 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0f764-6be2-49a7-8d46-3ba3bfaa55df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:36.143517 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0f764-6be2-49a7-8d46-3ba3bfaa55df None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:36.143959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0f764-6be2-49a7-8d46-3ba3bfaa55df None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:36.144230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0f764-6be2-49a7-8d46-3ba3bfaa55df None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:36.145704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0f764-6be2-49a7-8d46-3ba3bfaa55df None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:36.147344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0f764-6be2-49a7-8d46-3ba3bfaa55df None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:36.165880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:36.177830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93a0f9-4d36-45b4-bb35-2654572fa505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:36.179284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93a0f9-4d36-45b4-bb35-2654572fa505 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:36.218768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 370/746] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 31 04:25:35 2022] POST /identity/v3/services => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:36.219524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0f764-6be2-49a7-8d46-3ba3bfaa55df None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:36.294310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:36.316975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 377/747] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:35 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 04:25:36.319198 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123eb92-693b-409a-a9c5-e94d27613b69 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:36.319641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123eb92-693b-409a-a9c5-e94d27613b69 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:36.320405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123eb92-693b-409a-a9c5-e94d27613b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:36.347915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9123eb92-693b-409a-a9c5-e94d27613b69 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:36.349826 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9123eb92-693b-409a-a9c5-e94d27613b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:36.358518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0f764-6be2-49a7-8d46-3ba3bfaa55df None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:36.402917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc1765-9ee0-41ca-8d3a-8d608cf40525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:36.403545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc1765-9ee0-41ca-8d3a-8d608cf40525 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:36.403823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc1765-9ee0-41ca-8d3a-8d608cf40525 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:36.404096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc1765-9ee0-41ca-8d3a-8d608cf40525 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:36.404792 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc1765-9ee0-41ca-8d3a-8d608cf40525 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:36.405561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc1765-9ee0-41ca-8d3a-8d608cf40525 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:36.407373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc1765-9ee0-41ca-8d3a-8d608cf40525 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:36.423746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 371/748] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:36.425993 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc1765-9ee0-41ca-8d3a-8d608cf40525 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:36.445335 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 378/749] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:36.446580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123eb92-693b-409a-a9c5-e94d27613b69 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:36.467295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:36.606509 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc1765-9ee0-41ca-8d3a-8d608cf40525 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:36.620925 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123eb92-693b-409a-a9c5-e94d27613b69 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:36.641576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:36.691288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70248bc-f2a6-43da-a5fc-38d0101fbb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:36.692541 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70248bc-f2a6-43da-a5fc-38d0101fbb3a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:36.693488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70248bc-f2a6-43da-a5fc-38d0101fbb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:36.694380 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70248bc-f2a6-43da-a5fc-38d0101fbb3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:36.698199 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c65f0-ee99-4709-9bce-05fa7f463ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:36.700138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c65f0-ee99-4709-9bce-05fa7f463ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:36.700570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c65f0-ee99-4709-9bce-05fa7f463ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:36.702725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c65f0-ee99-4709-9bce-05fa7f463ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:36.703484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c65f0-ee99-4709-9bce-05fa7f463ae2 None admin] RBAC: Adding query filter params (role.id=8646bae8724e4a26bb49cd7cb1d39593, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=d8f5e60b6e1a4acc87c03da8cf86451e) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:36.703797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c65f0-ee99-4709-9bce-05fa7f463ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:36.706029 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c65f0-ee99-4709-9bce-05fa7f463ae2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:36.709776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70248bc-f2a6-43da-a5fc-38d0101fbb3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:36.711394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70248bc-f2a6-43da-a5fc-38d0101fbb3a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:36.721908 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 379/750] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:36 2022] GET /identity/v3/role_assignments?user.id=d8f5e60b6e1a4acc87c03da8cf86451e&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=8646bae8724e4a26bb49cd7cb1d39593 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b70248bc-f2a6-43da-a5fc-38d0101fbb3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:36.735294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:36.736594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:36.737669 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:36.737669 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:36.737669 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:36.739487 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 372/751] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:36.745122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c65f0-ee99-4709-9bce-05fa7f463ae2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:36.780711 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70248bc-f2a6-43da-a5fc-38d0101fbb3a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:36.849630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:36.870009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c65f0-ee99-4709-9bce-05fa7f463ae2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:36.907594 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5075e-7e53-48e4-a75e-492e316bf3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:36.909061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5075e-7e53-48e4-a75e-492e316bf3ad None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:36.909505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5075e-7e53-48e4-a75e-492e316bf3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:36.909936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5075e-7e53-48e4-a75e-492e316bf3ad None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:36.910931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5075e-7e53-48e4-a75e-492e316bf3ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:36.911371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5075e-7e53-48e4-a75e-492e316bf3ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:36.912907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5075e-7e53-48e4-a75e-492e316bf3ad None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:36.937251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 380/752] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:36.943602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5075e-7e53-48e4-a75e-492e316bf3ad None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:37.013452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70248bc-f2a6-43da-a5fc-38d0101fbb3a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:37.081819 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c2af7-50a8-48f2-8390-9687b27c43b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:37.082454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c2af7-50a8-48f2-8390-9687b27c43b7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:37.082730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c2af7-50a8-48f2-8390-9687b27c43b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:37.083000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c2af7-50a8-48f2-8390-9687b27c43b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:37.103700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c2af7-50a8-48f2-8390-9687b27c43b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-cb1c2af7-50a8-48f2-8390-9687b27c43b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:37.108627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:37.109666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:37.110523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:37.110523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:37.110523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:37.110523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:37.110523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:37.110523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:37.110523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:37.110523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:37.110523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:37.110523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:37.110523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:25:37.110523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:37.117622 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 373/753] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:25:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:37.124363 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c2af7-50a8-48f2-8390-9687b27c43b7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:37.140739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5075e-7e53-48e4-a75e-492e316bf3ad None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:37.173249 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:37.202065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ace31b-55dc-473d-94ee-55a63e2adf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:37.202700 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ace31b-55dc-473d-94ee-55a63e2adf67 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:37.202976 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ace31b-55dc-473d-94ee-55a63e2adf67 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:37.203245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ace31b-55dc-473d-94ee-55a63e2adf67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:37.213054 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ace31b-55dc-473d-94ee-55a63e2adf67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:37.214543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ace31b-55dc-473d-94ee-55a63e2adf67 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-19ace31b-55dc-473d-94ee-55a63e2adf67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:37.232862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:37.234915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:37.237170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:37.237170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:37.237170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:37.237170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:37.237170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:37.237170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:37.237170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:37.237170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:37.237170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 381/754] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:37.244021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ace31b-55dc-473d-94ee-55a63e2adf67 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:37.253517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:37.307047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c2af7-50a8-48f2-8390-9687b27c43b7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:37.377914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45bb01-6bc6-4951-ae2a-4dea73cb4899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:37.378462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45bb01-6bc6-4951-ae2a-4dea73cb4899 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:37.378744 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45bb01-6bc6-4951-ae2a-4dea73cb4899 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:37.379021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45bb01-6bc6-4951-ae2a-4dea73cb4899 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:37.379695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45bb01-6bc6-4951-ae2a-4dea73cb4899 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:37.379999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45bb01-6bc6-4951-ae2a-4dea73cb4899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:37.381420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45bb01-6bc6-4951-ae2a-4dea73cb4899 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:37.392254 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 374/755] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:25:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:37.400970 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45bb01-6bc6-4951-ae2a-4dea73cb4899 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:37.420177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ace31b-55dc-473d-94ee-55a63e2adf67 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:37.460383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e82b6-0f98-4a5e-9e86-799978079137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:37.460986 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e82b6-0f98-4a5e-9e86-799978079137 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:37.461451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e82b6-0f98-4a5e-9e86-799978079137 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:37.463647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e82b6-0f98-4a5e-9e86-799978079137 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:37.463647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e82b6-0f98-4a5e-9e86-799978079137 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:37.463647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e82b6-0f98-4a5e-9e86-799978079137 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:37.464143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e82b6-0f98-4a5e-9e86-799978079137 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:37.577464 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:37.595084 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 382/756] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:37.601162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e82b6-0f98-4a5e-9e86-799978079137 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:37.608085 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45bb01-6bc6-4951-ae2a-4dea73cb4899 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:37.678806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:37.701981 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d46d7-38b2-4505-8a49-3b3d620cf0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:37.702667 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d46d7-38b2-4505-8a49-3b3d620cf0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:37.702954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d46d7-38b2-4505-8a49-3b3d620cf0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:37.703229 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d46d7-38b2-4505-8a49-3b3d620cf0e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:37.722262 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e82b6-0f98-4a5e-9e86-799978079137 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:37.724986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d46d7-38b2-4505-8a49-3b3d620cf0e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:37.726463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d46d7-38b2-4505-8a49-3b3d620cf0e7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:37.758427 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a074e71-8c10-47ce-9a7b-c267e1da37bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:37.759059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074e71-8c10-47ce-9a7b-c267e1da37bc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-796d46d7-38b2-4505-8a49-3b3d620cf0e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:37.759182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:37.760051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:37.761729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:37.761729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:37.761729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:37.762118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074e71-8c10-47ce-9a7b-c267e1da37bc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:37.762118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074e71-8c10-47ce-9a7b-c267e1da37bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:37.762118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a074e71-8c10-47ce-9a7b-c267e1da37bc None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=98c52ca121d34ce6bbeb414c31f5d2fb) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:37.762118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a074e71-8c10-47ce-9a7b-c267e1da37bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:37.762653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 375/757] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:37.762789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a074e71-8c10-47ce-9a7b-c267e1da37bc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:37.769009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d46d7-38b2-4505-8a49-3b3d620cf0e7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:37.772924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 383/758] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:37 2022] GET /identity/v3/role_assignments?user.id=98c52ca121d34ce6bbeb414c31f5d2fb&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=1896db68dc754d5293037ab100ce46d9 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:37.933067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d46d7-38b2-4505-8a49-3b3d620cf0e7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:37.973251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca96a22-3ae6-4bef-81f6-399b622dca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:37.973869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca96a22-3ae6-4bef-81f6-399b622dca99 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:37.974148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca96a22-3ae6-4bef-81f6-399b622dca99 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:37.974420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca96a22-3ae6-4bef-81f6-399b622dca99 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:37.975063 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca96a22-3ae6-4bef-81f6-399b622dca99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:37.975365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca96a22-3ae6-4bef-81f6-399b622dca99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:37.976714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca96a22-3ae6-4bef-81f6-399b622dca99 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:37.984499 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:37.990722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 376/759] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:37.995889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a074e71-8c10-47ce-9a7b-c267e1da37bc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:38.056808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e9ae7-4174-4220-91fb-bf03b0f0f476 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:38.057100 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e9ae7-4174-4220-91fb-bf03b0f0f476 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:38.057490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e9ae7-4174-4220-91fb-bf03b0f0f476 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:38.059184 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 377/760] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:38.064235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d997c0-a900-4067-a395-b259db5fc77c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:38.064558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d997c0-a900-4067-a395-b259db5fc77c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:38.064830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d997c0-a900-4067-a395-b259db5fc77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:38.090426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c4d997c0-a900-4067-a395-b259db5fc77c None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:38.091644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c4d997c0-a900-4067-a395-b259db5fc77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:38.184857 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 378/761] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:25:38.205732 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a074e71-8c10-47ce-9a7b-c267e1da37bc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:38.245525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:38.262299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b1f81-ec19-4169-a46b-1304011b297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:38.268970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b1f81-ec19-4169-a46b-1304011b297e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:38.268970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b1f81-ec19-4169-a46b-1304011b297e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:38.268970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b1f81-ec19-4169-a46b-1304011b297e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:38.273588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b1f81-ec19-4169-a46b-1304011b297e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:38.275031 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b1f81-ec19-4169-a46b-1304011b297e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-442b1f81-ec19-4169-a46b-1304011b297e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:38.290385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:38.291329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:38.292850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:38.292850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:38.292850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:38.292850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:38.292850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:38.292850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:38.292850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:38.292850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:38.292850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:25:38.292850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:38.292850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 384/762] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 31 04:25:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:38.297064 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d997c0-a900-4067-a395-b259db5fc77c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:38.402913 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d997c0-a900-4067-a395-b259db5fc77c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:38.436614 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:38.445804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6d75e-4b8b-4b29-bfec-174a0c95c813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:38.446416 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6d75e-4b8b-4b29-bfec-174a0c95c813 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:38.446696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6d75e-4b8b-4b29-bfec-174a0c95c813 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:38.446968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6d75e-4b8b-4b29-bfec-174a0c95c813 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:38.447699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6d75e-4b8b-4b29-bfec-174a0c95c813 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:38.455717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6d75e-4b8b-4b29-bfec-174a0c95c813 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:38.455717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6d75e-4b8b-4b29-bfec-174a0c95c813 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:38.467540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 379/763] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 31 04:25:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:38.475640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b1f81-ec19-4169-a46b-1304011b297e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:38.586364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b1f81-ec19-4169-a46b-1304011b297e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:38.597389 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6d75e-4b8b-4b29-bfec-174a0c95c813 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:38.627832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24874891-9e07-4658-9a7f-14f8501399fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:38.628581 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24874891-9e07-4658-9a7f-14f8501399fc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:38.628861 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24874891-9e07-4658-9a7f-14f8501399fc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:38.629137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24874891-9e07-4658-9a7f-14f8501399fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:38.640322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24874891-9e07-4658-9a7f-14f8501399fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:38.641811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24874891-9e07-4658-9a7f-14f8501399fc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-24874891-9e07-4658-9a7f-14f8501399fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:38.657506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:38.658715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:38.659856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:38.659856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:38.659856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:38.659856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 385/764] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:38.664172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c425b-c542-470e-8c65-66d9edddcc0f None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:38.664468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c425b-c542-470e-8c65-66d9edddcc0f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:38.664748 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c425b-c542-470e-8c65-66d9edddcc0f None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:38.666346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 386/765] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:38.671408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c425b-c542-470e-8c65-66d9edddcc0f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:38.727744 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6d75e-4b8b-4b29-bfec-174a0c95c813 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:38.738535 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:38.764536 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a9ae9-9763-4c7a-91e6-a3f48a42d332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:38.765480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9ae9-9763-4c7a-91e6-a3f48a42d332 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:38.765963 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9ae9-9763-4c7a-91e6-a3f48a42d332 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:38.766406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9ae9-9763-4c7a-91e6-a3f48a42d332 None admin] PATH_INFO: `/v3/services/network` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:38.767182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a9ae9-9763-4c7a-91e6-a3f48a42d332 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:38.768926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a9ae9-9763-4c7a-91e6-a3f48a42d332 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6f3a9ae9-9763-4c7a-91e6-a3f48a42d332 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:38.781400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:38.782449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:38.783831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:38.783831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:38.783831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:38.783831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:38.783831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:38.783831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:38.783831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:38.783831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:38.783831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:38.783831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:38.783831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:25:38.783831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:38.783831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 04:25:38.783831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:38.786698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 380/766] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:38 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:38.788354 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21221ee3-ee27-44d9-b93b-1f59c440da72 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:38.788836 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21221ee3-ee27-44d9-b93b-1f59c440da72 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:38.789436 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21221ee3-ee27-44d9-b93b-1f59c440da72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:38.806289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c425b-c542-470e-8c65-66d9edddcc0f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:38.809743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-21221ee3-ee27-44d9-b93b-1f59c440da72 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:38.811169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-21221ee3-ee27-44d9-b93b-1f59c440da72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:38.845584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c7b8d-5b96-4e85-b2b7-a5e93ecb2217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:38.846353 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7b8d-5b96-4e85-b2b7-a5e93ecb2217 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:38.846678 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7b8d-5b96-4e85-b2b7-a5e93ecb2217 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:38.846948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7b8d-5b96-4e85-b2b7-a5e93ecb2217 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:38.847705 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c7b8d-5b96-4e85-b2b7-a5e93ecb2217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:38.848002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c7b8d-5b96-4e85-b2b7-a5e93ecb2217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:38.849466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c7b8d-5b96-4e85-b2b7-a5e93ecb2217 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:38.862645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:38.868572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 387/767] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:38.869545 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c7b8d-5b96-4e85-b2b7-a5e93ecb2217 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:38.886270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 381/768] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:38.887454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21221ee3-ee27-44d9-b93b-1f59c440da72 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:39.015704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21221ee3-ee27-44d9-b93b-1f59c440da72 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:39.062281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:39.069675 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c7b8d-5b96-4e85-b2b7-a5e93ecb2217 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:39.087435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120387c-f690-4446-b291-69a59515ea13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:39.088077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120387c-f690-4446-b291-69a59515ea13 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:39.088349 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120387c-f690-4446-b291-69a59515ea13 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:39.088617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120387c-f690-4446-b291-69a59515ea13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:39.097929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120387c-f690-4446-b291-69a59515ea13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:39.099365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120387c-f690-4446-b291-69a59515ea13 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b120387c-f690-4446-b291-69a59515ea13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:39.118466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:39.119445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:39.120372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:39.120372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:39.120372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:39.120372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:39.120372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:39.120372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:39.120372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:39.120372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:39.124421 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 382/769] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:39.125965 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120387c-f690-4446-b291-69a59515ea13 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:39.136789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6b16f-955d-4450-83fa-c10a2c2dacf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:39.140291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6b16f-955d-4450-83fa-c10a2c2dacf8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:39.140570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6b16f-955d-4450-83fa-c10a2c2dacf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:39.140837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6b16f-955d-4450-83fa-c10a2c2dacf8 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:39.141540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6b16f-955d-4450-83fa-c10a2c2dacf8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:39.141838 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6b16f-955d-4450-83fa-c10a2c2dacf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:39.143235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6b16f-955d-4450-83fa-c10a2c2dacf8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:39.154882 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 388/770] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 31 04:25:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:39.160381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6b16f-955d-4450-83fa-c10a2c2dacf8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:39.208598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:39.279177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120387c-f690-4446-b291-69a59515ea13 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:39.298816 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6b16f-955d-4450-83fa-c10a2c2dacf8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:39.318794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c37aa-d7d9-4142-89ed-19299aab0c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:39.319503 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c37aa-d7d9-4142-89ed-19299aab0c6a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:39.319665 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c37aa-d7d9-4142-89ed-19299aab0c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:39.319933 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c37aa-d7d9-4142-89ed-19299aab0c6a None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:39.320620 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c37aa-d7d9-4142-89ed-19299aab0c6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:39.320919 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c37aa-d7d9-4142-89ed-19299aab0c6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:39.322364 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c37aa-d7d9-4142-89ed-19299aab0c6a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:39.339707 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 383/771] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:39.340141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab254f2a-1aaf-4565-b8b9-be7a49a4fbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:39.340750 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab254f2a-1aaf-4565-b8b9-be7a49a4fbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:39.341035 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab254f2a-1aaf-4565-b8b9-be7a49a4fbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:39.341337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7e5f0-b81e-42e2-a56b-387575085e93 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:39.341450 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab254f2a-1aaf-4565-b8b9-be7a49a4fbb4 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:39.341688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7e5f0-b81e-42e2-a56b-387575085e93 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:39.341971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab254f2a-1aaf-4565-b8b9-be7a49a4fbb4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:39.342078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7e5f0-b81e-42e2-a56b-387575085e93 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:39.342273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab254f2a-1aaf-4565-b8b9-be7a49a4fbb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:39.347945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab254f2a-1aaf-4565-b8b9-be7a49a4fbb4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:39.348083 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 384/772] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:39.348083 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7e5f0-b81e-42e2-a56b-387575085e93 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:39.353548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 389/773] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 31 04:25:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:39.358288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab254f2a-1aaf-4565-b8b9-be7a49a4fbb4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:39.385430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:39.457171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:39.461768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7e5f0-b81e-42e2-a56b-387575085e93 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:39.466479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab254f2a-1aaf-4565-b8b9-be7a49a4fbb4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:39.497375 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9c029-ea0a-40c1-a5a6-e3ce9883fdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:39.498010 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9c029-ea0a-40c1-a5a6-e3ce9883fdee None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:39.498288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9c029-ea0a-40c1-a5a6-e3ce9883fdee None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:39.498564 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9c029-ea0a-40c1-a5a6-e3ce9883fdee None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:39.499141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9c029-ea0a-40c1-a5a6-e3ce9883fdee None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:39.500494 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9c029-ea0a-40c1-a5a6-e3ce9883fdee None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:39.503889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3971bd-8074-48c3-8060-917d95a691c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:39.504534 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3971bd-8074-48c3-8060-917d95a691c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:39.504807 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3971bd-8074-48c3-8060-917d95a691c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:39.505080 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3971bd-8074-48c3-8060-917d95a691c1 None admin] PATH_INFO: `/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/4877b72a6cea410dbb31a35c7acbd5f9/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:39.506968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3971bd-8074-48c3-8060-917d95a691c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff768fb064ce4d53b2e46ea611d3d103, user_id=4877b72a6cea410dbb31a35c7acbd5f9, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:39.508369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3971bd-8074-48c3-8060-917d95a691c1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-66d9c029-ea0a-40c1-a5a6-e3ce9883fdee None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:39.510741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:39.511949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:39.513003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:39.513003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:39.513003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:39.513003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:39.513003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:39.513003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:39.513003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:39.513003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:39.513003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:39.513003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:39.513003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:25:39.513003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:39.513003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 04:25:39.513003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:39.515184 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 385/774] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Aug 31 04:25:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:39.516613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8b8e5-2401-4bd1-a0cd-f098ab7b5128 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:39.516901 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8b8e5-2401-4bd1-a0cd-f098ab7b5128 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:39.517174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8b8e5-2401-4bd1-a0cd-f098ab7b5128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:39.535959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ead8b8e5-2401-4bd1-a0cd-f098ab7b5128 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:39.537068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ead8b8e5-2401-4bd1-a0cd-f098ab7b5128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:39.589226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 390/775] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:25:39 2022] PUT /identity/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/4877b72a6cea410dbb31a35c7acbd5f9/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:25:39.589226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3971bd-8074-48c3-8060-917d95a691c1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:39.625365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 386/776] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:39.626277 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8b8e5-2401-4bd1-a0cd-f098ab7b5128 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:39.746360 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:39.764941 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3971bd-8074-48c3-8060-917d95a691c1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:39.790712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:39.799995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8b8e5-2401-4bd1-a0cd-f098ab7b5128 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:39.807631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcc7fe-c604-4c6d-b429-a58aa511b517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:39.808390 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcc7fe-c604-4c6d-b429-a58aa511b517 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:39.808680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcc7fe-c604-4c6d-b429-a58aa511b517 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:39.809007 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcc7fe-c604-4c6d-b429-a58aa511b517 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:39.810528 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcc7fe-c604-4c6d-b429-a58aa511b517 None admin] RBAC: Adding query filter params (interface=public, service_id=e46451c038684ab292a1550629b8d165, region_id=RegionOne) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:39.813733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcc7fe-c604-4c6d-b429-a58aa511b517 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:39.813733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcc7fe-c604-4c6d-b429-a58aa511b517 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:39.820697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 391/777] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 31 04:25:39 2022] GET /identity/v3/endpoints?service_id=e46451c038684ab292a1550629b8d165&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:39.825794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcc7fe-c604-4c6d-b429-a58aa511b517 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:39.843381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0362b-f329-464a-b360-94cf3b125fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:39.844242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0362b-f329-464a-b360-94cf3b125fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:39.844910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0362b-f329-464a-b360-94cf3b125fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:39.845397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0362b-f329-464a-b360-94cf3b125fb9 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:39.846910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0362b-f329-464a-b360-94cf3b125fb9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:39.847366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0362b-f329-464a-b360-94cf3b125fb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:39.849490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0362b-f329-464a-b360-94cf3b125fb9 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:39.856224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 387/778] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 31 04:25:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:39.862770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0362b-f329-464a-b360-94cf3b125fb9 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:39.944038 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcc7fe-c604-4c6d-b429-a58aa511b517 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:39.987519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0362b-f329-464a-b360-94cf3b125fb9 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:39.991409 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023001d9-6536-44c5-a35a-a2f9847eaf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:39.992187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023001d9-6536-44c5-a35a-a2f9847eaf24 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:39.992625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023001d9-6536-44c5-a35a-a2f9847eaf24 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:39.993035 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023001d9-6536-44c5-a35a-a2f9847eaf24 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:39.993799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023001d9-6536-44c5-a35a-a2f9847eaf24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:39.995303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023001d9-6536-44c5-a35a-a2f9847eaf24 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:40.004126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 392/779] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 31 04:25:39 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:40.013431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8d758-3457-4b32-87fc-05afa5d82506 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:40.013431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8d758-3457-4b32-87fc-05afa5d82506 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:40.013431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8d758-3457-4b32-87fc-05afa5d82506 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:40.013431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 393/780] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:40.015760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc660d-b846-4c17-92e1-dad4f10deef6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:40.016136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc660d-b846-4c17-92e1-dad4f10deef6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:40.016307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc660d-b846-4c17-92e1-dad4f10deef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:40.042380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-55fc660d-b846-4c17-92e1-dad4f10deef6 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:40.043846 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-55fc660d-b846-4c17-92e1-dad4f10deef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:40.052577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee49f53-5cd9-45e0-af22-3972c4416d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:40.052577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee49f53-5cd9-45e0-af22-3972c4416d01 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:40.052577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee49f53-5cd9-45e0-af22-3972c4416d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:40.052577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee49f53-5cd9-45e0-af22-3972c4416d01 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:40.053036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee49f53-5cd9-45e0-af22-3972c4416d01 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:40.053036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee49f53-5cd9-45e0-af22-3972c4416d01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:40.053633 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee49f53-5cd9-45e0-af22-3972c4416d01 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:40.060063 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 388/781] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 31 04:25:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:40.060987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee49f53-5cd9-45e0-af22-3972c4416d01 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:40.064920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:40.092472 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:40.136111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 394/782] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:25:40.137347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc660d-b846-4c17-92e1-dad4f10deef6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:40.202095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee49f53-5cd9-45e0-af22-3972c4416d01 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:40.244201 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5c910-ac15-4de1-8615-457cf417974e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:40.244833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c910-ac15-4de1-8615-457cf417974e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:40.245093 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c910-ac15-4de1-8615-457cf417974e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:40.245402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c910-ac15-4de1-8615-457cf417974e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:40.259314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc660d-b846-4c17-92e1-dad4f10deef6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:40.259477 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5c910-ac15-4de1-8615-457cf417974e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-bfb5c910-ac15-4de1-8615-457cf417974e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:40.264127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:40.265059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:40.266188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:40.266188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:40.266188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:40.266188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:40.266188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:40.266188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:40.266188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:40.266188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:40.266188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:40.266188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:40.266188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:40.266188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:40.266188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 389/783] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:40.272412 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5c910-ac15-4de1-8615-457cf417974e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:40.302828 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc483e-fed0-44f8-8f03-8ddc9ef24d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:40.303881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc483e-fed0-44f8-8f03-8ddc9ef24d36 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:40.304300 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc483e-fed0-44f8-8f03-8ddc9ef24d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:40.304738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc483e-fed0-44f8-8f03-8ddc9ef24d36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:40.305611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc483e-fed0-44f8-8f03-8ddc9ef24d36 None admin] RBAC: Adding query filter params (interface=public, service_id=5ed90a0d598a4414ae831013e5d677a4, region_id=RegionOne) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:40.306187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc483e-fed0-44f8-8f03-8ddc9ef24d36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:40.307878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc483e-fed0-44f8-8f03-8ddc9ef24d36 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:40.313924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 395/784] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 31 04:25:40 2022] GET /identity/v3/endpoints?service_id=5ed90a0d598a4414ae831013e5d677a4&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:40.319100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc483e-fed0-44f8-8f03-8ddc9ef24d36 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:40.331362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:40.362663 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:40.380666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5c910-ac15-4de1-8615-457cf417974e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:40.417497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d2bed-a792-445a-8bd7-221c4d04ff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:40.418049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d2bed-a792-445a-8bd7-221c4d04ff73 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:40.418325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d2bed-a792-445a-8bd7-221c4d04ff73 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:40.418596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d2bed-a792-445a-8bd7-221c4d04ff73 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:40.419326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d2bed-a792-445a-8bd7-221c4d04ff73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:40.419548 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d2bed-a792-445a-8bd7-221c4d04ff73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:40.420921 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d2bed-a792-445a-8bd7-221c4d04ff73 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:40.430366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 390/785] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:40.431772 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc483e-fed0-44f8-8f03-8ddc9ef24d36 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:40.435794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d2bed-a792-445a-8bd7-221c4d04ff73 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:40.478165 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a1d80-994f-4781-a457-366603b19c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:40.479052 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a1d80-994f-4781-a457-366603b19c63 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:40.479529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a1d80-994f-4781-a457-366603b19c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:40.479940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a1d80-994f-4781-a457-366603b19c63 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:40.480682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a1d80-994f-4781-a457-366603b19c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:40.482431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a1d80-994f-4781-a457-366603b19c63 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:40.489289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 396/786] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 31 04:25:40 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:40.491993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a1d80-994f-4781-a457-366603b19c63 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:40.588104 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:40.623962 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a1d80-994f-4781-a457-366603b19c63 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:40.664830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d2bed-a792-445a-8bd7-221c4d04ff73 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:40.690602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64a724-7d09-463e-8a11-1dbc5881c623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:40.691242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64a724-7d09-463e-8a11-1dbc5881c623 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:40.691517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64a724-7d09-463e-8a11-1dbc5881c623 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:40.693140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64a724-7d09-463e-8a11-1dbc5881c623 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:40.707934 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64a724-7d09-463e-8a11-1dbc5881c623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-cd64a724-7d09-463e-8a11-1dbc5881c623 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:40.713070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:40.714111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:40.714961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:40.714961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:40.714961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:40.714961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:40.714961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:40.714961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:40.714961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:40.714961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:40.714961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:40.714961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:40.714961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:25:40.714961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:40.719360 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 397/787] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:25:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:40.726011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64a724-7d09-463e-8a11-1dbc5881c623 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:40.728808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6a34-b7c4-4bae-b5a0-7e04fe4f688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:40.729873 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6a34-b7c4-4bae-b5a0-7e04fe4f688c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:40.730368 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6a34-b7c4-4bae-b5a0-7e04fe4f688c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:40.730814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6a34-b7c4-4bae-b5a0-7e04fe4f688c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:40.742844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff6a34-b7c4-4bae-b5a0-7e04fe4f688c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:40.744587 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff6a34-b7c4-4bae-b5a0-7e04fe4f688c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:40.752755 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-63ff6a34-b7c4-4bae-b5a0-7e04fe4f688c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:40.766514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:40.767505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:40.769756 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:40.769756 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:40.769756 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:40.769756 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 391/788] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:40.775356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6a34-b7c4-4bae-b5a0-7e04fe4f688c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:40.886769 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64a724-7d09-463e-8a11-1dbc5881c623 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:40.917950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:40.923103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae12f5d-cefb-402a-a461-4b35f88a6768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:40.923869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae12f5d-cefb-402a-a461-4b35f88a6768 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:40.924156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae12f5d-cefb-402a-a461-4b35f88a6768 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:40.928406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae12f5d-cefb-402a-a461-4b35f88a6768 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:40.928406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae12f5d-cefb-402a-a461-4b35f88a6768 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:40.928406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae12f5d-cefb-402a-a461-4b35f88a6768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:40.928406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae12f5d-cefb-402a-a461-4b35f88a6768 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:40.937106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 398/789] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:25:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:40.949083 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6a34-b7c4-4bae-b5a0-7e04fe4f688c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:40.949725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae12f5d-cefb-402a-a461-4b35f88a6768 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:40.985433 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0decede-07f3-4e4c-b33b-d8e9fcbe72b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:40.986143 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0decede-07f3-4e4c-b33b-d8e9fcbe72b6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:40.986451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0decede-07f3-4e4c-b33b-d8e9fcbe72b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:40.986784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0decede-07f3-4e4c-b33b-d8e9fcbe72b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:40.987410 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0decede-07f3-4e4c-b33b-d8e9fcbe72b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:40.987712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0decede-07f3-4e4c-b33b-d8e9fcbe72b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:40.989176 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0decede-07f3-4e4c-b33b-d8e9fcbe72b6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:41.003113 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 392/790] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:41.013446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0decede-07f3-4e4c-b33b-d8e9fcbe72b6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:41.106398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae12f5d-cefb-402a-a461-4b35f88a6768 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:41.136923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:41.175676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a67d4f-f7eb-4f37-9267-8c070b62b2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:41.176311 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a67d4f-f7eb-4f37-9267-8c070b62b2ac None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:41.176589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a67d4f-f7eb-4f37-9267-8c070b62b2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:41.176855 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a67d4f-f7eb-4f37-9267-8c070b62b2ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:41.199351 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a67d4f-f7eb-4f37-9267-8c070b62b2ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:41.200876 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a67d4f-f7eb-4f37-9267-8c070b62b2ac None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:41.219069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0decede-07f3-4e4c-b33b-d8e9fcbe72b6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-f1a67d4f-f7eb-4f37-9267-8c070b62b2ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:41.233333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:41.234364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:41.235272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:41.235272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:41.235272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:41.238795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 399/791] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:41.242309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a67d4f-f7eb-4f37-9267-8c070b62b2ac None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:41.291142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d49b30-8db2-4dfd-a101-2f455c7922f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:41.293181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49b30-8db2-4dfd-a101-2f455c7922f7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:41.293485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49b30-8db2-4dfd-a101-2f455c7922f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:41.293761 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49b30-8db2-4dfd-a101-2f455c7922f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:41.313931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d49b30-8db2-4dfd-a101-2f455c7922f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:41.317911 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d49b30-8db2-4dfd-a101-2f455c7922f7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-72d49b30-8db2-4dfd-a101-2f455c7922f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:41.334121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:41.335124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:41.336097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:41.336097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:41.336097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:41.336097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:41.336097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:41.336097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:41.336097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:41.336097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:41.336097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 04:25:41.336097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:41.336097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 393/792] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 31 04:25:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:41.343322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:41.344889 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d49b30-8db2-4dfd-a101-2f455c7922f7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:41.456038 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a67d4f-f7eb-4f37-9267-8c070b62b2ac None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:41.500265 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffae95c-4ccb-46ff-9474-e03e9f72091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:41.500929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffae95c-4ccb-46ff-9474-e03e9f72091a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:41.501223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffae95c-4ccb-46ff-9474-e03e9f72091a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:41.501510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffae95c-4ccb-46ff-9474-e03e9f72091a None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:41.502725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffae95c-4ccb-46ff-9474-e03e9f72091a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:41.509309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffae95c-4ccb-46ff-9474-e03e9f72091a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:41.510766 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffae95c-4ccb-46ff-9474-e03e9f72091a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:41.536642 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d49b30-8db2-4dfd-a101-2f455c7922f7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:41.540514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 400/793] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:41.545710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffae95c-4ccb-46ff-9474-e03e9f72091a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:41.573537 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:41.611512 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d65c4-ad84-40a5-8175-0a8bf2c849e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:41.612122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d65c4-ad84-40a5-8175-0a8bf2c849e2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:41.613331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d65c4-ad84-40a5-8175-0a8bf2c849e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:41.613696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d65c4-ad84-40a5-8175-0a8bf2c849e2 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:41.621659 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d65c4-ad84-40a5-8175-0a8bf2c849e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:41.622223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d65c4-ad84-40a5-8175-0a8bf2c849e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:41.623855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d65c4-ad84-40a5-8175-0a8bf2c849e2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:41.667635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 394/794] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 31 04:25:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:41.672910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d65c4-ad84-40a5-8175-0a8bf2c849e2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:41.686812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffae95c-4ccb-46ff-9474-e03e9f72091a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:41.696001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:41.732341 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4c7b4-d199-4d04-8e4d-2e4d6dbc22ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:41.733230 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4c7b4-d199-4d04-8e4d-2e4d6dbc22ef None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:41.734380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4c7b4-d199-4d04-8e4d-2e4d6dbc22ef None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:41.734797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4c7b4-d199-4d04-8e4d-2e4d6dbc22ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:41.758222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4c7b4-d199-4d04-8e4d-2e4d6dbc22ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:41.759608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4c7b4-d199-4d04-8e4d-2e4d6dbc22ef None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-39c4c7b4-d199-4d04-8e4d-2e4d6dbc22ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:41.778715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:41.780529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:41.781543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:41.781543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:41.781543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:41.781543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:41.781543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:41.781543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:41.781543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:41.781543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:41.781543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 04:25:41.781543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:41.781543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 401/795] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:25:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:41.785977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4c7b4-d199-4d04-8e4d-2e4d6dbc22ef None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:41.828053 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d65c4-ad84-40a5-8175-0a8bf2c849e2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:41.869238 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df612fed-03ba-4cc6-9a3c-1f4a53a5a965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:41.869496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df612fed-03ba-4cc6-9a3c-1f4a53a5a965 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:41.869773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df612fed-03ba-4cc6-9a3c-1f4a53a5a965 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:41.871228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df612fed-03ba-4cc6-9a3c-1f4a53a5a965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:41.883873 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df612fed-03ba-4cc6-9a3c-1f4a53a5a965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:41.885567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df612fed-03ba-4cc6-9a3c-1f4a53a5a965 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-df612fed-03ba-4cc6-9a3c-1f4a53a5a965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:41.902515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:41.903676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:41.904803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:41.904803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:41.904803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:41.910560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 395/796] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:41.912050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882f51e-f497-4c2c-94c5-51d0fffb9517 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:41.912401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882f51e-f497-4c2c-94c5-51d0fffb9517 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:41.912743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882f51e-f497-4c2c-94c5-51d0fffb9517 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:41.914404 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 396/797] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:41.915201 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882f51e-f497-4c2c-94c5-51d0fffb9517 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:41.937111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4c7b4-d199-4d04-8e4d-2e4d6dbc22ef None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:41.949595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:41.977694 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20602df6-c1b3-4830-8cfa-b8264bd43932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:41.978469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20602df6-c1b3-4830-8cfa-b8264bd43932 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:41.978866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20602df6-c1b3-4830-8cfa-b8264bd43932 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:41.979213 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20602df6-c1b3-4830-8cfa-b8264bd43932 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:41.981101 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20602df6-c1b3-4830-8cfa-b8264bd43932 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:41.981553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20602df6-c1b3-4830-8cfa-b8264bd43932 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:41.983154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20602df6-c1b3-4830-8cfa-b8264bd43932 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:42.003201 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 402/798] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 31 04:25:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:42.004641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59cbe2-dbb6-4745-8193-ee6feb8dcb94 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:42.004995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59cbe2-dbb6-4745-8193-ee6feb8dcb94 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:42.005426 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59cbe2-dbb6-4745-8193-ee6feb8dcb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:42.030124 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-0a59cbe2-dbb6-4745-8193-ee6feb8dcb94 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:42.031644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0a59cbe2-dbb6-4745-8193-ee6feb8dcb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:42.047300 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882f51e-f497-4c2c-94c5-51d0fffb9517 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:42.060096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:42.098644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70264af7-2726-4f4d-bd40-40f1858bf726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:42.100089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70264af7-2726-4f4d-bd40-40f1858bf726 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:42.101120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70264af7-2726-4f4d-bd40-40f1858bf726 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:42.101917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70264af7-2726-4f4d-bd40-40f1858bf726 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:42.103847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70264af7-2726-4f4d-bd40-40f1858bf726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:42.104615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70264af7-2726-4f4d-bd40-40f1858bf726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:42.107529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70264af7-2726-4f4d-bd40-40f1858bf726 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:42.122902 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 403/799] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:42.124189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 397/800] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:42.125006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59cbe2-dbb6-4745-8193-ee6feb8dcb94 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:42.129638 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70264af7-2726-4f4d-bd40-40f1858bf726 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:42.265644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:42.288753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70264af7-2726-4f4d-bd40-40f1858bf726 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:42.326832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91085b26-92e3-4eb9-b8a8-a949c70c95b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:42.327463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91085b26-92e3-4eb9-b8a8-a949c70c95b4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:42.327730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91085b26-92e3-4eb9-b8a8-a949c70c95b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:42.328004 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91085b26-92e3-4eb9-b8a8-a949c70c95b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:42.335078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91085b26-92e3-4eb9-b8a8-a949c70c95b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:42.335239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59cbe2-dbb6-4745-8193-ee6feb8dcb94 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:42.336520 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91085b26-92e3-4eb9-b8a8-a949c70c95b4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-91085b26-92e3-4eb9-b8a8-a949c70c95b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:42.350141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:42.351099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:42.352032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:42.352032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:42.352032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:42.352032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:42.352032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:42.352032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:42.352032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:42.352032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:42.352032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 398/801] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:42.357828 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91085b26-92e3-4eb9-b8a8-a949c70c95b4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:42.411526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a9f7-77c9-4654-aaa1-37d079db70ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:42.412174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a9f7-77c9-4654-aaa1-37d079db70ed None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:42.412452 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a9f7-77c9-4654-aaa1-37d079db70ed None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:42.412724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a9f7-77c9-4654-aaa1-37d079db70ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:42.423591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644a9f7-77c9-4654-aaa1-37d079db70ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:42.425138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644a9f7-77c9-4654-aaa1-37d079db70ed None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-6644a9f7-77c9-4654-aaa1-37d079db70ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:42.442329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:42.443369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:42.444310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:42.444310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:42.444310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:42.444931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 404/802] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:42.448774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac081a8-d0d8-4078-bdbe-0b5620320d6f None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:42.448774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac081a8-d0d8-4078-bdbe-0b5620320d6f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:42.448774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac081a8-d0d8-4078-bdbe-0b5620320d6f None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:42.449332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 405/803] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:42.450294 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac081a8-d0d8-4078-bdbe-0b5620320d6f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:42.461375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:42.499755 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91085b26-92e3-4eb9-b8a8-a949c70c95b4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:42.541752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc43dc-9e5b-4ba8-a8fe-822aed2c638d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:42.542277 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc43dc-9e5b-4ba8-a8fe-822aed2c638d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:42.542556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc43dc-9e5b-4ba8-a8fe-822aed2c638d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:42.542825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc43dc-9e5b-4ba8-a8fe-822aed2c638d None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:42.543522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc43dc-9e5b-4ba8-a8fe-822aed2c638d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:42.543830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc43dc-9e5b-4ba8-a8fe-822aed2c638d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:42.545270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc43dc-9e5b-4ba8-a8fe-822aed2c638d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:42.563807 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 399/804] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:42.565083 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc43dc-9e5b-4ba8-a8fe-822aed2c638d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:42.568747 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac081a8-d0d8-4078-bdbe-0b5620320d6f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:42.574029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:42.604194 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c6035-1e7d-4cc6-a159-afc21aa7a6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:42.604827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c6035-1e7d-4cc6-a159-afc21aa7a6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:42.605159 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c6035-1e7d-4cc6-a159-afc21aa7a6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:42.605466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c6035-1e7d-4cc6-a159-afc21aa7a6c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:42.617174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c6035-1e7d-4cc6-a159-afc21aa7a6c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-db1c6035-1e7d-4cc6-a159-afc21aa7a6c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:42.622152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:42.623118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:42.623981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:42.623981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:42.623981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:42.623981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:42.623981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:42.623981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:42.623981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:42.623981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:42.623981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:42.623981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:42.623981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:25:42.623981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:42.623981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 406/805] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:25:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:42.624690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7a75c-ab33-4c61-9807-9d9f46c30d95 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:42.625094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7a75c-ab33-4c61-9807-9d9f46c30d95 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:42.625094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7a75c-ab33-4c61-9807-9d9f46c30d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:42.644131 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4dc7a75c-ab33-4c61-9807-9d9f46c30d95 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:42.645356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4dc7a75c-ab33-4c61-9807-9d9f46c30d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:42.678054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc43dc-9e5b-4ba8-a8fe-822aed2c638d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:42.708129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:42.715449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 407/806] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:42.715681 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021142ea-80c4-401e-9fb9-d63d6c5290cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:42.716271 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021142ea-80c4-401e-9fb9-d63d6c5290cf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:42.716523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021142ea-80c4-401e-9fb9-d63d6c5290cf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:42.716795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021142ea-80c4-401e-9fb9-d63d6c5290cf None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:42.717521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021142ea-80c4-401e-9fb9-d63d6c5290cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:42.717886 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021142ea-80c4-401e-9fb9-d63d6c5290cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:42.719182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021142ea-80c4-401e-9fb9-d63d6c5290cf None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:42.726115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7a75c-ab33-4c61-9807-9d9f46c30d95 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:42.748185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 400/807] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:42.749171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021142ea-80c4-401e-9fb9-d63d6c5290cf None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:42.819898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:42.842935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7a75c-ab33-4c61-9807-9d9f46c30d95 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:42.856500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021142ea-80c4-401e-9fb9-d63d6c5290cf None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:42.881088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459d4d4-45bb-47db-9ab8-ba6ffcc677c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:42.882378 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459d4d4-45bb-47db-9ab8-ba6ffcc677c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:42.882830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459d4d4-45bb-47db-9ab8-ba6ffcc677c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:42.883264 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459d4d4-45bb-47db-9ab8-ba6ffcc677c9 None admin] PATH_INFO: `/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/d8f5e60b6e1a4acc87c03da8cf86451e/roles/8646bae8724e4a26bb49cd7cb1d39593` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:42.892018 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267c633-9b27-4107-b76f-5a3bc766cfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:42.893159 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267c633-9b27-4107-b76f-5a3bc766cfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:42.893460 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267c633-9b27-4107-b76f-5a3bc766cfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:42.893730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267c633-9b27-4107-b76f-5a3bc766cfa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:42.894382 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267c633-9b27-4107-b76f-5a3bc766cfa7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:42.894679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267c633-9b27-4107-b76f-5a3bc766cfa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:42.896026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267c633-9b27-4107-b76f-5a3bc766cfa7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:42.901686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459d4d4-45bb-47db-9ab8-ba6ffcc677c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff768fb064ce4d53b2e46ea611d3d103, user_id=d8f5e60b6e1a4acc87c03da8cf86451e, role_id=8646bae8724e4a26bb49cd7cb1d39593)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:42.903339 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459d4d4-45bb-47db-9ab8-ba6ffcc677c9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:42.904187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 401/808] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:25:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:42.904961 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267c633-9b27-4107-b76f-5a3bc766cfa7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:42.969647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 408/809] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:25:42 2022] PUT /identity/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/d8f5e60b6e1a4acc87c03da8cf86451e/roles/8646bae8724e4a26bb49cd7cb1d39593 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:25:42.971587 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85b223-bebb-4b48-b490-e2c56ece9c00 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:42.972070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85b223-bebb-4b48-b490-e2c56ece9c00 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:42.972634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85b223-bebb-4b48-b490-e2c56ece9c00 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:42.974306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 409/810] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:42.974928 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85b223-bebb-4b48-b490-e2c56ece9c00 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:43.023196 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267c633-9b27-4107-b76f-5a3bc766cfa7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:43.038143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:43.061131 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:43.070684 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d690e-4dea-4fa8-addb-8c93301c0703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:43.071273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d690e-4dea-4fa8-addb-8c93301c0703 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:43.074514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d690e-4dea-4fa8-addb-8c93301c0703 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:43.074514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d690e-4dea-4fa8-addb-8c93301c0703 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:43.085013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d690e-4dea-4fa8-addb-8c93301c0703 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:43.086614 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d690e-4dea-4fa8-addb-8c93301c0703 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-7c1d690e-4dea-4fa8-addb-8c93301c0703 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:43.099504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:43.100497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:43.101467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:43.101467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:43.101467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:43.101467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:43.101467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:43.101467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:43.101467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:43.101467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:43.101467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 402/811] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:43.102509 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd8e2f-467b-4288-98db-80f0457751ae None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:43.102697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd8e2f-467b-4288-98db-80f0457751ae None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:43.102958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd8e2f-467b-4288-98db-80f0457751ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:43.107434 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85b223-bebb-4b48-b490-e2c56ece9c00 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:43.125353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-10dd8e2f-467b-4288-98db-80f0457751ae None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:43.126555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-10dd8e2f-467b-4288-98db-80f0457751ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:43.153758 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a8afc-d089-4283-b300-06cf3efe6d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:43.154395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8afc-d089-4283-b300-06cf3efe6d76 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:43.154672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8afc-d089-4283-b300-06cf3efe6d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:43.154945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8afc-d089-4283-b300-06cf3efe6d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:43.167278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a8afc-d089-4283-b300-06cf3efe6d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:43.168857 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a8afc-d089-4283-b300-06cf3efe6d76 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-477a8afc-d089-4283-b300-06cf3efe6d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:43.185088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:43.186093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:43.187002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:43.187002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:43.187002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:43.187002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 410/812] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:43.187766 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a8afc-d089-4283-b300-06cf3efe6d76 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:43.205591 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 403/813] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:43.206451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd8e2f-467b-4288-98db-80f0457751ae None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:43.295047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:43.299449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a8afc-d089-4283-b300-06cf3efe6d76 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:43.316981 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd8e2f-467b-4288-98db-80f0457751ae None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:43.335695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc253c-ca05-4940-b73c-f85a8e35410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:43.336608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:43.337614 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc253c-ca05-4940-b73c-f85a8e35410f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:43.338142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc253c-ca05-4940-b73c-f85a8e35410f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:43.338611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc253c-ca05-4940-b73c-f85a8e35410f None admin] PATH_INFO: `/v3/services/network` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:43.339404 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc253c-ca05-4940-b73c-f85a8e35410f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:43.340966 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc253c-ca05-4940-b73c-f85a8e35410f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d1cc253c-ca05-4940-b73c-f85a8e35410f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:43.350946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:43.355787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:43.356691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 411/814] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:43 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:43.357536 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc253c-ca05-4940-b73c-f85a8e35410f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:43.357604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784985d-b349-4b90-b356-c1145262b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:43.357604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784985d-b349-4b90-b356-c1145262b1bd None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:43.357604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784985d-b349-4b90-b356-c1145262b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:43.357604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784985d-b349-4b90-b356-c1145262b1bd None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:43.357865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784985d-b349-4b90-b356-c1145262b1bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:43.357865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784985d-b349-4b90-b356-c1145262b1bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:43.358983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784985d-b349-4b90-b356-c1145262b1bd None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:43.371389 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 404/815] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:43.372318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784985d-b349-4b90-b356-c1145262b1bd None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:43.483081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784985d-b349-4b90-b356-c1145262b1bd None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:43.484063 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc253c-ca05-4940-b73c-f85a8e35410f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:43.518780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fdc58-a3bf-4a5f-9e50-880a3da264af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:43.519398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fdc58-a3bf-4a5f-9e50-880a3da264af None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:43.519681 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fdc58-a3bf-4a5f-9e50-880a3da264af None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:43.519954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fdc58-a3bf-4a5f-9e50-880a3da264af None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:43.520578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fdc58-a3bf-4a5f-9e50-880a3da264af None admin] RBAC: Adding query filter params (name=network) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:43.520883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fdc58-a3bf-4a5f-9e50-880a3da264af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:43.522009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbbb8f-8c17-4d06-bced-44f2de6a6183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:43.522540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fdc58-a3bf-4a5f-9e50-880a3da264af None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:43.522636 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbbb8f-8c17-4d06-bced-44f2de6a6183 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:43.522871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbbb8f-8c17-4d06-bced-44f2de6a6183 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:43.523141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbbb8f-8c17-4d06-bced-44f2de6a6183 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:43.523783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbbb8f-8c17-4d06-bced-44f2de6a6183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:43.524083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbbb8f-8c17-4d06-bced-44f2de6a6183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:43.525567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbbb8f-8c17-4d06-bced-44f2de6a6183 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:43.527483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 405/816] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 31 04:25:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:43.532625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fdc58-a3bf-4a5f-9e50-880a3da264af None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:43.543137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 412/817] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:43.543137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbbb8f-8c17-4d06-bced-44f2de6a6183 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:43.569150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:43.577556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:43.642878 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fdc58-a3bf-4a5f-9e50-880a3da264af None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:43.648350 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbbb8f-8c17-4d06-bced-44f2de6a6183 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:43.679654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0337a85-8fe9-46eb-8f58-f3bdb721ba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:43.680296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0337a85-8fe9-46eb-8f58-f3bdb721ba5b None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:43.680573 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0337a85-8fe9-46eb-8f58-f3bdb721ba5b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:43.680841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0337a85-8fe9-46eb-8f58-f3bdb721ba5b None admin] PATH_INFO: `/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/98c52ca121d34ce6bbeb414c31f5d2fb/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:43.682797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0337a85-8fe9-46eb-8f58-f3bdb721ba5b None admin] RBAC: Authorizing `identity:create_grant(project_id=ff768fb064ce4d53b2e46ea611d3d103, user_id=98c52ca121d34ce6bbeb414c31f5d2fb, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:43.684220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0337a85-8fe9-46eb-8f58-f3bdb721ba5b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:43.686141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea0567-5bcc-41a9-aaba-932704fb82a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:43.686834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea0567-5bcc-41a9-aaba-932704fb82a7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:43.687453 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea0567-5bcc-41a9-aaba-932704fb82a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:43.687453 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea0567-5bcc-41a9-aaba-932704fb82a7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:43.688169 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea0567-5bcc-41a9-aaba-932704fb82a7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:43.689648 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea0567-5bcc-41a9-aaba-932704fb82a7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-e7ea0567-5bcc-41a9-aaba-932704fb82a7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:43.698431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:43.704424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:43.705491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 413/818] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Aug 31 04:25:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:43.706394 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea0567-5bcc-41a9-aaba-932704fb82a7 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:43.755219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 406/819] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:25:43 2022] PUT /identity/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/98c52ca121d34ce6bbeb414c31f5d2fb/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:25:43.756447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0337a85-8fe9-46eb-8f58-f3bdb721ba5b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:43.817810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:43.841252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea0567-5bcc-41a9-aaba-932704fb82a7 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:43.890863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64732b0a-6a65-4021-b067-20a7e2226c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:43.891869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64732b0a-6a65-4021-b067-20a7e2226c7e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:43.892322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64732b0a-6a65-4021-b067-20a7e2226c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:43.893698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64732b0a-6a65-4021-b067-20a7e2226c7e None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:43.894189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0337a85-8fe9-46eb-8f58-f3bdb721ba5b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:43.894783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64732b0a-6a65-4021-b067-20a7e2226c7e None admin] RBAC: Adding query filter params (type=network) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:43.895275 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64732b0a-6a65-4021-b067-20a7e2226c7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:43.895870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:43.897382 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64732b0a-6a65-4021-b067-20a7e2226c7e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:43.908083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 414/820] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 31 04:25:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:43.909656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64732b0a-6a65-4021-b067-20a7e2226c7e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:43.942503 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286114ab-4dc1-49a2-a5dc-66944a336e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:43.943143 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286114ab-4dc1-49a2-a5dc-66944a336e39 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:43.944055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286114ab-4dc1-49a2-a5dc-66944a336e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:43.944055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286114ab-4dc1-49a2-a5dc-66944a336e39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:43.951650 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286114ab-4dc1-49a2-a5dc-66944a336e39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:43.953104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286114ab-4dc1-49a2-a5dc-66944a336e39 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-286114ab-4dc1-49a2-a5dc-66944a336e39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:43.969809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:43.971071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:43.972286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:43.972286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:43.972286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:43.972286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:43.972286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:43.972286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:43.972286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:43.972286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:43.972286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:25:43.972286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:43.974237 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 407/821] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 31 04:25:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:43.975089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286114ab-4dc1-49a2-a5dc-66944a336e39 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:44.032514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64732b0a-6a65-4021-b067-20a7e2226c7e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:44.069087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154876e4-064d-41bb-b402-7721a15595df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:44.069897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154876e4-064d-41bb-b402-7721a15595df None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:44.070270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154876e4-064d-41bb-b402-7721a15595df None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:44.070641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154876e4-064d-41bb-b402-7721a15595df None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:44.073341 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154876e4-064d-41bb-b402-7721a15595df None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:44.073341 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154876e4-064d-41bb-b402-7721a15595df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:44.073341 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154876e4-064d-41bb-b402-7721a15595df None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:44.085331 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 415/822] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 31 04:25:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:44.085331 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154876e4-064d-41bb-b402-7721a15595df None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:44.100327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286114ab-4dc1-49a2-a5dc-66944a336e39 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:44.105236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:44.138893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfcf27-3fea-4292-937c-20b6d235b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:44.139823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfcf27-3fea-4292-937c-20b6d235b434 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:44.140286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfcf27-3fea-4292-937c-20b6d235b434 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:44.140859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfcf27-3fea-4292-937c-20b6d235b434 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:44.141857 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfcf27-3fea-4292-937c-20b6d235b434 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:44.144169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfcf27-3fea-4292-937c-20b6d235b434 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:44.200938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154876e4-064d-41bb-b402-7721a15595df None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:44.236073 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd17401-94ae-4787-9d1c-3199c09797f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:44.237272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd17401-94ae-4787-9d1c-3199c09797f0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:44.237551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd17401-94ae-4787-9d1c-3199c09797f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:44.237824 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd17401-94ae-4787-9d1c-3199c09797f0 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:44.238555 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd17401-94ae-4787-9d1c-3199c09797f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:44.238860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd17401-94ae-4787-9d1c-3199c09797f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:44.240277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd17401-94ae-4787-9d1c-3199c09797f0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:44.253366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 408/823] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:25:43 2022] POST /identity/v3/endpoints => generated 337 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:44.254782 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfcf27-3fea-4292-937c-20b6d235b434 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:44.262428 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 416/824] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 31 04:25:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:44.272154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd17401-94ae-4787-9d1c-3199c09797f0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:44.286731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:44.401825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfcf27-3fea-4292-937c-20b6d235b434 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:44.423239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:44.456621 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68162b-ed23-428d-a4f7-ac78d60e2ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:44.459861 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68162b-ed23-428d-a4f7-ac78d60e2ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:44.460308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68162b-ed23-428d-a4f7-ac78d60e2ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:44.460715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68162b-ed23-428d-a4f7-ac78d60e2ae0 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:44.461668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68162b-ed23-428d-a4f7-ac78d60e2ae0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:44.462146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68162b-ed23-428d-a4f7-ac78d60e2ae0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:44.463267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd17401-94ae-4787-9d1c-3199c09797f0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:44.464102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68162b-ed23-428d-a4f7-ac78d60e2ae0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:44.477051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 409/825] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 31 04:25:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:44.479994 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68162b-ed23-428d-a4f7-ac78d60e2ae0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:44.525576 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435bb94-3839-424e-9d8e-a5dc027a7e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:44.526781 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435bb94-3839-424e-9d8e-a5dc027a7e9f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:44.527489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435bb94-3839-424e-9d8e-a5dc027a7e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:44.528167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435bb94-3839-424e-9d8e-a5dc027a7e9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:44.602567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:44.621016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435bb94-3839-424e-9d8e-a5dc027a7e9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:44.622660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435bb94-3839-424e-9d8e-a5dc027a7e9f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:44.631123 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68162b-ed23-428d-a4f7-ac78d60e2ae0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:44.673068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd4bbe-1db2-49cb-9742-78eaa8118afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:44.674426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd4bbe-1db2-49cb-9742-78eaa8118afe None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:44.674426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd4bbe-1db2-49cb-9742-78eaa8118afe None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:44.674887 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd4bbe-1db2-49cb-9742-78eaa8118afe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:44.675701 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd4bbe-1db2-49cb-9742-78eaa8118afe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:44.677253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd4bbe-1db2-49cb-9742-78eaa8118afe None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:44.715387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:44.747278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 417/826] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:25:44.754154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435bb94-3839-424e-9d8e-a5dc027a7e9f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:44.765346 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 410/827] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:25:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:44.876132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435bb94-3839-424e-9d8e-a5dc027a7e9f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:44.923388 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e985f-50e6-4562-b9ff-cb3af88aab7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:44.924664 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e985f-50e6-4562-b9ff-cb3af88aab7c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:44.925006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e985f-50e6-4562-b9ff-cb3af88aab7c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:44.925362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e985f-50e6-4562-b9ff-cb3af88aab7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:44.936492 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e985f-50e6-4562-b9ff-cb3af88aab7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:44.938084 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e985f-50e6-4562-b9ff-cb3af88aab7c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-b74e985f-50e6-4562-b9ff-cb3af88aab7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:44.953298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:44.954429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:44.956472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:44.956472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:44.956472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:44.956999 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 418/828] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:44.962961 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd4bbe-1db2-49cb-9742-78eaa8118afe None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:45.071799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2300b3-dc36-46b2-857b-1beee6763727 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:45.072317 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2300b3-dc36-46b2-857b-1beee6763727 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:45.072317 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2300b3-dc36-46b2-857b-1beee6763727 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:45.076157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd4bbe-1db2-49cb-9742-78eaa8118afe None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:45.079440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 419/829] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:45.085163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bde1ba-f42a-40d3-95a9-d6add7087235 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:45.085848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bde1ba-f42a-40d3-95a9-d6add7087235 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:45.085848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bde1ba-f42a-40d3-95a9-d6add7087235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:45.104039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a6bde1ba-f42a-40d3-95a9-d6add7087235 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:45.105432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a6bde1ba-f42a-40d3-95a9-d6add7087235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:45.119498 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8ccc5-7eed-406c-8c59-ffbc25cccf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:45.120267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:45.120407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8ccc5-7eed-406c-8c59-ffbc25cccf9b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:45.120614 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8ccc5-7eed-406c-8c59-ffbc25cccf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:45.120891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8ccc5-7eed-406c-8c59-ffbc25cccf9b None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:45.122141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8ccc5-7eed-406c-8c59-ffbc25cccf9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:45.122453 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8ccc5-7eed-406c-8c59-ffbc25cccf9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:45.124086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8ccc5-7eed-406c-8c59-ffbc25cccf9b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:45.141561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:45.145276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 411/830] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:45.148607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8ccc5-7eed-406c-8c59-ffbc25cccf9b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:45.181268 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 420/831] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:45.260069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8ccc5-7eed-406c-8c59-ffbc25cccf9b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:45.298000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589af8b0-2823-4a5c-9aae-320a30f20d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:45.298633 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589af8b0-2823-4a5c-9aae-320a30f20d5d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:45.299546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589af8b0-2823-4a5c-9aae-320a30f20d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:45.300043 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589af8b0-2823-4a5c-9aae-320a30f20d5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:45.308253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589af8b0-2823-4a5c-9aae-320a30f20d5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:45.309854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589af8b0-2823-4a5c-9aae-320a30f20d5d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-589af8b0-2823-4a5c-9aae-320a30f20d5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:45.321546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:45.322447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:45.323334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:45.323334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:45.323334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:45.323334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:45.323334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:45.323334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:45.323334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:45.323334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:45.327434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 412/832] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:45.328773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bde1ba-f42a-40d3-95a9-d6add7087235 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:45.438786 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bde1ba-f42a-40d3-95a9-d6add7087235 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:45.462907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589af8b0-2823-4a5c-9aae-320a30f20d5d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:45.479309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053301c-d03e-4f47-b630-cde746da2b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:45.479921 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053301c-d03e-4f47-b630-cde746da2b32 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:45.480199 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053301c-d03e-4f47-b630-cde746da2b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:45.480473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053301c-d03e-4f47-b630-cde746da2b32 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:45.481601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053301c-d03e-4f47-b630-cde746da2b32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:45.481911 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053301c-d03e-4f47-b630-cde746da2b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:45.483604 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053301c-d03e-4f47-b630-cde746da2b32 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:45.501287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 421/833] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:45.507205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053301c-d03e-4f47-b630-cde746da2b32 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:45.529125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:45.531283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:45.579319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589af8b0-2823-4a5c-9aae-320a30f20d5d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:45.617770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd551ad-92df-440a-8a7e-25fd448d139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:45.618829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd551ad-92df-440a-8a7e-25fd448d139b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:45.619303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd551ad-92df-440a-8a7e-25fd448d139b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:45.619781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd551ad-92df-440a-8a7e-25fd448d139b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:45.631023 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd551ad-92df-440a-8a7e-25fd448d139b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4fd551ad-92df-440a-8a7e-25fd448d139b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:45.636909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:45.637880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:45.638742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:45.638742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:45.638742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:45.638742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:45.638742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:45.638742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:45.638742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:45.638742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:45.638742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:45.638742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:45.638742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:25:45.638742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:45.640852 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053301c-d03e-4f47-b630-cde746da2b32 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:45.647546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 413/834] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:25:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:45.648679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd551ad-92df-440a-8a7e-25fd448d139b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:45.690459 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e19cf7-2944-4e21-9d37-55b8cc3fee22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:45.690996 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e19cf7-2944-4e21-9d37-55b8cc3fee22 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:45.691276 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e19cf7-2944-4e21-9d37-55b8cc3fee22 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:45.691548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e19cf7-2944-4e21-9d37-55b8cc3fee22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:45.692282 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e19cf7-2944-4e21-9d37-55b8cc3fee22 None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=4877b72a6cea410dbb31a35c7acbd5f9) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:45.692585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e19cf7-2944-4e21-9d37-55b8cc3fee22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:45.694558 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e19cf7-2944-4e21-9d37-55b8cc3fee22 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:45.708826 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 422/835] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:45 2022] GET /identity/v3/role_assignments?user.id=4877b72a6cea410dbb31a35c7acbd5f9&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=1896db68dc754d5293037ab100ce46d9 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:45.751182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deab66-d77e-4adf-92c8-5a7d7af826a1 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:45.751501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deab66-d77e-4adf-92c8-5a7d7af826a1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:45.751739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deab66-d77e-4adf-92c8-5a7d7af826a1 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:45.753244 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 423/836] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:25:45.758472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f758-dabd-4fd7-9243-6581fbe7613b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:45.758748 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f758-dabd-4fd7-9243-6581fbe7613b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:45.759027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f758-dabd-4fd7-9243-6581fbe7613b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:45.778586 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bcf9f758-dabd-4fd7-9243-6581fbe7613b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:45.779905 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bcf9f758-dabd-4fd7-9243-6581fbe7613b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:45.782664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd551ad-92df-440a-8a7e-25fd448d139b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:45.800278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:45.823571 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62978950-a959-43fa-8e63-5ec2534670fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:45.824287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62978950-a959-43fa-8e63-5ec2534670fc None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:45.824637 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62978950-a959-43fa-8e63-5ec2534670fc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:45.824978 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62978950-a959-43fa-8e63-5ec2534670fc None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:45.825764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62978950-a959-43fa-8e63-5ec2534670fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:45.826139 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62978950-a959-43fa-8e63-5ec2534670fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:45.827642 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62978950-a959-43fa-8e63-5ec2534670fc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:45.843174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 414/837] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:25:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:45.844407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62978950-a959-43fa-8e63-5ec2534670fc None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:45.865318 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 424/838] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:25:45.956690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62978950-a959-43fa-8e63-5ec2534670fc None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:45.993995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720fd6e-f7f4-42ed-8d5d-fbb327b10f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:45.994926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720fd6e-f7f4-42ed-8d5d-fbb327b10f96 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:45.995379 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720fd6e-f7f4-42ed-8d5d-fbb327b10f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:45.995799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720fd6e-f7f4-42ed-8d5d-fbb327b10f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:46.011243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720fd6e-f7f4-42ed-8d5d-fbb327b10f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:46.012926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720fd6e-f7f4-42ed-8d5d-fbb327b10f96 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1720fd6e-f7f4-42ed-8d5d-fbb327b10f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:46.040020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:46.041255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:46.042187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:46.042187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:46.042187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:46.042648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 415/839] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:46.048540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9f758-dabd-4fd7-9243-6581fbe7613b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:46.059450 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:46.137050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720fd6e-f7f4-42ed-8d5d-fbb327b10f96 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:46.166213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:46.169949 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9f758-dabd-4fd7-9243-6581fbe7613b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:46.208100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501a42a-fe45-4a67-9ac7-683d978ebb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:46.208742 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a42a-fe45-4a67-9ac7-683d978ebb6c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:46.209016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a42a-fe45-4a67-9ac7-683d978ebb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:46.209311 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a42a-fe45-4a67-9ac7-683d978ebb6c None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:46.209961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501a42a-fe45-4a67-9ac7-683d978ebb6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:46.210261 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501a42a-fe45-4a67-9ac7-683d978ebb6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:46.211719 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501a42a-fe45-4a67-9ac7-683d978ebb6c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:46.224971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 425/840] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:46.234462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501a42a-fe45-4a67-9ac7-683d978ebb6c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:46.248639 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720fd6e-f7f4-42ed-8d5d-fbb327b10f96 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:46.285955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7129-908c-4af2-9ec0-928af23ca2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:46.286644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7129-908c-4af2-9ec0-928af23ca2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:46.286921 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7129-908c-4af2-9ec0-928af23ca2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:46.287186 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7129-908c-4af2-9ec0-928af23ca2b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:46.297997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd7129-908c-4af2-9ec0-928af23ca2b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-58dd7129-908c-4af2-9ec0-928af23ca2b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:46.302950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:46.303922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:46.304765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:46.304765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:46.304765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:46.304765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:46.304765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:46.304765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:46.304765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:46.304765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:46.304765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:46.304765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:46.304765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:25:46.304765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:46.304765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 416/841] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:25:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:46.310231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7129-908c-4af2-9ec0-928af23ca2b6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:46.322107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:46.362916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501a42a-fe45-4a67-9ac7-683d978ebb6c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:46.410119 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6d33f-0d05-4549-a4aa-f633ed06a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:46.410778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6d33f-0d05-4549-a4aa-f633ed06a1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:46.411065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6d33f-0d05-4549-a4aa-f633ed06a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:46.411517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6d33f-0d05-4549-a4aa-f633ed06a1a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:46.419514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6d33f-0d05-4549-a4aa-f633ed06a1a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:46.420793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6d33f-0d05-4549-a4aa-f633ed06a1a3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:46.424241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d2f6d33f-0d05-4549-a4aa-f633ed06a1a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:46.433827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:46.439307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:46.441122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:46.441122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:46.441122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:46.441122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:46.441122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:46.441122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:46.441122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:46.441122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:46.441122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 04:25:46.441122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:46.441122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 426/842] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 31 04:25:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:46.442806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6d33f-0d05-4549-a4aa-f633ed06a1a3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:46.443225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7129-908c-4af2-9ec0-928af23ca2b6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:46.479317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab70d1b-bfbc-4464-a3b9-6c944a088e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:46.480750 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab70d1b-bfbc-4464-a3b9-6c944a088e88 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:46.481278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab70d1b-bfbc-4464-a3b9-6c944a088e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:46.481753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab70d1b-bfbc-4464-a3b9-6c944a088e88 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:46.482676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab70d1b-bfbc-4464-a3b9-6c944a088e88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:46.483197 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab70d1b-bfbc-4464-a3b9-6c944a088e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:46.484767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab70d1b-bfbc-4464-a3b9-6c944a088e88 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:46.500244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 417/843] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:25:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:46.501466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab70d1b-bfbc-4464-a3b9-6c944a088e88 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:46.570553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6d33f-0d05-4549-a4aa-f633ed06a1a3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:46.602736 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:46.618156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a06c36-edf1-4a76-ac34-8d1ebd154c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:46.618761 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a06c36-edf1-4a76-ac34-8d1ebd154c31 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:46.619037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a06c36-edf1-4a76-ac34-8d1ebd154c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:46.619314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a06c36-edf1-4a76-ac34-8d1ebd154c31 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:46.620480 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a06c36-edf1-4a76-ac34-8d1ebd154c31 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:46.620788 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a06c36-edf1-4a76-ac34-8d1ebd154c31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:46.622790 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a06c36-edf1-4a76-ac34-8d1ebd154c31 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:46.630387 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab70d1b-bfbc-4464-a3b9-6c944a088e88 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:46.649349 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 427/844] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 31 04:25:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:46.653711 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a06c36-edf1-4a76-ac34-8d1ebd154c31 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:46.679221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da69d4a-ccd2-4bc2-8cb8-9edc0c28bd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:46.680052 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da69d4a-ccd2-4bc2-8cb8-9edc0c28bd4a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:46.680343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da69d4a-ccd2-4bc2-8cb8-9edc0c28bd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:46.680727 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da69d4a-ccd2-4bc2-8cb8-9edc0c28bd4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:46.698474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da69d4a-ccd2-4bc2-8cb8-9edc0c28bd4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:46.699962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da69d4a-ccd2-4bc2-8cb8-9edc0c28bd4a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-6da69d4a-ccd2-4bc2-8cb8-9edc0c28bd4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:46.724488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:46.725531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:46.726475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:46.726475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:46.726475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:46.729446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 418/845] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:46.735212 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da69d4a-ccd2-4bc2-8cb8-9edc0c28bd4a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:46.739565 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:46.787654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a06c36-edf1-4a76-ac34-8d1ebd154c31 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:46.825192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a534221-2a2a-4e7e-af24-f3941eedb161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:46.825817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534221-2a2a-4e7e-af24-f3941eedb161 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:46.826096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534221-2a2a-4e7e-af24-f3941eedb161 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:46.826368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534221-2a2a-4e7e-af24-f3941eedb161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:46.858847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da69d4a-ccd2-4bc2-8cb8-9edc0c28bd4a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:46.877417 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:46.896095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403fc94-eb5d-4b30-bfd3-b7ff6eb14238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:46.897320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403fc94-eb5d-4b30-bfd3-b7ff6eb14238 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:46.897320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403fc94-eb5d-4b30-bfd3-b7ff6eb14238 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:46.897577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403fc94-eb5d-4b30-bfd3-b7ff6eb14238 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:46.898205 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403fc94-eb5d-4b30-bfd3-b7ff6eb14238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:46.898542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403fc94-eb5d-4b30-bfd3-b7ff6eb14238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:46.899122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a534221-2a2a-4e7e-af24-f3941eedb161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:46.899917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403fc94-eb5d-4b30-bfd3-b7ff6eb14238 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:46.900563 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a534221-2a2a-4e7e-af24-f3941eedb161 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:46.912614 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 419/846] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:46.913882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c12931-c1e5-4167-80a3-bb936363827c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:46.914330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c12931-c1e5-4167-80a3-bb936363827c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:46.914610 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c12931-c1e5-4167-80a3-bb936363827c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:46.915931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 420/847] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:46.917974 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c12931-c1e5-4167-80a3-bb936363827c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:46.989873 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:47.030764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c12931-c1e5-4167-80a3-bb936363827c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:47.035915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 428/848] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:46 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 04:25:47.037175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ade4a-ca87-439e-8ebe-b7e90fecd556 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:47.037485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ade4a-ca87-439e-8ebe-b7e90fecd556 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:47.037757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ade4a-ca87-439e-8ebe-b7e90fecd556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:47.060292 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-161ade4a-ca87-439e-8ebe-b7e90fecd556 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:47.061797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-161ade4a-ca87-439e-8ebe-b7e90fecd556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:47.067622 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011f833-1e90-4b4d-aded-f0b9d6d38b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:47.068247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011f833-1e90-4b4d-aded-f0b9d6d38b11 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:47.068520 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011f833-1e90-4b4d-aded-f0b9d6d38b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:47.068787 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011f833-1e90-4b4d-aded-f0b9d6d38b11 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:47.077839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011f833-1e90-4b4d-aded-f0b9d6d38b11 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:47.079649 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011f833-1e90-4b4d-aded-f0b9d6d38b11 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3011f833-1e90-4b4d-aded-f0b9d6d38b11 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:47.091223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:47.092177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:47.093137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:47.093137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:47.093137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:47.093137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:47.093137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:47.093137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:47.093137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:47.093137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:47.093137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 04:25:47.093137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:47.093137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 421/849] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:25:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:47.093137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011f833-1e90-4b4d-aded-f0b9d6d38b11 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:47.138533 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 429/850] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:47.139481 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ade4a-ca87-439e-8ebe-b7e90fecd556 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:47.164059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:47.211007 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011f833-1e90-4b4d-aded-f0b9d6d38b11 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:47.235987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:47.250327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcea6f7-fd2b-4410-8f04-59b09f00659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:47.250327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcea6f7-fd2b-4410-8f04-59b09f00659e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:47.250327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcea6f7-fd2b-4410-8f04-59b09f00659e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:47.250327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcea6f7-fd2b-4410-8f04-59b09f00659e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:47.260579 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ade4a-ca87-439e-8ebe-b7e90fecd556 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:47.262609 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcea6f7-fd2b-4410-8f04-59b09f00659e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:47.264239 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcea6f7-fd2b-4410-8f04-59b09f00659e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-ebcea6f7-fd2b-4410-8f04-59b09f00659e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:47.280912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:47.282009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:47.282935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:47.282935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:47.282935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:47.290333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 422/851] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:47.291432 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcea6f7-fd2b-4410-8f04-59b09f00659e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:47.299226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ae837-22ab-4477-a5d2-530ad713ac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:47.300125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ae837-22ab-4477-a5d2-530ad713ac6b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:47.300319 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ae837-22ab-4477-a5d2-530ad713ac6b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:47.300696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ae837-22ab-4477-a5d2-530ad713ac6b None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:47.301528 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ae837-22ab-4477-a5d2-530ad713ac6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:47.301899 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ae837-22ab-4477-a5d2-530ad713ac6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:47.303400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ae837-22ab-4477-a5d2-530ad713ac6b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:47.323459 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 430/852] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 31 04:25:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:47.329179 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ae837-22ab-4477-a5d2-530ad713ac6b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:47.403322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcea6f7-fd2b-4410-8f04-59b09f00659e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:47.422508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:47.451381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fea05-ac7c-4b90-b9f9-659c617ee9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:47.452488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fea05-ac7c-4b90-b9f9-659c617ee9ab None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:47.452965 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fea05-ac7c-4b90-b9f9-659c617ee9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:47.453440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fea05-ac7c-4b90-b9f9-659c617ee9ab None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:47.454254 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fea05-ac7c-4b90-b9f9-659c617ee9ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:47.454727 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fea05-ac7c-4b90-b9f9-659c617ee9ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:47.455116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ae837-22ab-4477-a5d2-530ad713ac6b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:47.456839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fea05-ac7c-4b90-b9f9-659c617ee9ab None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:47.470067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 423/853] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:47.471668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fea05-ac7c-4b90-b9f9-659c617ee9ab None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:47.493996 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269fa1a-29ab-44a7-8852-9f548a25b9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:47.494613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269fa1a-29ab-44a7-8852-9f548a25b9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:47.494891 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269fa1a-29ab-44a7-8852-9f548a25b9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:47.495164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269fa1a-29ab-44a7-8852-9f548a25b9d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:47.513753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:47.567869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269fa1a-29ab-44a7-8852-9f548a25b9d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:47.569362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269fa1a-29ab-44a7-8852-9f548a25b9d5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:47.584080 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fea05-ac7c-4b90-b9f9-659c617ee9ab None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:47.620547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6eba41-32b9-4e7a-93f4-2a7c737b8fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:47.621171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eba41-32b9-4e7a-93f4-2a7c737b8fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:47.621481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eba41-32b9-4e7a-93f4-2a7c737b8fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:47.621753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eba41-32b9-4e7a-93f4-2a7c737b8fd7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:47.622324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6eba41-32b9-4e7a-93f4-2a7c737b8fd7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:47.623669 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6eba41-32b9-4e7a-93f4-2a7c737b8fd7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1e6eba41-32b9-4e7a-93f4-2a7c737b8fd7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:47.632867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:47.637474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:47.638502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 424/854] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:25:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:47.639316 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6eba41-32b9-4e7a-93f4-2a7c737b8fd7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:47.651548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:47.684535 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 431/855] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 04:25:47.687068 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269fa1a-29ab-44a7-8852-9f548a25b9d5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:47.739965 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:47.744031 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6eba41-32b9-4e7a-93f4-2a7c737b8fd7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:47.780745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9361f1d-69b1-414d-9173-0eca890297a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:47.781344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361f1d-69b1-414d-9173-0eca890297a8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:47.781622 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361f1d-69b1-414d-9173-0eca890297a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:47.781897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361f1d-69b1-414d-9173-0eca890297a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:47.788918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9361f1d-69b1-414d-9173-0eca890297a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:47.790389 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9361f1d-69b1-414d-9173-0eca890297a8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:47.795027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269fa1a-29ab-44a7-8852-9f548a25b9d5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-d9361f1d-69b1-414d-9173-0eca890297a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:47.802518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:47.803440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:47.804367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:47.804367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:47.804367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:47.804367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:47.804367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:47.804367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:47.804367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:47.804367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:47.804367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 425/856] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:47.804859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9361f1d-69b1-414d-9173-0eca890297a8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:47.835530 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda43869-e377-45c4-beb6-8bacbf7d47b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:47.836128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda43869-e377-45c4-beb6-8bacbf7d47b9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:47.836403 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda43869-e377-45c4-beb6-8bacbf7d47b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:47.836670 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda43869-e377-45c4-beb6-8bacbf7d47b9 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:47.837329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda43869-e377-45c4-beb6-8bacbf7d47b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:47.837629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda43869-e377-45c4-beb6-8bacbf7d47b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:47.838986 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda43869-e377-45c4-beb6-8bacbf7d47b9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:47.843580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 432/857] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:25:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:47.844304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda43869-e377-45c4-beb6-8bacbf7d47b9 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:47.878996 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:47.905752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9361f1d-69b1-414d-9173-0eca890297a8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:47.938611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c39e3a-a12f-468a-87ca-d52c13ea1f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:47.939226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39e3a-a12f-468a-87ca-d52c13ea1f47 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:47.940040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39e3a-a12f-468a-87ca-d52c13ea1f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:47.940309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39e3a-a12f-468a-87ca-d52c13ea1f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:47.944410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda43869-e377-45c4-beb6-8bacbf7d47b9 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:47.950011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c39e3a-a12f-468a-87ca-d52c13ea1f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:47.951433 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c39e3a-a12f-468a-87ca-d52c13ea1f47 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-99c39e3a-a12f-468a-87ca-d52c13ea1f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:47.965630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:47.966634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:47.967542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:47.967542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:47.967542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:47.967542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 426/858] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:47.968025 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ba45d-5948-4230-956b-81cb25978907 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:47.968245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ba45d-5948-4230-956b-81cb25978907 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:47.968518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ba45d-5948-4230-956b-81cb25978907 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:47.969882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 427/859] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:47.975560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ba45d-5948-4230-956b-81cb25978907 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:47.981399 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0ccf-2b9a-4e43-ad9b-fe7404984c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:47.982006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0ccf-2b9a-4e43-ad9b-fe7404984c1c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:47.982282 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0ccf-2b9a-4e43-ad9b-fe7404984c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:47.982552 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0ccf-2b9a-4e43-ad9b-fe7404984c1c None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:47.983360 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e0ccf-2b9a-4e43-ad9b-fe7404984c1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:47.983683 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e0ccf-2b9a-4e43-ad9b-fe7404984c1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:47.985141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e0ccf-2b9a-4e43-ad9b-fe7404984c1c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:47.988773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:48.002439 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 433/860] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:48.003257 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0ccf-2b9a-4e43-ad9b-fe7404984c1c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:48.088418 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ba45d-5948-4230-956b-81cb25978907 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:48.106967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:48.114100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0ccf-2b9a-4e43-ad9b-fe7404984c1c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:48.125366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14390c18-616e-4b79-9f26-3ec63aba6666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:48.125976 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14390c18-616e-4b79-9f26-3ec63aba6666 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:48.126255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14390c18-616e-4b79-9f26-3ec63aba6666 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:48.126527 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14390c18-616e-4b79-9f26-3ec63aba6666 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:48.127213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14390c18-616e-4b79-9f26-3ec63aba6666 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:48.127514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14390c18-616e-4b79-9f26-3ec63aba6666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:48.128898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14390c18-616e-4b79-9f26-3ec63aba6666 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:48.133288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 428/861] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:25:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:48.134447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d62c9e-6dfa-42ea-a027-d59f78ccadf7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:48.134725 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d62c9e-6dfa-42ea-a027-d59f78ccadf7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:48.134993 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d62c9e-6dfa-42ea-a027-d59f78ccadf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:48.150683 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8ccfb-f53a-4d8a-94f5-1295aab6936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:48.151303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ccfb-f53a-4d8a-94f5-1295aab6936b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:48.151579 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ccfb-f53a-4d8a-94f5-1295aab6936b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:48.151847 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ccfb-f53a-4d8a-94f5-1295aab6936b None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:48.152511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8ccfb-f53a-4d8a-94f5-1295aab6936b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:48.152813 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8ccfb-f53a-4d8a-94f5-1295aab6936b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:48.154246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8ccfb-f53a-4d8a-94f5-1295aab6936b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:48.155560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f1d62c9e-6dfa-42ea-a027-d59f78ccadf7 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:48.156804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f1d62c9e-6dfa-42ea-a027-d59f78ccadf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:48.172274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 434/862] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:48.172274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8ccfb-f53a-4d8a-94f5-1295aab6936b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:48.241217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 429/863] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:48.242167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d62c9e-6dfa-42ea-a027-d59f78ccadf7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:48.250877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:48.305869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8ccfb-f53a-4d8a-94f5-1295aab6936b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:48.351907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39292b-c9bb-46be-927f-40201c42cbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:48.352659 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39292b-c9bb-46be-927f-40201c42cbfe None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:48.352934 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39292b-c9bb-46be-927f-40201c42cbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:48.353217 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39292b-c9bb-46be-927f-40201c42cbfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:48.354222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39292b-c9bb-46be-927f-40201c42cbfe None admin] RBAC: Adding query filter params (role.id=8646bae8724e4a26bb49cd7cb1d39593, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=d8f5e60b6e1a4acc87c03da8cf86451e) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:48.354533 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39292b-c9bb-46be-927f-40201c42cbfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:48.356662 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39292b-c9bb-46be-927f-40201c42cbfe None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:48.365324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d62c9e-6dfa-42ea-a027-d59f78ccadf7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:48.365477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 435/864] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:48 2022] GET /identity/v3/role_assignments?user.id=d8f5e60b6e1a4acc87c03da8cf86451e&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=8646bae8724e4a26bb49cd7cb1d39593 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:48.408793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb00ac-5484-453a-ae1f-2ff37a73c420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:48.409576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb00ac-5484-453a-ae1f-2ff37a73c420 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:48.409917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb00ac-5484-453a-ae1f-2ff37a73c420 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:48.410251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb00ac-5484-453a-ae1f-2ff37a73c420 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:48.418410 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb00ac-5484-453a-ae1f-2ff37a73c420 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:48.419984 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb00ac-5484-453a-ae1f-2ff37a73c420 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-81bb00ac-5484-453a-ae1f-2ff37a73c420 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:48.433161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:48.434318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:48.435431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:48.435431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:48.435431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:48.435431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:48.435431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:48.435431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:48.435431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:48.435431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:48.436660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 430/865] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:48.446404 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39292b-c9bb-46be-927f-40201c42cbfe None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:48.469174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:48.537500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb00ac-5484-453a-ae1f-2ff37a73c420 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:48.569789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39292b-c9bb-46be-927f-40201c42cbfe None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:48.621557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a7682-c25b-40e5-90c0-128a4b76c74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:48.622525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:48.623106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a7682-c25b-40e5-90c0-128a4b76c74c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:48.623383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a7682-c25b-40e5-90c0-128a4b76c74c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:48.623772 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a7682-c25b-40e5-90c0-128a4b76c74c None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:48.624958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a7682-c25b-40e5-90c0-128a4b76c74c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:48.625290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a7682-c25b-40e5-90c0-128a4b76c74c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:48.627018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a7682-c25b-40e5-90c0-128a4b76c74c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:48.643810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 436/866] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:48.649585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a7682-c25b-40e5-90c0-128a4b76c74c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:48.667275 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb00ac-5484-453a-ae1f-2ff37a73c420 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:48.720874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9255-d089-44ff-9f7c-c4bc7d47170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:48.721569 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9255-d089-44ff-9f7c-c4bc7d47170e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:48.722088 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9255-d089-44ff-9f7c-c4bc7d47170e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:48.722372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9255-d089-44ff-9f7c-c4bc7d47170e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:48.722966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b9255-d089-44ff-9f7c-c4bc7d47170e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:48.725089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b9255-d089-44ff-9f7c-c4bc7d47170e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e83b9255-d089-44ff-9f7c-c4bc7d47170e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:48.738056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:48.739071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:48.740576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 431/867] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Aug 31 04:25:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:48.745626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9255-d089-44ff-9f7c-c4bc7d47170e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:48.751010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:48.782798 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a7682-c25b-40e5-90c0-128a4b76c74c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:48.831331 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79997c-1fd1-41b5-b24f-54fa417c6450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:48.832232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79997c-1fd1-41b5-b24f-54fa417c6450 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:48.833240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79997c-1fd1-41b5-b24f-54fa417c6450 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:48.833706 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79997c-1fd1-41b5-b24f-54fa417c6450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:48.835040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79997c-1fd1-41b5-b24f-54fa417c6450 None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=98c52ca121d34ce6bbeb414c31f5d2fb) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:48.835844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79997c-1fd1-41b5-b24f-54fa417c6450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:48.837761 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79997c-1fd1-41b5-b24f-54fa417c6450 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:48.846860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 437/868] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:48 2022] GET /identity/v3/role_assignments?user.id=98c52ca121d34ce6bbeb414c31f5d2fb&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=1896db68dc754d5293037ab100ce46d9 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:48.860513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9255-d089-44ff-9f7c-c4bc7d47170e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:48.894025 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:48.903679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3825a-edbe-4d50-b99b-7034574ea3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:48.904303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3825a-edbe-4d50-b99b-7034574ea3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:48.904578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3825a-edbe-4d50-b99b-7034574ea3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:48.904847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3825a-edbe-4d50-b99b-7034574ea3c2 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:48.905518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3825a-edbe-4d50-b99b-7034574ea3c2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:48.911370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3825a-edbe-4d50-b99b-7034574ea3c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:48.911370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3825a-edbe-4d50-b99b-7034574ea3c2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:48.913590 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 432/869] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 31 04:25:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:48.919084 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79997c-1fd1-41b5-b24f-54fa417c6450 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:49.030191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79997c-1fd1-41b5-b24f-54fa417c6450 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:49.070943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c53644-46b5-472d-b135-f87b66face9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:49.071797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c53644-46b5-472d-b135-f87b66face9b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:49.072257 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c53644-46b5-472d-b135-f87b66face9b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:49.072676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c53644-46b5-472d-b135-f87b66face9b None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:49.073509 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c53644-46b5-472d-b135-f87b66face9b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:49.073957 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c53644-46b5-472d-b135-f87b66face9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:49.075477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c53644-46b5-472d-b135-f87b66face9b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:49.086241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 438/870] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 31 04:25:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:50.138424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16031f4-c199-434c-9837-c9365f15efd4 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:50.138982 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16031f4-c199-434c-9837-c9365f15efd4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:50.138982 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16031f4-c199-434c-9837-c9365f15efd4 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:50.140536 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 433/871] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:50.146498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f0bec-7189-4d63-af50-eb9f87506cf1 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:50.147157 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f0bec-7189-4d63-af50-eb9f87506cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:50.147359 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f0bec-7189-4d63-af50-eb9f87506cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:50.161323 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:50.167737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c52f0bec-7189-4d63-af50-eb9f87506cf1 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:50.169190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c52f0bec-7189-4d63-af50-eb9f87506cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:50.244933 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 439/872] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:25:50.475279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cda923-2983-43a8-be01-529504c2211a None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:50.475454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cda923-2983-43a8-be01-529504c2211a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:50.475740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cda923-2983-43a8-be01-529504c2211a None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:50.477300 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 434/873] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:50.482559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271a171-5baf-459a-85c1-f092e771bf0c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:50.482840 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271a171-5baf-459a-85c1-f092e771bf0c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:50.483111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271a171-5baf-459a-85c1-f092e771bf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:50.501159 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d271a171-5baf-459a-85c1-f092e771bf0c None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:50.502952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d271a171-5baf-459a-85c1-f092e771bf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:50.514824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cda923-2983-43a8-be01-529504c2211a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:50.594201 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 440/874] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:50.641223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cda923-2983-43a8-be01-529504c2211a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:50.676503 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea43048-0334-4cf8-a976-994f3c4f7a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:50.677376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea43048-0334-4cf8-a976-994f3c4f7a51 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:50.677797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea43048-0334-4cf8-a976-994f3c4f7a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:50.678238 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea43048-0334-4cf8-a976-994f3c4f7a51 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:50.679033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea43048-0334-4cf8-a976-994f3c4f7a51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:50.680522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea43048-0334-4cf8-a976-994f3c4f7a51 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:50.750686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 435/875] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 31 04:25:50 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:50.884365 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f24d4-e33f-4406-ad7e-97dc67a91014 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:50.885040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f24d4-e33f-4406-ad7e-97dc67a91014 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:50.885595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f24d4-e33f-4406-ad7e-97dc67a91014 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:50.887366 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 441/876] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:50.893440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412920-c515-424d-ad68-4282c9cb6077 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:50.893973 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412920-c515-424d-ad68-4282c9cb6077 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:50.894443 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412920-c515-424d-ad68-4282c9cb6077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:50.900713 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f24d4-e33f-4406-ad7e-97dc67a91014 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:50.916079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b3412920-c515-424d-ad68-4282c9cb6077 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:50.918253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b3412920-c515-424d-ad68-4282c9cb6077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:50.976438 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:50.984030 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:51.005127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 436/877] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:50 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:51.023766 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f24d4-e33f-4406-ad7e-97dc67a91014 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:51.062064 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c29880-617b-481f-90fc-6e6103b7d206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:51.062759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c29880-617b-481f-90fc-6e6103b7d206 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:51.063036 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c29880-617b-481f-90fc-6e6103b7d206 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:51.063307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c29880-617b-481f-90fc-6e6103b7d206 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:51.074968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c29880-617b-481f-90fc-6e6103b7d206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-a9c29880-617b-481f-90fc-6e6103b7d206 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:51.081548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:51.082501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:51.083332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:51.083332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:51.083332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:51.083332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:51.083332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:51.083332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:51.083332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:51.083332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:51.083332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:51.083332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:51.083332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 04:25:51.083332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:51.083332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 442/878] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 31 04:25:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:51.090339 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3412920-c515-424d-ad68-4282c9cb6077 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:51.138908 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27f924-21b3-48a9-ad6f-5db17a966d1d None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:51.139218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27f924-21b3-48a9-ad6f-5db17a966d1d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:51.139471 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27f924-21b3-48a9-ad6f-5db17a966d1d None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:51.140942 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 443/879] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:51.146605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15a2c8-4b85-4754-b836-8a7be01a0e00 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:51.147869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15a2c8-4b85-4754-b836-8a7be01a0e00 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:51.148341 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15a2c8-4b85-4754-b836-8a7be01a0e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:51.167298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1f15a2c8-4b85-4754-b836-8a7be01a0e00 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:51.168770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1f15a2c8-4b85-4754-b836-8a7be01a0e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:51.216015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3412920-c515-424d-ad68-4282c9cb6077 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:51.251005 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 444/880] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:51 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:25:51.259952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68076f-ed9d-4452-a6b3-b78aec648225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:51.260813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68076f-ed9d-4452-a6b3-b78aec648225 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:51.261341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68076f-ed9d-4452-a6b3-b78aec648225 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:51.261843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68076f-ed9d-4452-a6b3-b78aec648225 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:51.262719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68076f-ed9d-4452-a6b3-b78aec648225 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:51.263222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68076f-ed9d-4452-a6b3-b78aec648225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:51.264793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68076f-ed9d-4452-a6b3-b78aec648225 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:51.275746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 437/881] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 31 04:25:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:51.276446 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15a2c8-4b85-4754-b836-8a7be01a0e00 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:51.285220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68076f-ed9d-4452-a6b3-b78aec648225 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:51.331096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:51.337345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:51.384357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15a2c8-4b85-4754-b836-8a7be01a0e00 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:51.412595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68076f-ed9d-4452-a6b3-b78aec648225 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:51.425429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74622b7-cc83-403a-8f2b-1129263a9ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:51.426218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74622b7-cc83-403a-8f2b-1129263a9ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:51.426496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74622b7-cc83-403a-8f2b-1129263a9ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:51.427137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74622b7-cc83-403a-8f2b-1129263a9ad2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:51.427874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74622b7-cc83-403a-8f2b-1129263a9ad2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:51.429529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74622b7-cc83-403a-8f2b-1129263a9ad2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d74622b7-cc83-403a-8f2b-1129263a9ad2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:51.441631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:51.442673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:51.443540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:51.443540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:51.443540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:51.443540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:51.443540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:51.443540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:51.443540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:51.443540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:51.443540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:51.443540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:51.443540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:25:51.443540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:51.443540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:25:51.443540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:51.448902 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 445/882] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 31 04:25:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:51.449920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74622b7-cc83-403a-8f2b-1129263a9ad2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:51.452930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f477f9e-68a7-4a0d-9f8e-789d5e47e12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:51.453845 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f477f9e-68a7-4a0d-9f8e-789d5e47e12a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:51.454309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f477f9e-68a7-4a0d-9f8e-789d5e47e12a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:51.454681 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f477f9e-68a7-4a0d-9f8e-789d5e47e12a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:51.466332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f477f9e-68a7-4a0d-9f8e-789d5e47e12a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:51.468104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f477f9e-68a7-4a0d-9f8e-789d5e47e12a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-1f477f9e-68a7-4a0d-9f8e-789d5e47e12a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:51.487935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:51.489972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:51.491533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:51.491533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:51.491533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:51.491533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 438/883] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:51.497512 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f477f9e-68a7-4a0d-9f8e-789d5e47e12a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:51.567901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74622b7-cc83-403a-8f2b-1129263a9ad2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:51.590857 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:51.605103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a269d-6e19-4973-9175-19fd1ff129eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:51.613129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a269d-6e19-4973-9175-19fd1ff129eb None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:51.613129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a269d-6e19-4973-9175-19fd1ff129eb None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:51.613129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a269d-6e19-4973-9175-19fd1ff129eb None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:51.613129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a269d-6e19-4973-9175-19fd1ff129eb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:51.613129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a269d-6e19-4973-9175-19fd1ff129eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:51.613129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a269d-6e19-4973-9175-19fd1ff129eb None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:51.613693 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:51.613772 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 446/884] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 31 04:25:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:51.614522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a269d-6e19-4973-9175-19fd1ff129eb None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:51.625907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f477f9e-68a7-4a0d-9f8e-789d5e47e12a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:51.661526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c6ce7-e4c7-43a2-b00e-69c7cab52768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:51.662247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c6ce7-e4c7-43a2-b00e-69c7cab52768 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:51.662523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c6ce7-e4c7-43a2-b00e-69c7cab52768 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:51.662790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c6ce7-e4c7-43a2-b00e-69c7cab52768 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:51.663430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c6ce7-e4c7-43a2-b00e-69c7cab52768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:51.663729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c6ce7-e4c7-43a2-b00e-69c7cab52768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:51.665290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c6ce7-e4c7-43a2-b00e-69c7cab52768 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:51.678604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 439/885] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:51.683624 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c6ce7-e4c7-43a2-b00e-69c7cab52768 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:51.716440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a269d-6e19-4973-9175-19fd1ff129eb None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:51.752103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ec374-cdde-463c-b263-c6d0aade3826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:51.752805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec374-cdde-463c-b263-c6d0aade3826 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:51.753089 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec374-cdde-463c-b263-c6d0aade3826 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:51.753388 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec374-cdde-463c-b263-c6d0aade3826 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:51.754046 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ec374-cdde-463c-b263-c6d0aade3826 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:51.755398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ec374-cdde-463c-b263-c6d0aade3826 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:51.793873 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c6ce7-e4c7-43a2-b00e-69c7cab52768 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:51.828200 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dcadc-ff81-4315-9bf9-cbc4dceee1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:51.828735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dcadc-ff81-4315-9bf9-cbc4dceee1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:51.829017 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dcadc-ff81-4315-9bf9-cbc4dceee1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:51.829323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dcadc-ff81-4315-9bf9-cbc4dceee1d3 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:51.830594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dcadc-ff81-4315-9bf9-cbc4dceee1d3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:51.830908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dcadc-ff81-4315-9bf9-cbc4dceee1d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:51.832257 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dcadc-ff81-4315-9bf9-cbc4dceee1d3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:51.836657 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 440/886] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 31 04:25:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:51.837441 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dcadc-ff81-4315-9bf9-cbc4dceee1d3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:51.870219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:51.874476 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 447/887] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 31 04:25:51 2022] POST /identity/v3/services => generated 269 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:51.977824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dcadc-ff81-4315-9bf9-cbc4dceee1d3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:52.025729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417d8da-16fd-425d-ba02-ba1411ebd92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:52.026768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417d8da-16fd-425d-ba02-ba1411ebd92d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:52.027243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417d8da-16fd-425d-ba02-ba1411ebd92d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:52.027707 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417d8da-16fd-425d-ba02-ba1411ebd92d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:52.036434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417d8da-16fd-425d-ba02-ba1411ebd92d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:52.038159 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417d8da-16fd-425d-ba02-ba1411ebd92d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-9417d8da-16fd-425d-ba02-ba1411ebd92d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:52.054533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:52.055435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:52.056381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:52.056381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:52.056381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:52.056381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:52.056381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:52.056381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:52.056381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:52.056381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:52.056381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 04:25:52.056381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:52.058393 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 441/888] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 31 04:25:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:52.064160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ec374-cdde-463c-b263-c6d0aade3826 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:52.120931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:52.177990 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ec374-cdde-463c-b263-c6d0aade3826 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:52.213525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42d771-207a-42a1-ab17-badd45fee675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:52.214129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42d771-207a-42a1-ab17-badd45fee675 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:52.214405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42d771-207a-42a1-ab17-badd45fee675 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:52.214674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42d771-207a-42a1-ab17-badd45fee675 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:52.215408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42d771-207a-42a1-ab17-badd45fee675 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:52.215711 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42d771-207a-42a1-ab17-badd45fee675 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:52.217149 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42d771-207a-42a1-ab17-badd45fee675 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:52.236112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 448/889] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 31 04:25:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:52.241659 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417d8da-16fd-425d-ba02-ba1411ebd92d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:52.316780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:52.349192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417d8da-16fd-425d-ba02-ba1411ebd92d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:52.383806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c8a66-3ae3-4b7d-b675-6bccf29a0806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:52.384335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c8a66-3ae3-4b7d-b675-6bccf29a0806 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:52.384608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c8a66-3ae3-4b7d-b675-6bccf29a0806 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:52.384876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c8a66-3ae3-4b7d-b675-6bccf29a0806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:52.458121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c8a66-3ae3-4b7d-b675-6bccf29a0806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:52.459936 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c8a66-3ae3-4b7d-b675-6bccf29a0806 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:52.532476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:52.564187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 442/890] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:25:52 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:25:52.570192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42d771-207a-42a1-ab17-badd45fee675 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:52.686931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42d771-207a-42a1-ab17-badd45fee675 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:52.688387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:52.722677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf5a45-2261-44b2-8157-689bb975d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:52.723797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5a45-2261-44b2-8157-689bb975d458 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:52.724074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5a45-2261-44b2-8157-689bb975d458 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:52.724347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5a45-2261-44b2-8157-689bb975d458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:52.734654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf5a45-2261-44b2-8157-689bb975d458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:52.736189 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf5a45-2261-44b2-8157-689bb975d458 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:52.736408 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8985c97-7807-4eca-ac79-4ec52761c8f1 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:52.736684 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8985c97-7807-4eca-ac79-4ec52761c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:52.737051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8985c97-7807-4eca-ac79-4ec52761c8f1 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:52.738559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 443/891] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:52.743682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e38d9e-33c7-421c-b726-dd34c49db9f4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:52.744185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e38d9e-33c7-421c-b726-dd34c49db9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:52.744660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e38d9e-33c7-421c-b726-dd34c49db9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-abdf5a45-2261-44b2-8157-689bb975d458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:52.756829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:52.757854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:52.759354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:52.759354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:52.759354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:52.759354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 449/892] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:52.763695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf5a45-2261-44b2-8157-689bb975d458 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:52.767370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d9e38d9e-33c7-421c-b726-dd34c49db9f4 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:52.768716 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d9e38d9e-33c7-421c-b726-dd34c49db9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:52.849335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 444/893] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:25:52.883858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf5a45-2261-44b2-8157-689bb975d458 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:52.920420 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bce30a-9c2b-4a12-a684-3f0f066ea50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:52.921381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bce30a-9c2b-4a12-a684-3f0f066ea50d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:52.921841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bce30a-9c2b-4a12-a684-3f0f066ea50d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:52.922294 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bce30a-9c2b-4a12-a684-3f0f066ea50d None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:52.923117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bce30a-9c2b-4a12-a684-3f0f066ea50d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:52.923681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bce30a-9c2b-4a12-a684-3f0f066ea50d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:52.925840 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bce30a-9c2b-4a12-a684-3f0f066ea50d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:52.939874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 450/894] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:52.946120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e38d9e-33c7-421c-b726-dd34c49db9f4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:53.060982 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e38d9e-33c7-421c-b726-dd34c49db9f4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:53.063404 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:53.103971 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740c9c3-0921-4c62-90c0-9601e6461e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:53.104905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c9c3-0921-4c62-90c0-9601e6461e99 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:53.105434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c9c3-0921-4c62-90c0-9601e6461e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:53.105890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c9c3-0921-4c62-90c0-9601e6461e99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:53.115502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740c9c3-0921-4c62-90c0-9601e6461e99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:53.117154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740c9c3-0921-4c62-90c0-9601e6461e99 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:53.123256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bce30a-9c2b-4a12-a684-3f0f066ea50d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-a740c9c3-0921-4c62-90c0-9601e6461e99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:53.131778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:53.132696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:53.134252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:53.134252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:53.134252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:53.134252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:53.134252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:53.134252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:53.134252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:53.134252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:53.134252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 445/895] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:53.138771 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740c9c3-0921-4c62-90c0-9601e6461e99 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:53.143492 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:53.248119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740c9c3-0921-4c62-90c0-9601e6461e99 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:53.254069 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bce30a-9c2b-4a12-a684-3f0f066ea50d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:53.288636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8ee76-ed24-49d7-a09d-8503b721bf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:53.289833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8ee76-ed24-49d7-a09d-8503b721bf1b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:53.290428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8ee76-ed24-49d7-a09d-8503b721bf1b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:53.290882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8ee76-ed24-49d7-a09d-8503b721bf1b None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:53.291721 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605ca56-e208-45b5-ae5a-12383d745a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:53.292049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8ee76-ed24-49d7-a09d-8503b721bf1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:53.292466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605ca56-e208-45b5-ae5a-12383d745a4b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:53.292716 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8ee76-ed24-49d7-a09d-8503b721bf1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:53.292902 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605ca56-e208-45b5-ae5a-12383d745a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:53.293135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605ca56-e208-45b5-ae5a-12383d745a4b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:53.293834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605ca56-e208-45b5-ae5a-12383d745a4b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:53.294883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8ee76-ed24-49d7-a09d-8503b721bf1b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:53.295369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605ca56-e208-45b5-ae5a-12383d745a4b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-5605ca56-e208-45b5-ae5a-12383d745a4b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:53.306095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:53.307125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:53.313066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 451/896] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:25:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:53.314365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 446/897] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:53.320506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605ca56-e208-45b5-ae5a-12383d745a4b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:53.320781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8ee76-ed24-49d7-a09d-8503b721bf1b None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:53.347557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:53.426627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:53.448824 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605ca56-e208-45b5-ae5a-12383d745a4b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:53.449045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8ee76-ed24-49d7-a09d-8503b721bf1b None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:53.490890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28406c9-8c9e-4200-be28-b4ae17a0d83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:53.491862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28406c9-8c9e-4200-be28-b4ae17a0d83a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:53.492379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28406c9-8c9e-4200-be28-b4ae17a0d83a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:53.492864 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28406c9-8c9e-4200-be28-b4ae17a0d83a None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:53.493844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28406c9-8c9e-4200-be28-b4ae17a0d83a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:53.494425 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28406c9-8c9e-4200-be28-b4ae17a0d83a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:53.496124 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28406c9-8c9e-4200-be28-b4ae17a0d83a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:53.496243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7744474-aaf2-458d-b23a-0e58d6fe3d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:53.498002 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7744474-aaf2-458d-b23a-0e58d6fe3d58 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:53.499204 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7744474-aaf2-458d-b23a-0e58d6fe3d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:53.499788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7744474-aaf2-458d-b23a-0e58d6fe3d58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:53.501632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7744474-aaf2-458d-b23a-0e58d6fe3d58 None admin] RBAC: Adding query filter params (role.id=018c712ded3f43a6af39ad9ea1bcf78e, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=d8f5e60b6e1a4acc87c03da8cf86451e) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:53.502306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7744474-aaf2-458d-b23a-0e58d6fe3d58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:53.507691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7744474-aaf2-458d-b23a-0e58d6fe3d58 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:53.507949 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 452/898] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:25:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:53.509490 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28406c9-8c9e-4200-be28-b4ae17a0d83a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:53.517222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 447/899] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:25:53 2022] GET /identity/v3/role_assignments?user.id=d8f5e60b6e1a4acc87c03da8cf86451e&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=018c712ded3f43a6af39ad9ea1bcf78e => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:53.634110 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28406c9-8c9e-4200-be28-b4ae17a0d83a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:53.672563 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ee76a-7a8b-41c8-b8fe-ba64049358a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:53.673471 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ee76a-7a8b-41c8-b8fe-ba64049358a4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:53.674012 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ee76a-7a8b-41c8-b8fe-ba64049358a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:53.674431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ee76a-7a8b-41c8-b8fe-ba64049358a4 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:53.675213 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ee76a-7a8b-41c8-b8fe-ba64049358a4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:53.675662 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ee76a-7a8b-41c8-b8fe-ba64049358a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:53.677178 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ee76a-7a8b-41c8-b8fe-ba64049358a4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:53.687692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 453/900] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:25:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:53.690918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7744474-aaf2-458d-b23a-0e58d6fe3d58 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:53.790359 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:53.806753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7744474-aaf2-458d-b23a-0e58d6fe3d58 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:53.847670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0099c0d-64bf-41e8-80df-d95b96c6a57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:53.848283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0099c0d-64bf-41e8-80df-d95b96c6a57b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:53.848561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0099c0d-64bf-41e8-80df-d95b96c6a57b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:53.848834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0099c0d-64bf-41e8-80df-d95b96c6a57b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:53.849587 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0099c0d-64bf-41e8-80df-d95b96c6a57b None admin] RBAC: Adding query filter params (interface=public, service_id=d1ffe09a17af43b2a84789fd94f13672, region_id=RegionOne) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:53.849898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0099c0d-64bf-41e8-80df-d95b96c6a57b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:53.851266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0099c0d-64bf-41e8-80df-d95b96c6a57b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:53.859532 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 448/901] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 31 04:25:53 2022] GET /identity/v3/endpoints?service_id=d1ffe09a17af43b2a84789fd94f13672&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:53.865283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ee76a-7a8b-41c8-b8fe-ba64049358a4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:53.875413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:53.909225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdda44-20bc-4383-bca1-9b192cfc57d8 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:53.909557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdda44-20bc-4383-bca1-9b192cfc57d8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:53.909780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdda44-20bc-4383-bca1-9b192cfc57d8 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:53.911351 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 449/902] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:25:53.916266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5768b-3952-42c3-b0d8-1118f0b30aca None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:53.916548 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5768b-3952-42c3-b0d8-1118f0b30aca None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:53.916890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5768b-3952-42c3-b0d8-1118f0b30aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:53.935311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-fca5768b-3952-42c3-b0d8-1118f0b30aca None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:53.936485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fca5768b-3952-42c3-b0d8-1118f0b30aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:53.981355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ee76a-7a8b-41c8-b8fe-ba64049358a4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:54.010033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 450/903] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:25:54.010790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3c5a-c6dd-4658-a4a1-d9c6df6fae18 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:54.011078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3c5a-c6dd-4658-a4a1-d9c6df6fae18 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:54.011350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3c5a-c6dd-4658-a4a1-d9c6df6fae18 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:54.013059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 451/904] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:54.019320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0edc7-6871-41f3-b061-3d51896715b0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:54.019599 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0edc7-6871-41f3-b061-3d51896715b0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:54.019872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0edc7-6871-41f3-b061-3d51896715b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:54.029996 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f259f-e668-47b3-80c0-4f4eb99da995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:54.031048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f259f-e668-47b3-80c0-4f4eb99da995 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:54.031537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f259f-e668-47b3-80c0-4f4eb99da995 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:54.032013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f259f-e668-47b3-80c0-4f4eb99da995 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:54.032850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f259f-e668-47b3-80c0-4f4eb99da995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:54.035810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f259f-e668-47b3-80c0-4f4eb99da995 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:54.040740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4bd0edc7-6871-41f3-b061-3d51896715b0 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:54.041891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4bd0edc7-6871-41f3-b061-3d51896715b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:54.043767 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 454/905] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 31 04:25:53 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:25:54.139827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 452/906] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:25:54.277043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f259f-e668-47b3-80c0-4f4eb99da995 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:54.355458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:54.388118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f259f-e668-47b3-80c0-4f4eb99da995 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:54.419638 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0edc7-6871-41f3-b061-3d51896715b0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:54.426069 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c348c7-8615-4d5e-93da-d7c7eabe4ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:54.426879 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c348c7-8615-4d5e-93da-d7c7eabe4ff6 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:54.427315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c348c7-8615-4d5e-93da-d7c7eabe4ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:54.427734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c348c7-8615-4d5e-93da-d7c7eabe4ff6 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:54.428546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c348c7-8615-4d5e-93da-d7c7eabe4ff6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:54.430585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c348c7-8615-4d5e-93da-d7c7eabe4ff6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:54.432369 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:54.497678 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 455/907] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 31 04:25:54 2022] POST /identity/v3/services => generated 241 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:54.537371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0edc7-6871-41f3-b061-3d51896715b0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:54.602638 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973432c7-63f4-4454-ada1-00ffc12aedc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:54.603318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973432c7-63f4-4454-ada1-00ffc12aedc1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:54.603649 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973432c7-63f4-4454-ada1-00ffc12aedc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:54.603924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973432c7-63f4-4454-ada1-00ffc12aedc1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:54.605910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973432c7-63f4-4454-ada1-00ffc12aedc1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:54.607323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973432c7-63f4-4454-ada1-00ffc12aedc1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-973432c7-63f4-4454-ada1-00ffc12aedc1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:54.618329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:54.619336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:54.620448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 453/908] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Aug 31 04:25:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:54.628679 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c348c7-8615-4d5e-93da-d7c7eabe4ff6 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:54.756857 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c348c7-8615-4d5e-93da-d7c7eabe4ff6 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:54.787511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:54.793430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713700c-d9d8-4597-bddb-35d6276dbe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:54.794034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713700c-d9d8-4597-bddb-35d6276dbe40 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:54.794306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713700c-d9d8-4597-bddb-35d6276dbe40 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:54.794571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713700c-d9d8-4597-bddb-35d6276dbe40 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:54.795344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713700c-d9d8-4597-bddb-35d6276dbe40 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:54.795644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713700c-d9d8-4597-bddb-35d6276dbe40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:54.797053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713700c-d9d8-4597-bddb-35d6276dbe40 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:54.802766 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 456/909] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 31 04:25:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:54.808481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973432c7-63f4-4454-ada1-00ffc12aedc1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:54.882448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:54.918556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973432c7-63f4-4454-ada1-00ffc12aedc1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:54.953986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe65fa9-24be-4fe5-9fde-46960f0cc231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:54.954591 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe65fa9-24be-4fe5-9fde-46960f0cc231 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:54.954952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe65fa9-24be-4fe5-9fde-46960f0cc231 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:54.955345 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe65fa9-24be-4fe5-9fde-46960f0cc231 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:54.956250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe65fa9-24be-4fe5-9fde-46960f0cc231 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:54.956554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe65fa9-24be-4fe5-9fde-46960f0cc231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:54.957944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe65fa9-24be-4fe5-9fde-46960f0cc231 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:54.963602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 454/910] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 31 04:25:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:54.971721 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713700c-d9d8-4597-bddb-35d6276dbe40 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:55.091001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713700c-d9d8-4597-bddb-35d6276dbe40 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:55.129040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a769e7-1e0f-4590-9c52-85327ffeb2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:55.129741 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a769e7-1e0f-4590-9c52-85327ffeb2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:55.130021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a769e7-1e0f-4590-9c52-85327ffeb2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:55.130298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a769e7-1e0f-4590-9c52-85327ffeb2e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:55.131053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a769e7-1e0f-4590-9c52-85327ffeb2e9 None admin] RBAC: Adding query filter params (interface=public, service_id=db0db6e992964ce1a27d1ddc4b71ef38, region_id=RegionOne) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:55.131368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a769e7-1e0f-4590-9c52-85327ffeb2e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:55.132786 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a769e7-1e0f-4590-9c52-85327ffeb2e9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:55.138496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 457/911] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 31 04:25:54 2022] GET /identity/v3/endpoints?service_id=db0db6e992964ce1a27d1ddc4b71ef38&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:55.146298 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe65fa9-24be-4fe5-9fde-46960f0cc231 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:55.255700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe65fa9-24be-4fe5-9fde-46960f0cc231 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:55.295105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e0869-cf3c-4482-97cb-265cd25cb08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:55.295717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e0869-cf3c-4482-97cb-265cd25cb08b None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:55.296000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e0869-cf3c-4482-97cb-265cd25cb08b None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:55.296275 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e0869-cf3c-4482-97cb-265cd25cb08b None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:55.296875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e0869-cf3c-4482-97cb-265cd25cb08b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:55.298323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e0869-cf3c-4482-97cb-265cd25cb08b None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:55.299985 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:55.305474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 455/912] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 31 04:25:55 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:25:55.553823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1510bd-c6b6-40ab-808f-ea4dfdefbbaa None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:55.554347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1510bd-c6b6-40ab-808f-ea4dfdefbbaa None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:55.554347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1510bd-c6b6-40ab-808f-ea4dfdefbbaa None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:55.555975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 458/913] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:55.561151 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a017-ba9a-4cdf-b548-0bd61ec325c4 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:55.561580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a017-ba9a-4cdf-b548-0bd61ec325c4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:55.561766 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a017-ba9a-4cdf-b548-0bd61ec325c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:55.583654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c844a017-ba9a-4cdf-b548-0bd61ec325c4 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:55.585740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c844a017-ba9a-4cdf-b548-0bd61ec325c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:55.660995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 456/914] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:55.929402 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1510bd-c6b6-40ab-808f-ea4dfdefbbaa None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:55.996985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:56.043238 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1510bd-c6b6-40ab-808f-ea4dfdefbbaa None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:56.079109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6034a7a-3897-4f65-823d-0e6e1c90a843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:56.080265 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6034a7a-3897-4f65-823d-0e6e1c90a843 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:56.081170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6034a7a-3897-4f65-823d-0e6e1c90a843 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:56.081488 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6034a7a-3897-4f65-823d-0e6e1c90a843 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:56.092034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6034a7a-3897-4f65-823d-0e6e1c90a843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d6034a7a-3897-4f65-823d-0e6e1c90a843 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:25:56.097984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:56.098943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:56.099809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:56.099809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:56.099809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:56.099809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:56.099809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:25:56.099809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:25:56.099809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:25:56.099809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:25:56.099809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:25:56.099809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:25:56.099809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 04:25:56.099809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:56.099809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 459/915] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 31 04:25:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:56.105480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844a017-ba9a-4cdf-b548-0bd61ec325c4 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:56.145958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05db1ae-916d-4279-8fd2-001a57678053 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:56.146280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05db1ae-916d-4279-8fd2-001a57678053 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:56.146503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05db1ae-916d-4279-8fd2-001a57678053 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:56.148366 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 460/916] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:25:56.153809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b8be3-6a9a-4f20-a663-ac3e24624e0b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:56.154094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b8be3-6a9a-4f20-a663-ac3e24624e0b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:56.154741 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b8be3-6a9a-4f20-a663-ac3e24624e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:56.179997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-756b8be3-6a9a-4f20-a663-ac3e24624e0b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:56.181302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-756b8be3-6a9a-4f20-a663-ac3e24624e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:56.217972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844a017-ba9a-4cdf-b548-0bd61ec325c4 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:56.249644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:56.260041 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c976614-7146-40d5-924b-df652f61ea78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:56.260767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c976614-7146-40d5-924b-df652f61ea78 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:56.261049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c976614-7146-40d5-924b-df652f61ea78 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:56.261354 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c976614-7146-40d5-924b-df652f61ea78 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:56.261903 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 461/917] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:56.265740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c976614-7146-40d5-924b-df652f61ea78 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:56.266245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c976614-7146-40d5-924b-df652f61ea78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:56.267892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c976614-7146-40d5-924b-df652f61ea78 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:56.278219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 457/918] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 31 04:25:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:56.284083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b8be3-6a9a-4f20-a663-ac3e24624e0b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:56.337568 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:56.389029 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b8be3-6a9a-4f20-a663-ac3e24624e0b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:56.427696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0878261-32d2-43e5-83de-bae61e325fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:56.428331 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0878261-32d2-43e5-83de-bae61e325fdc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:56.428612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0878261-32d2-43e5-83de-bae61e325fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:56.428887 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0878261-32d2-43e5-83de-bae61e325fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:56.440720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0878261-32d2-43e5-83de-bae61e325fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:56.442144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0878261-32d2-43e5-83de-bae61e325fdc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-e0878261-32d2-43e5-83de-bae61e325fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:56.457025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:56.457988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:56.458900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:56.458900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:56.458900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:56.458900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 462/919] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:56.464125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c976614-7146-40d5-924b-df652f61ea78 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:56.566789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0878261-32d2-43e5-83de-bae61e325fdc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:56.571836 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c976614-7146-40d5-924b-df652f61ea78 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:56.608374 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81013122-9530-4f3c-9204-1c06be61a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:56.608980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81013122-9530-4f3c-9204-1c06be61a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:56.609291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81013122-9530-4f3c-9204-1c06be61a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:56.609570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81013122-9530-4f3c-9204-1c06be61a9f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:56.610211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81013122-9530-4f3c-9204-1c06be61a9f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:56.610515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81013122-9530-4f3c-9204-1c06be61a9f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:56.612698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81013122-9530-4f3c-9204-1c06be61a9f2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:56.632248 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 458/920] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:56.632248 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e914-20bd-468c-9810-65704115df08 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:56.632248 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e914-20bd-468c-9810-65704115df08 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:56.632248 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e914-20bd-468c-9810-65704115df08 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:56.632248 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 459/921] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:56.633111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82e914-20bd-468c-9810-65704115df08 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:56.687123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:56.690553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0878261-32d2-43e5-83de-bae61e325fdc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:56.690769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:56.725735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb5e68-d32a-41a3-9a09-a50c597ab9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:56.726631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb5e68-d32a-41a3-9a09-a50c597ab9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:56.727103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb5e68-d32a-41a3-9a09-a50c597ab9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:56.727820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb5e68-d32a-41a3-9a09-a50c597ab9c0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:56.728419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb5e68-d32a-41a3-9a09-a50c597ab9c0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:56.729823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb5e68-d32a-41a3-9a09-a50c597ab9c0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-3dbb5e68-d32a-41a3-9a09-a50c597ab9c0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:56.739081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:56.740095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:56.740953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 463/922] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:25:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:56.741893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281a457-046a-4e61-b5f7-e7569a0e7c97 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:56.741893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281a457-046a-4e61-b5f7-e7569a0e7c97 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:56.741893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281a457-046a-4e61-b5f7-e7569a0e7c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:56.752602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82e914-20bd-468c-9810-65704115df08 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:56.760890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a281a457-046a-4e61-b5f7-e7569a0e7c97 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:56.762254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a281a457-046a-4e61-b5f7-e7569a0e7c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:56.788977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39453e0-9916-4df9-a3e3-6b8ebb3f8383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:56.789633 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39453e0-9916-4df9-a3e3-6b8ebb3f8383 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:56.789911 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39453e0-9916-4df9-a3e3-6b8ebb3f8383 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:56.790182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39453e0-9916-4df9-a3e3-6b8ebb3f8383 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:56.797911 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39453e0-9916-4df9-a3e3-6b8ebb3f8383 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:56.799981 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39453e0-9916-4df9-a3e3-6b8ebb3f8383 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e39453e0-9916-4df9-a3e3-6b8ebb3f8383 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:25:56.811227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:56.812221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:56.818328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:56.818328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:56.818328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:25:56.818328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:25:56.818328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:25:56.818328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:25:56.818328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:25:56.818328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:25:56.818328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 04:25:56.818328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:56.818328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 460/923] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 31 04:25:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:56.818328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39453e0-9916-4df9-a3e3-6b8ebb3f8383 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:56.861511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 464/924] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:56.861511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281a457-046a-4e61-b5f7-e7569a0e7c97 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:56.925704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39453e0-9916-4df9-a3e3-6b8ebb3f8383 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:56.937011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:56.971371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac6a6e-f51c-4101-b722-baab76978475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:56.971953 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac6a6e-f51c-4101-b722-baab76978475 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:56.972232 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac6a6e-f51c-4101-b722-baab76978475 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:56.973079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac6a6e-f51c-4101-b722-baab76978475 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:56.973742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac6a6e-f51c-4101-b722-baab76978475 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:56.974047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac6a6e-f51c-4101-b722-baab76978475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:56.975959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac6a6e-f51c-4101-b722-baab76978475 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:56.979221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:56.988774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 461/925] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:25:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:56.989896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac6a6e-f51c-4101-b722-baab76978475 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:56.992039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281a457-046a-4e61-b5f7-e7569a0e7c97 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:57.031026 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51848f2b-b0fc-4972-8344-537f4dd3942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:57.032062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51848f2b-b0fc-4972-8344-537f4dd3942a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:57.032571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51848f2b-b0fc-4972-8344-537f4dd3942a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:57.033246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51848f2b-b0fc-4972-8344-537f4dd3942a None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:57.034377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51848f2b-b0fc-4972-8344-537f4dd3942a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:57.034894 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51848f2b-b0fc-4972-8344-537f4dd3942a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:57.036517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51848f2b-b0fc-4972-8344-537f4dd3942a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:57.058836 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 465/926] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 31 04:25:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:57.064480 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51848f2b-b0fc-4972-8344-537f4dd3942a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:57.111726 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac6a6e-f51c-4101-b722-baab76978475 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:57.148299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744d734-1a1a-4939-88b1-f3bde299a0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:57.148765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744d734-1a1a-4939-88b1-f3bde299a0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:57.149097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744d734-1a1a-4939-88b1-f3bde299a0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:57.149411 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744d734-1a1a-4939-88b1-f3bde299a0a1 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:57.150037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744d734-1a1a-4939-88b1-f3bde299a0a1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:57.150334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744d734-1a1a-4939-88b1-f3bde299a0a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:57.151741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744d734-1a1a-4939-88b1-f3bde299a0a1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:57.157216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 462/927] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 31 04:25:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:57.158550 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744d734-1a1a-4939-88b1-f3bde299a0a1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:57.201493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:57.205186 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51848f2b-b0fc-4972-8344-537f4dd3942a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:57.242642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efa65c-bc69-4554-88af-c280538a326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:57.243212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efa65c-bc69-4554-88af-c280538a326f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:57.243479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efa65c-bc69-4554-88af-c280538a326f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:57.243753 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efa65c-bc69-4554-88af-c280538a326f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:57.255620 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efa65c-bc69-4554-88af-c280538a326f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:57.257099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efa65c-bc69-4554-88af-c280538a326f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:57.265792 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744d734-1a1a-4939-88b1-f3bde299a0a1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-98efa65c-bc69-4554-88af-c280538a326f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:25:57.272783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:57.273797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:25:57.274693 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:25:57.274693 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:25:57.274693 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:57.274693 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 466/928] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:25:57.274693 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efa65c-bc69-4554-88af-c280538a326f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:57.279837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:57.302235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a6a5e-1a7c-48f1-9cc2-8aee588551e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:57.302853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6a5e-1a7c-48f1-9cc2-8aee588551e7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:57.303128 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6a5e-1a7c-48f1-9cc2-8aee588551e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:57.303395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6a5e-1a7c-48f1-9cc2-8aee588551e7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:57.303962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a6a5e-1a7c-48f1-9cc2-8aee588551e7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:57.305335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a6a5e-1a7c-48f1-9cc2-8aee588551e7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-bd9a6a5e-1a7c-48f1-9cc2-8aee588551e7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:57.314636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:57.315619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:57.316643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 463/929] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 31 04:25:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:57.317927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4c984-e10f-49f9-a81a-7cf21b7f7687 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:57.317927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4c984-e10f-49f9-a81a-7cf21b7f7687 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:57.317927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4c984-e10f-49f9-a81a-7cf21b7f7687 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:57.321326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 464/930] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:57.321326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4c984-e10f-49f9-a81a-7cf21b7f7687 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:57.381369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efa65c-bc69-4554-88af-c280538a326f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:57.415391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87388d28-c1e4-4fb3-b587-2f4717c526cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:57.415990 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87388d28-c1e4-4fb3-b587-2f4717c526cf None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:57.416274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87388d28-c1e4-4fb3-b587-2f4717c526cf None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:57.416543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87388d28-c1e4-4fb3-b587-2f4717c526cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:57.417244 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87388d28-c1e4-4fb3-b587-2f4717c526cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:57.418601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87388d28-c1e4-4fb3-b587-2f4717c526cf None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:57.420697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4c984-e10f-49f9-a81a-7cf21b7f7687 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:57.422227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:57.454650 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc2393-ba64-47aa-aa74-ca1fd7a33e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:57.455343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc2393-ba64-47aa-aa74-ca1fd7a33e3a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:57.455622 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc2393-ba64-47aa-aa74-ca1fd7a33e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:57.455925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc2393-ba64-47aa-aa74-ca1fd7a33e3a None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:57.456533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc2393-ba64-47aa-aa74-ca1fd7a33e3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:57.456833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc2393-ba64-47aa-aa74-ca1fd7a33e3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:57.458217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc2393-ba64-47aa-aa74-ca1fd7a33e3a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:57.469319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 465/931] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:57.473252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc2393-ba64-47aa-aa74-ca1fd7a33e3a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:57.498265 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 467/932] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:25:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:57.499297 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815c2fa-b093-4446-846c-e6c5449a600d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:57.499585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815c2fa-b093-4446-846c-e6c5449a600d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:57.499945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815c2fa-b093-4446-846c-e6c5449a600d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:57.519892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3815c2fa-b093-4446-846c-e6c5449a600d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:57.521128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3815c2fa-b093-4446-846c-e6c5449a600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:57.584661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:57.591227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc2393-ba64-47aa-aa74-ca1fd7a33e3a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:57.609273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 468/933] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:57.609273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815c2fa-b093-4446-846c-e6c5449a600d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:57.654297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27c3f8-7def-4d47-a830-f5228bdc2231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:57.655072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27c3f8-7def-4d47-a830-f5228bdc2231 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:57.655354 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27c3f8-7def-4d47-a830-f5228bdc2231 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:57.656272 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27c3f8-7def-4d47-a830-f5228bdc2231 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:57.656395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27c3f8-7def-4d47-a830-f5228bdc2231 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:57.656675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27c3f8-7def-4d47-a830-f5228bdc2231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:57.659972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27c3f8-7def-4d47-a830-f5228bdc2231 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:57.666641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 466/934] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 31 04:25:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:57.672057 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27c3f8-7def-4d47-a830-f5228bdc2231 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:57.702270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:57.731626 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815c2fa-b093-4446-846c-e6c5449a600d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:57.769005 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1617c-3c44-4bb7-af26-143c10b4272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:57.769628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1617c-3c44-4bb7-af26-143c10b4272d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:57.769900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1617c-3c44-4bb7-af26-143c10b4272d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:57.770218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1617c-3c44-4bb7-af26-143c10b4272d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:57.778845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1617c-3c44-4bb7-af26-143c10b4272d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:57.780458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1617c-3c44-4bb7-af26-143c10b4272d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-a3b1617c-3c44-4bb7-af26-143c10b4272d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:25:57.792909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:57.793865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:57.794795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:25:57.794795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:25:57.794795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:25:57.794795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:25:57.794795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:25:57.794795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:25:57.794795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:25:57.794795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:25:57.794795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 469/935] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:25:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:57.800451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1617c-3c44-4bb7-af26-143c10b4272d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:57.810959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27c3f8-7def-4d47-a830-f5228bdc2231 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:57.863247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:57.865480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b254f-740e-42ee-89dc-0c2ee089ec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:57.866477 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b254f-740e-42ee-89dc-0c2ee089ec8e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:57.867213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b254f-740e-42ee-89dc-0c2ee089ec8e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:57.867686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b254f-740e-42ee-89dc-0c2ee089ec8e None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:57.868582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b254f-740e-42ee-89dc-0c2ee089ec8e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:57.869159 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b254f-740e-42ee-89dc-0c2ee089ec8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:57.871566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b254f-740e-42ee-89dc-0c2ee089ec8e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:57.879298 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 467/936] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 31 04:25:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:57.880578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b254f-740e-42ee-89dc-0c2ee089ec8e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:57.924018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1617c-3c44-4bb7-af26-143c10b4272d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:57.961542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696928b-b8d9-4f25-b07d-d7feaa81aa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:57.962783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696928b-b8d9-4f25-b07d-d7feaa81aa15 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:57.963571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696928b-b8d9-4f25-b07d-d7feaa81aa15 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:57.964027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696928b-b8d9-4f25-b07d-d7feaa81aa15 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:57.964892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696928b-b8d9-4f25-b07d-d7feaa81aa15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:57.965430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696928b-b8d9-4f25-b07d-d7feaa81aa15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:57.967041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696928b-b8d9-4f25-b07d-d7feaa81aa15 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:57.976126 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:57.988785 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 470/937] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:25:57.988785 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696928b-b8d9-4f25-b07d-d7feaa81aa15 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:57.989065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b254f-740e-42ee-89dc-0c2ee089ec8e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:58.021235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ef1cd-8c0e-470e-9d4c-ab6158bf0294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:58.021784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef1cd-8c0e-470e-9d4c-ab6158bf0294 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:58.022345 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef1cd-8c0e-470e-9d4c-ab6158bf0294 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:58.022939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef1cd-8c0e-470e-9d4c-ab6158bf0294 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:58.023530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ef1cd-8c0e-470e-9d4c-ab6158bf0294 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:58.024885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ef1cd-8c0e-470e-9d4c-ab6158bf0294 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-122ef1cd-8c0e-470e-9d4c-ab6158bf0294 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:25:58.034489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:25:58.035501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:25:58.036444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 468/938] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Aug 31 04:25:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:25:58.037836 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ef1cd-8c0e-470e-9d4c-ab6158bf0294 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:58.106591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696928b-b8d9-4f25-b07d-d7feaa81aa15 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:58.114936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:58.145596 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7341f-6884-4ed4-8815-e7ba9a3a8075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:58.146303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7341f-6884-4ed4-8815-e7ba9a3a8075 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:58.146576 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7341f-6884-4ed4-8815-e7ba9a3a8075 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:58.147214 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7341f-6884-4ed4-8815-e7ba9a3a8075 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:58.147915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7341f-6884-4ed4-8815-e7ba9a3a8075 None admin] RBAC: Adding query filter params (interface=public, service_id=235858d4a6914e3b9dbd7e424ccf9c4d, region_id=RegionOne) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:58.148219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7341f-6884-4ed4-8815-e7ba9a3a8075 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:58.149606 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7341f-6884-4ed4-8815-e7ba9a3a8075 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:58.154977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 471/939] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 31 04:25:57 2022] GET /identity/v3/endpoints?service_id=235858d4a6914e3b9dbd7e424ccf9c4d&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:58.155743 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7341f-6884-4ed4-8815-e7ba9a3a8075 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:58.168478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ef1cd-8c0e-470e-9d4c-ab6158bf0294 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:58.207138 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899faa0f-b695-40a5-9429-0fa8135eb59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:58.208103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899faa0f-b695-40a5-9429-0fa8135eb59c None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:58.208627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899faa0f-b695-40a5-9429-0fa8135eb59c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:58.209092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899faa0f-b695-40a5-9429-0fa8135eb59c None admin] PATH_INFO: `/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/d8f5e60b6e1a4acc87c03da8cf86451e/roles/018c712ded3f43a6af39ad9ea1bcf78e` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:58.211692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899faa0f-b695-40a5-9429-0fa8135eb59c None admin] RBAC: Authorizing `identity:create_grant(project_id=ff768fb064ce4d53b2e46ea611d3d103, user_id=d8f5e60b6e1a4acc87c03da8cf86451e, role_id=018c712ded3f43a6af39ad9ea1bcf78e)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:58.213371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899faa0f-b695-40a5-9429-0fa8135eb59c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:58.257112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7341f-6884-4ed4-8815-e7ba9a3a8075 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:58.292470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11d4fe-4814-4131-91f9-beb88fb68567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:58.293001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11d4fe-4814-4131-91f9-beb88fb68567 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:58.293307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11d4fe-4814-4131-91f9-beb88fb68567 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:58.293579 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11d4fe-4814-4131-91f9-beb88fb68567 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:58.294196 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11d4fe-4814-4131-91f9-beb88fb68567 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:58.294495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11d4fe-4814-4131-91f9-beb88fb68567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:58.295845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11d4fe-4814-4131-91f9-beb88fb68567 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:58.301353 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 472/940] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 31 04:25:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:58.302118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11d4fe-4814-4131-91f9-beb88fb68567 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:58.320752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 469/941] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:25:58 2022] PUT /identity/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/d8f5e60b6e1a4acc87c03da8cf86451e/roles/018c712ded3f43a6af39ad9ea1bcf78e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:25:58.321599 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899faa0f-b695-40a5-9429-0fa8135eb59c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:58.340643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:58.366557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:58.445847 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11d4fe-4814-4131-91f9-beb88fb68567 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:58.450734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899faa0f-b695-40a5-9429-0fa8135eb59c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:58.490786 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acb17d-20c2-440b-b952-42c5b6c353cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:58.491387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acb17d-20c2-440b-b952-42c5b6c353cc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:58.491664 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acb17d-20c2-440b-b952-42c5b6c353cc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:58.491940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acb17d-20c2-440b-b952-42c5b6c353cc None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:58.492541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acb17d-20c2-440b-b952-42c5b6c353cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:58.493984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acb17d-20c2-440b-b952-42c5b6c353cc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:58.494571 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe9619-ccb1-4c69-8dbe-d72ce9638a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:58.495375 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9619-ccb1-4c69-8dbe-d72ce9638a32 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:58.495832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9619-ccb1-4c69-8dbe-d72ce9638a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:58.496282 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9619-ccb1-4c69-8dbe-d72ce9638a32 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:58.497104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe9619-ccb1-4c69-8dbe-d72ce9638a32 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:25:58.497609 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe9619-ccb1-4c69-8dbe-d72ce9638a32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:58.499135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe9619-ccb1-4c69-8dbe-d72ce9638a32 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:58.500228 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 473/942] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 31 04:25:58 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:25:58.505026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 470/943] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 31 04:25:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:25:58.511367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acb17d-20c2-440b-b952-42c5b6c353cc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:25:58.630653 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:25:58.637679 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acb17d-20c2-440b-b952-42c5b6c353cc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:25:58.675511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f26213-68af-4791-87c7-d20c594bcc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:25:58.676511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f26213-68af-4791-87c7-d20c594bcc43 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:58.677004 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f26213-68af-4791-87c7-d20c594bcc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:58.677557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f26213-68af-4791-87c7-d20c594bcc43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:58.678493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f26213-68af-4791-87c7-d20c594bcc43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:25:58.680134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f26213-68af-4791-87c7-d20c594bcc43 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:25:58.779738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 474/944] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:25:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:25:59.534926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78283a-5469-4a8c-a9d9-3b154181bc23 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:59.535427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78283a-5469-4a8c-a9d9-3b154181bc23 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:59.535427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78283a-5469-4a8c-a9d9-3b154181bc23 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:59.536959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 471/945] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:25:59.542100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b708a0e-fc08-4e90-8772-3a872d3c3681 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:25:59.542389 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b708a0e-fc08-4e90-8772-3a872d3c3681 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:25:59.542667 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b708a0e-fc08-4e90-8772-3a872d3c3681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:25:59.561410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5b708a0e-fc08-4e90-8772-3a872d3c3681 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:25:59.562598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5b708a0e-fc08-4e90-8772-3a872d3c3681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:25:59.643176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 475/946] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:25:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:25:59.920911 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78283a-5469-4a8c-a9d9-3b154181bc23 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:00.010126 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:00.035187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78283a-5469-4a8c-a9d9-3b154181bc23 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:00.072568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070aa0-feb7-4189-8f6b-1bd5935fa251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:00.073177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070aa0-feb7-4189-8f6b-1bd5935fa251 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:00.073484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070aa0-feb7-4189-8f6b-1bd5935fa251 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:00.076558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070aa0-feb7-4189-8f6b-1bd5935fa251 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:00.076558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070aa0-feb7-4189-8f6b-1bd5935fa251 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:00.076558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070aa0-feb7-4189-8f6b-1bd5935fa251 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:00.078446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: WARNING keystone.server.flask.common [None req-d4070aa0-feb7-4189-8f6b-1bd5935fa251 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 04:26:00.126293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.sql.core [None req-d4070aa0-feb7-4189-8f6b-1bd5935fa251 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 04:26:00.126293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 04:26:00.126293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [parameters: {'id': '4c5a5e3a3bd141999f6a5b757be81216', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 04:26:00.126293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81644) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 04:26:00.145107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-d4070aa0-feb7-4189-8f6b-1bd5935fa251 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c5a5e3a3bd141999f6a5b757be81216.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c5a5e3a3bd141999f6a5b757be81216. Aug 31 04:26:00.145107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:00.145107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 04:26:00.145107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 04:26:00.145107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 04:26:00.145107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 04:26:00.145107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 04:26:00.145107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 04:26:00.145107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 04:26:00.145107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application conn.query(q) Aug 31 04:26:00.145107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 04:26:00.145107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 04:26:00.145107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application result.read() Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 04:26:00.146021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application next(self.gen) Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application yield resource Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application next(self.gen) Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise self.value Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application session.commit() Aug 31 04:26:00.147478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.session.flush() Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application compat.raise_( Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 04:26:00.149182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 04:26:00.150823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application conn.query(q) Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application result.read() Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 04:26:00.152388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [parameters: {'id': '4c5a5e3a3bd141999f6a5b757be81216', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:00.154273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:00.162301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:00.164969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:00.164969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 04:26:00.164969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 04:26:00.164969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:00.164969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:00.164969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 04:26:00.164969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 04:26:00.164969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c5a5e3a3bd141999f6a5b757be81216. Aug 31 04:26:00.164969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:00.164969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 472/947] 10.222.0.39 () {60 vars in 1140 bytes} [Wed Aug 31 04:25:59 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:00.167004 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b708a0e-fc08-4e90-8772-3a872d3c3681 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:00.240856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:00.265724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b708a0e-fc08-4e90-8772-3a872d3c3681 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:00.302407 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c621db-c15c-4da3-a286-2082b5f9a12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:00.303040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c621db-c15c-4da3-a286-2082b5f9a12e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:00.303319 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c621db-c15c-4da3-a286-2082b5f9a12e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:00.303587 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c621db-c15c-4da3-a286-2082b5f9a12e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:00.310594 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c621db-c15c-4da3-a286-2082b5f9a12e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:00.312037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c621db-c15c-4da3-a286-2082b5f9a12e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-a6c621db-c15c-4da3-a286-2082b5f9a12e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:26:00.325834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:00.337255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:00.339398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:26:00.339398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:26:00.339398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:26:00.339398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:26:00.339398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:26:00.339398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:26:00.339398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:26:00.339398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:00.339398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 476/948] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:00.340534 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070aa0-feb7-4189-8f6b-1bd5935fa251 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:00.434765 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2d766-6a37-455c-b277-772c75bc060e None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:00.435095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2d766-6a37-455c-b277-772c75bc060e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:00.435297 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2d766-6a37-455c-b277-772c75bc060e None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:00.437004 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 477/949] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:26:00.442415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4d42b-aeac-4e3e-bf2b-717273322575 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:00.442801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4d42b-aeac-4e3e-bf2b-717273322575 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:00.443257 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4d42b-aeac-4e3e-bf2b-717273322575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:00.446179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070aa0-feb7-4189-8f6b-1bd5935fa251 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:00.462578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-eeb4d42b-aeac-4e3e-bf2b-717273322575 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:00.463876 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-eeb4d42b-aeac-4e3e-bf2b-717273322575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:00.482205 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96656918-213c-4f4d-a6c1-9b3673831077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:00.482805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96656918-213c-4f4d-a6c1-9b3673831077 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:00.483077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96656918-213c-4f4d-a6c1-9b3673831077 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:00.483342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96656918-213c-4f4d-a6c1-9b3673831077 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:00.484026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96656918-213c-4f4d-a6c1-9b3673831077 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:00.484325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96656918-213c-4f4d-a6c1-9b3673831077 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:00.485996 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96656918-213c-4f4d-a6c1-9b3673831077 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:00.488294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:00.507601 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 473/950] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 31 04:26:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:00.509125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160832f-5c77-4594-8895-4543e798ef28 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:00.509609 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160832f-5c77-4594-8895-4543e798ef28 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:00.510021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160832f-5c77-4594-8895-4543e798ef28 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:00.515764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 474/951] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:00.517771 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f4828-5961-4461-a2ea-c827263566fb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:00.518459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f4828-5961-4461-a2ea-c827263566fb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:00.518892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f4828-5961-4461-a2ea-c827263566fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:00.541178 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a98f4828-5961-4461-a2ea-c827263566fb None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:00.542065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 478/952] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:00.543686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a98f4828-5961-4461-a2ea-c827263566fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:00.622312 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 475/953] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:00.827514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78078eb0-18b0-4a02-9be2-baea38c09118 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:00.829975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78078eb0-18b0-4a02-9be2-baea38c09118 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:00.829975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78078eb0-18b0-4a02-9be2-baea38c09118 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:00.829975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 479/954] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:00.835147 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccd8a8-53bb-4d39-a298-f86c34a72dde None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:00.835437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccd8a8-53bb-4d39-a298-f86c34a72dde None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:00.835714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccd8a8-53bb-4d39-a298-f86c34a72dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:00.841390 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78078eb0-18b0-4a02-9be2-baea38c09118 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:00.858367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-06ccd8a8-53bb-4d39-a298-f86c34a72dde None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:00.859563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-06ccd8a8-53bb-4d39-a298-f86c34a72dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:00.923656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:00.940209 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 476/955] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:00.941000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccd8a8-53bb-4d39-a298-f86c34a72dde None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:00.969403 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78078eb0-18b0-4a02-9be2-baea38c09118 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:01.006445 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae569c-275b-498b-9b09-b00c958e34e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:01.007076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae569c-275b-498b-9b09-b00c958e34e2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:01.007355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae569c-275b-498b-9b09-b00c958e34e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:01.007629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae569c-275b-498b-9b09-b00c958e34e2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:01.008217 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae569c-275b-498b-9b09-b00c958e34e2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:01.009692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae569c-275b-498b-9b09-b00c958e34e2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:01.013492 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-00ae569c-275b-498b-9b09-b00c958e34e2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:01.019737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:01.021072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:01.022577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 480/956] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 31 04:26:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:01.030742 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae569c-275b-498b-9b09-b00c958e34e2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:01.086904 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccd8a8-53bb-4d39-a298-f86c34a72dde None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:01.124683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f69cb-60ef-4fd1-91a5-8bfdf5429f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:01.125500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f69cb-60ef-4fd1-91a5-8bfdf5429f44 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:01.125877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f69cb-60ef-4fd1-91a5-8bfdf5429f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:01.126250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f69cb-60ef-4fd1-91a5-8bfdf5429f44 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:01.137296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f69cb-60ef-4fd1-91a5-8bfdf5429f44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4c9f69cb-60ef-4fd1-91a5-8bfdf5429f44 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:26:01.142303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:01.143370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:01.144216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:01.144216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:01.144216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:01.144216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:01.144216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:26:01.144216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:26:01.144216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:26:01.144216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:26:01.144216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:26:01.144216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:26:01.144216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 04:26:01.144216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:01.144216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 477/957] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 31 04:26:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:01.150041 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f69cb-60ef-4fd1-91a5-8bfdf5429f44 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:01.155958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae569c-275b-498b-9b09-b00c958e34e2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:01.195546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc61bd-fd68-48b4-90be-b74f9f2c8bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:01.197423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc61bd-fd68-48b4-90be-b74f9f2c8bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:01.197892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc61bd-fd68-48b4-90be-b74f9f2c8bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:01.198370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc61bd-fd68-48b4-90be-b74f9f2c8bc4 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:01.199189 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc61bd-fd68-48b4-90be-b74f9f2c8bc4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:01.199710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc61bd-fd68-48b4-90be-b74f9f2c8bc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:01.201284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc61bd-fd68-48b4-90be-b74f9f2c8bc4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:01.203412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:01.210021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 481/958] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 31 04:26:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:01.215195 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc61bd-fd68-48b4-90be-b74f9f2c8bc4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:01.278526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f69cb-60ef-4fd1-91a5-8bfdf5429f44 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:01.294834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:01.317923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d539cd-f3e9-46a0-8742-c10542c6fa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:01.318851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d539cd-f3e9-46a0-8742-c10542c6fa5f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:01.319158 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d539cd-f3e9-46a0-8742-c10542c6fa5f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:01.319557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d539cd-f3e9-46a0-8742-c10542c6fa5f None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:01.320223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d539cd-f3e9-46a0-8742-c10542c6fa5f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:01.320529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d539cd-f3e9-46a0-8742-c10542c6fa5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:01.322043 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d539cd-f3e9-46a0-8742-c10542c6fa5f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:01.330936 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 478/959] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 31 04:26:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:01.337396 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc61bd-fd68-48b4-90be-b74f9f2c8bc4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:01.337535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d539cd-f3e9-46a0-8742-c10542c6fa5f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:01.385671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612e0c8-bdcc-47e9-b224-8edf4cb5757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:01.386275 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e0c8-bdcc-47e9-b224-8edf4cb5757c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:01.386561 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e0c8-bdcc-47e9-b224-8edf4cb5757c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:01.386833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e0c8-bdcc-47e9-b224-8edf4cb5757c None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:01.387457 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612e0c8-bdcc-47e9-b224-8edf4cb5757c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:01.387768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612e0c8-bdcc-47e9-b224-8edf4cb5757c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:01.389129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612e0c8-bdcc-47e9-b224-8edf4cb5757c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:01.395419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 482/960] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 31 04:26:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:01.396256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612e0c8-bdcc-47e9-b224-8edf4cb5757c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:01.451903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d539cd-f3e9-46a0-8742-c10542c6fa5f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:01.463201 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:01.490033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882abf14-2929-4803-ba1d-c7a34145fe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:01.490670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882abf14-2929-4803-ba1d-c7a34145fe10 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:01.490949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882abf14-2929-4803-ba1d-c7a34145fe10 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:01.491228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882abf14-2929-4803-ba1d-c7a34145fe10 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:01.491868 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882abf14-2929-4803-ba1d-c7a34145fe10 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:01.493296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882abf14-2929-4803-ba1d-c7a34145fe10 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-882abf14-2929-4803-ba1d-c7a34145fe10 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:01.503780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:01.504881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:01.506491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:01.506491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:01.506491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:01.506491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:01.506491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:01.506491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:01.506491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:01.506491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:01.506491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:01.506491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:01.506491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:26:01.506491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:01.506491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 04:26:01.506491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:01.507473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612e0c8-bdcc-47e9-b224-8edf4cb5757c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:01.507583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 479/961] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:26:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:01.510474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882abf14-2929-4803-ba1d-c7a34145fe10 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:01.545575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d281-d52c-4c49-9c7d-184c4a4926e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:01.546236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d281-d52c-4c49-9c7d-184c4a4926e1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:01.546517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d281-d52c-4c49-9c7d-184c4a4926e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:01.546796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d281-d52c-4c49-9c7d-184c4a4926e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:01.558784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02d281-d52c-4c49-9c7d-184c4a4926e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:01.559399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:01.560247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02d281-d52c-4c49-9c7d-184c4a4926e1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2a02d281-d52c-4c49-9c7d-184c4a4926e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:26:01.575462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:01.580737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:26:01.581746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:26:01.581746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:01.581746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:01.581746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 483/962] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:01.581746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d281-d52c-4c49-9c7d-184c4a4926e1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:01.626590 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882abf14-2929-4803-ba1d-c7a34145fe10 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:01.665455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66086fad-0b07-49f7-8027-2ccb5395a268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:01.666227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66086fad-0b07-49f7-8027-2ccb5395a268 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:01.666517 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66086fad-0b07-49f7-8027-2ccb5395a268 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:01.666796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66086fad-0b07-49f7-8027-2ccb5395a268 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:01.667852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66086fad-0b07-49f7-8027-2ccb5395a268 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:01.669397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66086fad-0b07-49f7-8027-2ccb5395a268 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:01.685431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d281-d52c-4c49-9c7d-184c4a4926e1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:01.710255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:01.731103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9647f4d-35e1-4c28-bde0-df1eb091fdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:01.731707 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9647f4d-35e1-4c28-bde0-df1eb091fdfe None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:01.731981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9647f4d-35e1-4c28-bde0-df1eb091fdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:01.732249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9647f4d-35e1-4c28-bde0-df1eb091fdfe None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:01.732940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9647f4d-35e1-4c28-bde0-df1eb091fdfe None admin] RBAC: Adding query filter params (name=compute) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:01.733346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9647f4d-35e1-4c28-bde0-df1eb091fdfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:01.735157 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9647f4d-35e1-4c28-bde0-df1eb091fdfe None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:01.742285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 484/963] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 31 04:26:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:01.743108 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9647f4d-35e1-4c28-bde0-df1eb091fdfe None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:01.749893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 480/964] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:26:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:26:01.751055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66086fad-0b07-49f7-8027-2ccb5395a268 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:01.881597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:01.900261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66086fad-0b07-49f7-8027-2ccb5395a268 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:01.910928 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9647f4d-35e1-4c28-bde0-df1eb091fdfe None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:01.947863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c458a-f8c1-4289-b943-13a48cb29500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:01.948547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c458a-f8c1-4289-b943-13a48cb29500 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:01.948833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c458a-f8c1-4289-b943-13a48cb29500 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:01.949108 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c458a-f8c1-4289-b943-13a48cb29500 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:01.949775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c458a-f8c1-4289-b943-13a48cb29500 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:01.950081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c458a-f8c1-4289-b943-13a48cb29500 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:01.951444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c458a-f8c1-4289-b943-13a48cb29500 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:01.952434 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec3c66-0904-46c6-bb2c-5758a5938529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:01.953233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec3c66-0904-46c6-bb2c-5758a5938529 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:01.953515 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec3c66-0904-46c6-bb2c-5758a5938529 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:01.954110 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec3c66-0904-46c6-bb2c-5758a5938529 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:01.955277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec3c66-0904-46c6-bb2c-5758a5938529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:01.955584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec3c66-0904-46c6-bb2c-5758a5938529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:01.956782 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 481/965] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 31 04:26:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:01.957116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec3c66-0904-46c6-bb2c-5758a5938529 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:01.970953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 485/966] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:01.977277 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c458a-f8c1-4289-b943-13a48cb29500 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:02.101504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c458a-f8c1-4289-b943-13a48cb29500 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:02.142310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39919749-4a6b-4810-a677-1c5aa3847cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:02.142843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39919749-4a6b-4810-a677-1c5aa3847cdb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:02.143120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39919749-4a6b-4810-a677-1c5aa3847cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:02.143397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39919749-4a6b-4810-a677-1c5aa3847cdb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:02.151823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39919749-4a6b-4810-a677-1c5aa3847cdb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:02.153302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39919749-4a6b-4810-a677-1c5aa3847cdb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-39919749-4a6b-4810-a677-1c5aa3847cdb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:26:02.165296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:02.166332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:02.167353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:02.167353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:02.167353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:26:02.167353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:26:02.167353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:26:02.167353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:26:02.167353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:26:02.167353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:26:02.167353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 04:26:02.167353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:02.167353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 482/967] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 31 04:26:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:02.172191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec3c66-0904-46c6-bb2c-5758a5938529 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:02.215456 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:02.278406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec3c66-0904-46c6-bb2c-5758a5938529 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:02.314187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4542e1c-d22a-451f-9409-7335b0944c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:02.314938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4542e1c-d22a-451f-9409-7335b0944c32 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:02.315224 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4542e1c-d22a-451f-9409-7335b0944c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:02.315490 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4542e1c-d22a-451f-9409-7335b0944c32 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:02.316222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4542e1c-d22a-451f-9409-7335b0944c32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:02.316524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4542e1c-d22a-451f-9409-7335b0944c32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:02.317969 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4542e1c-d22a-451f-9409-7335b0944c32 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:02.337288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 486/968] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 31 04:26:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:02.342813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39919749-4a6b-4810-a677-1c5aa3847cdb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:02.363080 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:02.449380 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39919749-4a6b-4810-a677-1c5aa3847cdb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:02.485492 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fd88c-ac2c-46a1-bd21-88353d2ab40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:02.486330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fd88c-ac2c-46a1-bd21-88353d2ab40e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:02.486735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fd88c-ac2c-46a1-bd21-88353d2ab40e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:02.487027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fd88c-ac2c-46a1-bd21-88353d2ab40e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:02.557684 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fd88c-ac2c-46a1-bd21-88353d2ab40e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:02.559259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fd88c-ac2c-46a1-bd21-88353d2ab40e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:02.577104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:02.600947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb7804-12bd-4e9d-ace4-0b2624eee8a5 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:02.601408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb7804-12bd-4e9d-ace4-0b2624eee8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:02.601610 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb7804-12bd-4e9d-ace4-0b2624eee8a5 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:02.603483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 487/969] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:26:02.608214 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9fe45-843e-489c-8c0f-a0d1818c9362 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:02.608584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9fe45-843e-489c-8c0f-a0d1818c9362 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:02.608824 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9fe45-843e-489c-8c0f-a0d1818c9362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:02.627690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-cde9fe45-843e-489c-8c0f-a0d1818c9362 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:02.628945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cde9fe45-843e-489c-8c0f-a0d1818c9362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:02.678083 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 483/970] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:26:02 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:26:02.686619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fd88c-ac2c-46a1-bd21-88353d2ab40e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:02.712124 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 488/971] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:02.794890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fd88c-ac2c-46a1-bd21-88353d2ab40e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:02.818302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:02.830471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52b0e2-0581-444c-bebe-1490227f7821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:02.831160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b0e2-0581-444c-bebe-1490227f7821 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:02.831437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b0e2-0581-444c-bebe-1490227f7821 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:02.831705 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b0e2-0581-444c-bebe-1490227f7821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:02.842593 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52b0e2-0581-444c-bebe-1490227f7821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:02.844101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52b0e2-0581-444c-bebe-1490227f7821 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-ba52b0e2-0581-444c-bebe-1490227f7821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:26:02.858736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:02.859779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:26:02.860712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:26:02.860712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:02.860712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:02.860712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 484/972] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:02.866094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9fe45-843e-489c-8c0f-a0d1818c9362 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:02.897603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:02.974233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9fe45-843e-489c-8c0f-a0d1818c9362 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:03.009606 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52b0e2-0581-444c-bebe-1490227f7821 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:03.009947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cfc93-1df6-44c8-b630-8ba8afdb2983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:03.010542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cfc93-1df6-44c8-b630-8ba8afdb2983 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:03.010815 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cfc93-1df6-44c8-b630-8ba8afdb2983 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:03.011082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cfc93-1df6-44c8-b630-8ba8afdb2983 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:03.011727 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cfc93-1df6-44c8-b630-8ba8afdb2983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:03.012024 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cfc93-1df6-44c8-b630-8ba8afdb2983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:03.014799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cfc93-1df6-44c8-b630-8ba8afdb2983 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:03.030902 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 489/973] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:03.036560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cfc93-1df6-44c8-b630-8ba8afdb2983 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:03.131887 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52b0e2-0581-444c-bebe-1490227f7821 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:03.137642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:03.148385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cfc93-1df6-44c8-b630-8ba8afdb2983 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:03.167876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebe98e-cb16-4524-8180-939526e42541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:03.168478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebe98e-cb16-4524-8180-939526e42541 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:03.168752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebe98e-cb16-4524-8180-939526e42541 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:03.169020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebe98e-cb16-4524-8180-939526e42541 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:03.169738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebe98e-cb16-4524-8180-939526e42541 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:03.171294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebe98e-cb16-4524-8180-939526e42541 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:03.185819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534b8f6-eef8-46c6-8843-da3392c9f71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:03.186551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534b8f6-eef8-46c6-8843-da3392c9f71c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:03.186832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534b8f6-eef8-46c6-8843-da3392c9f71c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:03.187106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534b8f6-eef8-46c6-8843-da3392c9f71c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:03.195016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534b8f6-eef8-46c6-8843-da3392c9f71c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:03.196504 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534b8f6-eef8-46c6-8843-da3392c9f71c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-8534b8f6-eef8-46c6-8843-da3392c9f71c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:26:03.209237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:03.210200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:03.211142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:26:03.211142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:26:03.211142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:26:03.211142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:26:03.211142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:26:03.211142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:26:03.211142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:26:03.211142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:03.212010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 490/974] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:26:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:03.216169 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534b8f6-eef8-46c6-8843-da3392c9f71c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:03.243297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.sql.core [None req-31ebe98e-cb16-4524-8180-939526e42541 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 04:26:03.243297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 04:26:03.243297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [parameters: {'user_id': 'e41d7320e4d6479291383d62ad8e0c2c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 04:26:03.243297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81644) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-31ebe98e-cb16-4524-8180-939526e42541 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application conn.query(q) Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application result.read() Aug 31 04:26:03.250810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 04:26:03.252050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application next(self.gen) Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application yield resource Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application next(self.gen) Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise self.value Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application session.commit() Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 04:26:03.253304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.session.flush() Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application compat.raise_( Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 04:26:03.254462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 04:26:03.255583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application conn.query(q) Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application result.read() Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 04:26:03.256732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e41d7320e4d6479291383d62ad8e0c2c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:03.257903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 04:26:03.258874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 04:26:03.259992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 04:26:03.259992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 04:26:03.259992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 04:26:03.259992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 04:26:03.259992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 04:26:03.259992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:03.265455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 485/975] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 31 04:26:03 2022] POST /identity/v3/users => generated 160 bytes in 252 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:03.266959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebe98e-cb16-4524-8180-939526e42541 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:03.299313 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:03.358095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534b8f6-eef8-46c6-8843-da3392c9f71c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:03.395931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9a61f-53c4-4c41-812e-a95db6421ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:03.396699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a61f-53c4-4c41-812e-a95db6421ccc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:03.397398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a61f-53c4-4c41-812e-a95db6421ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:03.397783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a61f-53c4-4c41-812e-a95db6421ccc None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:03.398432 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebe98e-cb16-4524-8180-939526e42541 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:03.398663 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9a61f-53c4-4c41-812e-a95db6421ccc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:03.399058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9a61f-53c4-4c41-812e-a95db6421ccc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:03.400703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9a61f-53c4-4c41-812e-a95db6421ccc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:03.419246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 491/976] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:26:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:03.420509 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9a61f-53c4-4c41-812e-a95db6421ccc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:03.432485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:03.440147 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac356-d219-456e-bcb0-52656c2d1234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:03.440922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac356-d219-456e-bcb0-52656c2d1234 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:03.445210 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac356-d219-456e-bcb0-52656c2d1234 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:03.445210 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac356-d219-456e-bcb0-52656c2d1234 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:03.450244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ac356-d219-456e-bcb0-52656c2d1234 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:03.451727 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ac356-d219-456e-bcb0-52656c2d1234 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-064ac356-d219-456e-bcb0-52656c2d1234 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:26:03.464044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:03.465167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:03.466181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:03.466181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:03.466181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:26:03.466181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:26:03.466181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:26:03.466181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:26:03.466181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:26:03.466181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:26:03.466181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 04:26:03.466181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:03.471081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 486/977] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:26:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:03.471964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac356-d219-456e-bcb0-52656c2d1234 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:03.545875 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9a61f-53c4-4c41-812e-a95db6421ccc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:03.576997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:03.588670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac356-d219-456e-bcb0-52656c2d1234 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:03.594367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce1daa-5308-4991-9a15-ccf0195e19ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:03.594367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce1daa-5308-4991-9a15-ccf0195e19ea None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:03.594367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce1daa-5308-4991-9a15-ccf0195e19ea None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:03.594367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce1daa-5308-4991-9a15-ccf0195e19ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:03.594733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce1daa-5308-4991-9a15-ccf0195e19ea None admin] RBAC: Adding query filter params (role.id=018c712ded3f43a6af39ad9ea1bcf78e, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=d8f5e60b6e1a4acc87c03da8cf86451e) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:03.594733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce1daa-5308-4991-9a15-ccf0195e19ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:03.596296 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce1daa-5308-4991-9a15-ccf0195e19ea None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:03.605369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 492/978] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:26:03 2022] GET /identity/v3/role_assignments?user.id=d8f5e60b6e1a4acc87c03da8cf86451e&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=018c712ded3f43a6af39ad9ea1bcf78e => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:03.637736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257b428-94c9-47db-95ca-30576120fba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:03.638667 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257b428-94c9-47db-95ca-30576120fba4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:03.639096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257b428-94c9-47db-95ca-30576120fba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:03.639525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257b428-94c9-47db-95ca-30576120fba4 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:03.640393 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257b428-94c9-47db-95ca-30576120fba4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:03.640850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257b428-94c9-47db-95ca-30576120fba4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:03.643350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257b428-94c9-47db-95ca-30576120fba4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:03.690798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 487/979] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 31 04:26:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:03.815543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c4dd3-4a98-4e95-9c14-bc0b0352e590 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:03.815758 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c4dd3-4a98-4e95-9c14-bc0b0352e590 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:03.816037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c4dd3-4a98-4e95-9c14-bc0b0352e590 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:03.817793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 493/980] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:03.823575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa27d7c-027f-4e2f-bf3d-50c25d4feb13 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:03.823997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa27d7c-027f-4e2f-bf3d-50c25d4feb13 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:03.824366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa27d7c-027f-4e2f-bf3d-50c25d4feb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:03.846216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7fa27d7c-027f-4e2f-bf3d-50c25d4feb13 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:03.847892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7fa27d7c-027f-4e2f-bf3d-50c25d4feb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:03.920726 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 488/981] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:03.979757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51099d-57cc-4d44-aa4c-2016c4a0bccb None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:03.980298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51099d-57cc-4d44-aa4c-2016c4a0bccb None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:03.980298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51099d-57cc-4d44-aa4c-2016c4a0bccb None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:03.981854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 494/982] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:03.987285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c84973-8dc8-4d00-a1a8-4750e0256e83 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:03.987568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c84973-8dc8-4d00-a1a8-4750e0256e83 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:03.987847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c84973-8dc8-4d00-a1a8-4750e0256e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:04.006228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a6c84973-8dc8-4d00-a1a8-4750e0256e83 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:04.007419 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a6c84973-8dc8-4d00-a1a8-4750e0256e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:04.082480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 489/983] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:04.189923 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51099d-57cc-4d44-aa4c-2016c4a0bccb None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:04.262211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:04.294895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51099d-57cc-4d44-aa4c-2016c4a0bccb None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:04.328813 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b5e1a-c1c5-4198-a187-3755b0875445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:04.329558 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b5e1a-c1c5-4198-a187-3755b0875445 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:04.329944 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b5e1a-c1c5-4198-a187-3755b0875445 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:04.330280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b5e1a-c1c5-4198-a187-3755b0875445 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:04.330930 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b5e1a-c1c5-4198-a187-3755b0875445 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:04.332354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b5e1a-c1c5-4198-a187-3755b0875445 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-a14b5e1a-c1c5-4198-a187-3755b0875445 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:04.342175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:04.343343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:04.344415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:04.344415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:04.344415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:04.344415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:04.344415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:04.344415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:04.344415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:04.344415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:04.344415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:04.344415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:04.344415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:26:04.344415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:04.344415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:26:04.344415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:04.349494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 495/984] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 31 04:26:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:04.350505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b5e1a-c1c5-4198-a187-3755b0875445 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:04.350611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c84973-8dc8-4d00-a1a8-4750e0256e83 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:04.361525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:04.450605 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c84973-8dc8-4d00-a1a8-4750e0256e83 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:04.455644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b5e1a-c1c5-4198-a187-3755b0875445 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:04.488538 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396f06c-904d-483a-ad66-5a22b2e58e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:04.489118 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396f06c-904d-483a-ad66-5a22b2e58e96 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:04.489476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396f06c-904d-483a-ad66-5a22b2e58e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:04.489697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396f06c-904d-483a-ad66-5a22b2e58e96 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:04.490328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396f06c-904d-483a-ad66-5a22b2e58e96 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:04.490632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396f06c-904d-483a-ad66-5a22b2e58e96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:04.491124 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de8dde-0cd5-4a09-9fd9-731b548b60ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:04.491716 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de8dde-0cd5-4a09-9fd9-731b548b60ae None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:04.491989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de8dde-0cd5-4a09-9fd9-731b548b60ae None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:04.492142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396f06c-904d-483a-ad66-5a22b2e58e96 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:04.492316 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de8dde-0cd5-4a09-9fd9-731b548b60ae None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:04.492888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de8dde-0cd5-4a09-9fd9-731b548b60ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:04.494483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de8dde-0cd5-4a09-9fd9-731b548b60ae None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:04.497020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 490/985] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 31 04:26:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:04.497938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:04.502477 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396f06c-904d-483a-ad66-5a22b2e58e96 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:04.570553 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:04.581443 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 496/986] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 31 04:26:04 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:26:04.608470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396f06c-904d-483a-ad66-5a22b2e58e96 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:04.654335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb165b04-3acb-45bc-9098-14714f7bfae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:04.654965 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb165b04-3acb-45bc-9098-14714f7bfae5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:04.655243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb165b04-3acb-45bc-9098-14714f7bfae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:04.655515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb165b04-3acb-45bc-9098-14714f7bfae5 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:04.656498 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb165b04-3acb-45bc-9098-14714f7bfae5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:04.656498 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb165b04-3acb-45bc-9098-14714f7bfae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:04.658473 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb165b04-3acb-45bc-9098-14714f7bfae5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:04.669626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 491/987] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 31 04:26:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:04.670643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de8dde-0cd5-4a09-9fd9-731b548b60ae None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:04.787156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de8dde-0cd5-4a09-9fd9-731b548b60ae None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:04.824126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf359fb-a36c-40ae-9b3d-c9afe08e9f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:04.824736 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf359fb-a36c-40ae-9b3d-c9afe08e9f44 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:04.825014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf359fb-a36c-40ae-9b3d-c9afe08e9f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:04.825315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf359fb-a36c-40ae-9b3d-c9afe08e9f44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:04.826025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf359fb-a36c-40ae-9b3d-c9afe08e9f44 None admin] RBAC: Adding query filter params (interface=admin, service_id=235858d4a6914e3b9dbd7e424ccf9c4d, region_id=RegionOne) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:04.826335 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf359fb-a36c-40ae-9b3d-c9afe08e9f44 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:04.827703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf359fb-a36c-40ae-9b3d-c9afe08e9f44 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:04.834079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 497/988] 10.222.0.39 () {56 vars in 1249 bytes} [Wed Aug 31 04:26:04 2022] GET /identity/v3/endpoints?service_id=235858d4a6914e3b9dbd7e424ccf9c4d&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:04.839780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb165b04-3acb-45bc-9098-14714f7bfae5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:04.941930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb165b04-3acb-45bc-9098-14714f7bfae5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:04.971267 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:04.976713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d16650-29bd-4a37-ab49-fbec031d1c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:04.977367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d16650-29bd-4a37-ab49-fbec031d1c8e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:04.977645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d16650-29bd-4a37-ab49-fbec031d1c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:04.977922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d16650-29bd-4a37-ab49-fbec031d1c8e None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:04.978516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d16650-29bd-4a37-ab49-fbec031d1c8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:04.979895 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d16650-29bd-4a37-ab49-fbec031d1c8e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:04.987451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 492/989] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 31 04:26:04 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:26:05.640504 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa3dfc-8e7d-4e61-a708-8fdcdec195a2 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:05.641076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa3dfc-8e7d-4e61-a708-8fdcdec195a2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:05.641076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa3dfc-8e7d-4e61-a708-8fdcdec195a2 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:05.642544 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 498/990] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:05.648067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a3495-4897-4bdf-8828-2d631c49d00b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:05.648489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a3495-4897-4bdf-8828-2d631c49d00b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:05.648659 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a3495-4897-4bdf-8828-2d631c49d00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:05.667342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a12a3495-4897-4bdf-8828-2d631c49d00b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:05.668529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a12a3495-4897-4bdf-8828-2d631c49d00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:05.737703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 493/991] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:06.006900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa3dfc-8e7d-4e61-a708-8fdcdec195a2 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:06.077710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:06.121268 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa3dfc-8e7d-4e61-a708-8fdcdec195a2 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:06.156268 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54750e-a590-49c1-8145-baa0628360c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:06.156973 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54750e-a590-49c1-8145-baa0628360c5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:06.157280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54750e-a590-49c1-8145-baa0628360c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:06.157554 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54750e-a590-49c1-8145-baa0628360c5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:06.158783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54750e-a590-49c1-8145-baa0628360c5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:06.160157 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54750e-a590-49c1-8145-baa0628360c5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-eb54750e-a590-49c1-8145-baa0628360c5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:06.168907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:06.169938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:06.170784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:06.170784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:06.170784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:06.170784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:06.170784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:06.170784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:06.170784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:06.170784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:06.170784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:06.170784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:06.170784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:26:06.170784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:06.170784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 04:26:06.170784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:06.173991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 499/992] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Aug 31 04:26:06 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:06.176475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a3495-4897-4bdf-8828-2d631c49d00b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:06.275381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a3495-4897-4bdf-8828-2d631c49d00b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:06.300447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:06.308831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f46e3f-0fd2-4747-9e8c-16ff83d1934d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:06.309484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f46e3f-0fd2-4747-9e8c-16ff83d1934d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:06.309762 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f46e3f-0fd2-4747-9e8c-16ff83d1934d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:06.310030 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f46e3f-0fd2-4747-9e8c-16ff83d1934d None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:06.310653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f46e3f-0fd2-4747-9e8c-16ff83d1934d None admin] RBAC: Adding query filter params (name=image) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:06.310954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f46e3f-0fd2-4747-9e8c-16ff83d1934d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:06.312420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f46e3f-0fd2-4747-9e8c-16ff83d1934d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:06.317870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 494/993] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:06.323473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54750e-a590-49c1-8145-baa0628360c5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:06.428489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54750e-a590-49c1-8145-baa0628360c5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:06.451167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:06.463338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9cc3a-fa19-4258-bfea-fb2031a78b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:06.463941 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9cc3a-fa19-4258-bfea-fb2031a78b7e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:06.464214 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9cc3a-fa19-4258-bfea-fb2031a78b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:06.464482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9cc3a-fa19-4258-bfea-fb2031a78b7e None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:06.465224 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9cc3a-fa19-4258-bfea-fb2031a78b7e None admin] RBAC: Adding query filter params (type=image) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:06.465535 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9cc3a-fa19-4258-bfea-fb2031a78b7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:06.466889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9cc3a-fa19-4258-bfea-fb2031a78b7e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:06.472075 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 500/994] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:06.534334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4572dd-f1cf-460f-9375-d7dcc2047f29 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:06.534538 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4572dd-f1cf-460f-9375-d7dcc2047f29 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:06.534704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4572dd-f1cf-460f-9375-d7dcc2047f29 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:06.536305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 495/995] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:06.542099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a083c6-e167-480d-a97d-03bc5447fe05 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:06.542382 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a083c6-e167-480d-a97d-03bc5447fe05 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:06.542661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a083c6-e167-480d-a97d-03bc5447fe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:06.562153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a8a083c6-e167-480d-a97d-03bc5447fe05 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:06.563380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a8a083c6-e167-480d-a97d-03bc5447fe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:06.638432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 501/996] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:06.905146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4572dd-f1cf-460f-9375-d7dcc2047f29 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:06.935588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9fdc1-8174-407d-83a7-16edea16f415 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:06.936130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9fdc1-8174-407d-83a7-16edea16f415 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:06.936130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9fdc1-8174-407d-83a7-16edea16f415 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:06.937603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 502/997] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:06.943212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99c5c-8fd0-4039-ae71-84311fcf9caf None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:06.943495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99c5c-8fd0-4039-ae71-84311fcf9caf None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:06.943768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99c5c-8fd0-4039-ae71-84311fcf9caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:06.962549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-12d99c5c-8fd0-4039-ae71-84311fcf9caf None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:06.963741 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-12d99c5c-8fd0-4039-ae71-84311fcf9caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:07.015927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4572dd-f1cf-460f-9375-d7dcc2047f29 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:07.037334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 503/998] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:26:07.053582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884b927-c37b-45b7-898f-142683240a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:07.054220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884b927-c37b-45b7-898f-142683240a6f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:07.054556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884b927-c37b-45b7-898f-142683240a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:07.054831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884b927-c37b-45b7-898f-142683240a6f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:07.055414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884b927-c37b-45b7-898f-142683240a6f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:07.057061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884b927-c37b-45b7-898f-142683240a6f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b884b927-c37b-45b7-898f-142683240a6f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:07.067096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:07.068102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:07.070293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 496/999] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:26:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:07.074048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d99c5c-8fd0-4039-ae71-84311fcf9caf None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:07.124196 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:07.177387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d99c5c-8fd0-4039-ae71-84311fcf9caf None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:07.211350 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9767e-43b6-4d26-ab0b-b4901884d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:07.211948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9767e-43b6-4d26-ab0b-b4901884d555 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:07.212224 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9767e-43b6-4d26-ab0b-b4901884d555 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:07.212494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9767e-43b6-4d26-ab0b-b4901884d555 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:07.213114 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9767e-43b6-4d26-ab0b-b4901884d555 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:07.213442 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9767e-43b6-4d26-ab0b-b4901884d555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:07.214800 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9767e-43b6-4d26-ab0b-b4901884d555 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:07.219686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 504/1000] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 31 04:26:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:07.225774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884b927-c37b-45b7-898f-142683240a6f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:07.280947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:07.311828 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9767e-43b6-4d26-ab0b-b4901884d555 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:07.326060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884b927-c37b-45b7-898f-142683240a6f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:07.367743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783630bd-da31-4ccf-b84d-abcf4570a04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:07.368352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783630bd-da31-4ccf-b84d-abcf4570a04e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:07.368630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783630bd-da31-4ccf-b84d-abcf4570a04e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:07.368897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783630bd-da31-4ccf-b84d-abcf4570a04e None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:07.370014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783630bd-da31-4ccf-b84d-abcf4570a04e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:07.370325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783630bd-da31-4ccf-b84d-abcf4570a04e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:07.371973 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783630bd-da31-4ccf-b84d-abcf4570a04e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:07.381356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 497/1001] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 31 04:26:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:07.384244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783630bd-da31-4ccf-b84d-abcf4570a04e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:07.428276 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9767e-43b6-4d26-ab0b-b4901884d555 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:07.441616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:07.466472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c400a5-da02-4f9f-b0b5-f7e19169abe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:07.467098 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c400a5-da02-4f9f-b0b5-f7e19169abe0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:07.467372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c400a5-da02-4f9f-b0b5-f7e19169abe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:07.467638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c400a5-da02-4f9f-b0b5-f7e19169abe0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:07.468324 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c400a5-da02-4f9f-b0b5-f7e19169abe0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:07.469786 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c400a5-da02-4f9f-b0b5-f7e19169abe0 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-11c400a5-da02-4f9f-b0b5-f7e19169abe0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:07.479520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:07.480756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:07.481839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:07.481839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:07.481839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:07.481839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:07.481839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:07.481839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:07.481839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:07.481839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:07.481839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:07.481839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:07.481839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:26:07.481839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:07.481839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 04:26:07.481839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:07.484123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 505/1002] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 31 04:26:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:07.491485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c400a5-da02-4f9f-b0b5-f7e19169abe0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:07.493740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783630bd-da31-4ccf-b84d-abcf4570a04e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:07.513769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:07.531865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c6313-2609-4dd3-ada2-f18b9e2a949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:07.532468 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c6313-2609-4dd3-ada2-f18b9e2a949c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:07.532810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c6313-2609-4dd3-ada2-f18b9e2a949c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:07.533092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c6313-2609-4dd3-ada2-f18b9e2a949c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:07.533814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c6313-2609-4dd3-ada2-f18b9e2a949c None admin] RBAC: Adding query filter params (interface=public, service_id=bab911c46da04b33bb6e43debe9cd406, region_id=RegionOne) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:07.534115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c6313-2609-4dd3-ada2-f18b9e2a949c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:07.535518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c6313-2609-4dd3-ada2-f18b9e2a949c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:07.540841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 498/1003] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 31 04:26:07 2022] GET /identity/v3/endpoints?service_id=bab911c46da04b33bb6e43debe9cd406&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:07.546340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c6313-2609-4dd3-ada2-f18b9e2a949c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:07.599534 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c400a5-da02-4f9f-b0b5-f7e19169abe0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:07.633804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01a55a-3a17-4e06-96c3-bc72cfb1b02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:07.634409 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a55a-3a17-4e06-96c3-bc72cfb1b02d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:07.634689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a55a-3a17-4e06-96c3-bc72cfb1b02d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:07.634956 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a55a-3a17-4e06-96c3-bc72cfb1b02d None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:07.635582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01a55a-3a17-4e06-96c3-bc72cfb1b02d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:07.635944 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01a55a-3a17-4e06-96c3-bc72cfb1b02d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:07.637348 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01a55a-3a17-4e06-96c3-bc72cfb1b02d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:07.642001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 506/1004] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 31 04:26:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:07.648361 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01a55a-3a17-4e06-96c3-bc72cfb1b02d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:07.666189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c6313-2609-4dd3-ada2-f18b9e2a949c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:07.688473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:07.702828 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31685cc3-ac4a-4758-913b-50aafd65da9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:07.703432 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31685cc3-ac4a-4758-913b-50aafd65da9a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:07.703737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31685cc3-ac4a-4758-913b-50aafd65da9a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:07.703982 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31685cc3-ac4a-4758-913b-50aafd65da9a None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:07.704657 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31685cc3-ac4a-4758-913b-50aafd65da9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:07.706133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31685cc3-ac4a-4758-913b-50aafd65da9a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:07.721617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 499/1005] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 31 04:26:07 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:26:07.759931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01a55a-3a17-4e06-96c3-bc72cfb1b02d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:07.796708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b49c09-c676-45c0-a71d-979c9a40ecd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:07.797358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b49c09-c676-45c0-a71d-979c9a40ecd5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:07.797639 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b49c09-c676-45c0-a71d-979c9a40ecd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:07.797912 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b49c09-c676-45c0-a71d-979c9a40ecd5 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:07.798786 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b49c09-c676-45c0-a71d-979c9a40ecd5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:07.799100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b49c09-c676-45c0-a71d-979c9a40ecd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:07.800760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b49c09-c676-45c0-a71d-979c9a40ecd5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:07.806396 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 507/1006] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 31 04:26:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:07.812192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31685cc3-ac4a-4758-913b-50aafd65da9a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:07.864847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:07.925795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31685cc3-ac4a-4758-913b-50aafd65da9a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:07.961072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82b8ac-f6c8-4ec8-b7d4-c66a169dc4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:07.961629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82b8ac-f6c8-4ec8-b7d4-c66a169dc4e4 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:07.961909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82b8ac-f6c8-4ec8-b7d4-c66a169dc4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:07.962174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82b8ac-f6c8-4ec8-b7d4-c66a169dc4e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:07.962849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82b8ac-f6c8-4ec8-b7d4-c66a169dc4e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:07.964197 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82b8ac-f6c8-4ec8-b7d4-c66a169dc4e4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:08.035334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 500/1007] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:26:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:26:08.396848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c46a1-d542-466d-851a-e0dab5922c42 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:08.397703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c46a1-d542-466d-851a-e0dab5922c42 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:08.397703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c46a1-d542-466d-851a-e0dab5922c42 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:08.399185 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 508/1008] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:08.404195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c655a-8c9f-4a88-84a0-8ff8e2dc4253 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:08.404483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c655a-8c9f-4a88-84a0-8ff8e2dc4253 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:08.404753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c655a-8c9f-4a88-84a0-8ff8e2dc4253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:08.423152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4f4c655a-8c9f-4a88-84a0-8ff8e2dc4253 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:08.424914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4f4c655a-8c9f-4a88-84a0-8ff8e2dc4253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:08.496174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 501/1009] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:08 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:08.770984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c46a1-d542-466d-851a-e0dab5922c42 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:08.882138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c46a1-d542-466d-851a-e0dab5922c42 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:08.883742 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:08.916982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3270d-36ba-4d11-bc3a-b7ce54958e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:08.917889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3270d-36ba-4d11-bc3a-b7ce54958e61 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:08.918177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3270d-36ba-4d11-bc3a-b7ce54958e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:08.918446 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3270d-36ba-4d11-bc3a-b7ce54958e61 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:08.919104 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3270d-36ba-4d11-bc3a-b7ce54958e61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:08.920465 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3270d-36ba-4d11-bc3a-b7ce54958e61 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:08.997795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 509/1010] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 31 04:26:08 2022] POST /identity/v3/services => generated 242 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:26:09.681160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbadc3-4317-47b5-aae4-4754f075224e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:09.681728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbadc3-4317-47b5-aae4-4754f075224e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:09.681728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbadc3-4317-47b5-aae4-4754f075224e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:09.683253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 502/1011] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:09.688112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266db45-a095-48e9-a90f-407e904504fe None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:09.688524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266db45-a095-48e9-a90f-407e904504fe None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:09.688710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266db45-a095-48e9-a90f-407e904504fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:09.712678 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7266db45-a095-48e9-a90f-407e904504fe None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:09.712678 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7266db45-a095-48e9-a90f-407e904504fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:09.788054 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 510/1012] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:09 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:10.041248 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b980bec-1fea-4af3-acf5-78b8527fc058 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:10.041449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b980bec-1fea-4af3-acf5-78b8527fc058 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:10.041713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b980bec-1fea-4af3-acf5-78b8527fc058 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:10.043194 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 503/1013] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:10.048122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b23360-448c-417a-b592-4dcf5afde7b9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:10.052770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b23360-448c-417a-b592-4dcf5afde7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:10.052770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b23360-448c-417a-b592-4dcf5afde7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:10.065859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b980bec-1fea-4af3-acf5-78b8527fc058 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:10.069426 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d9b23360-448c-417a-b592-4dcf5afde7b9 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:10.074116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d9b23360-448c-417a-b592-4dcf5afde7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:10.101617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:10.148864 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 511/1014] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:10 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:10.180873 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b980bec-1fea-4af3-acf5-78b8527fc058 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:10.217792 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc693a9e-b98c-4992-949d-58ccf9f94740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:10.218424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc693a9e-b98c-4992-949d-58ccf9f94740 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:10.218717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc693a9e-b98c-4992-949d-58ccf9f94740 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:10.218973 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc693a9e-b98c-4992-949d-58ccf9f94740 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:10.219553 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc693a9e-b98c-4992-949d-58ccf9f94740 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:10.220967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc693a9e-b98c-4992-949d-58ccf9f94740 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-dc693a9e-b98c-4992-949d-58ccf9f94740 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:10.229843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:10.230864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:10.232283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:10.232283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:10.232283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:10.232283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:10.232283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:10.232283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:10.232283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:10.232283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:10.232283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:10.232283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:10.232283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:26:10.232283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:10.232283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 04:26:10.232283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:10.235999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 504/1015] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:26:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:10.236975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b23360-448c-417a-b592-4dcf5afde7b9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:10.256729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:10.341329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b23360-448c-417a-b592-4dcf5afde7b9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:10.376071 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c27b2d-0833-4b6a-95ba-47ec5f66722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:10.376785 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c27b2d-0833-4b6a-95ba-47ec5f66722b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:10.377068 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c27b2d-0833-4b6a-95ba-47ec5f66722b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:10.377378 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c27b2d-0833-4b6a-95ba-47ec5f66722b None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:10.378011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c27b2d-0833-4b6a-95ba-47ec5f66722b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:10.378317 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c27b2d-0833-4b6a-95ba-47ec5f66722b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:10.379754 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c27b2d-0833-4b6a-95ba-47ec5f66722b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:10.389066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 512/1016] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 31 04:26:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:10.390287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc693a9e-b98c-4992-949d-58ccf9f94740 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:10.429975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c27b2d-0833-4b6a-95ba-47ec5f66722b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:10.488708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:10.495355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc693a9e-b98c-4992-949d-58ccf9f94740 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:10.513517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:10.532321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf588fa-0838-4801-9b12-59c589397fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:10.533000 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c27b2d-0833-4b6a-95ba-47ec5f66722b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:10.533260 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf588fa-0838-4801-9b12-59c589397fda None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:10.533552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf588fa-0838-4801-9b12-59c589397fda None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:10.533828 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf588fa-0838-4801-9b12-59c589397fda None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:10.534463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf588fa-0838-4801-9b12-59c589397fda None admin] RBAC: Adding query filter params (type=compute) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:10.534821 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf588fa-0838-4801-9b12-59c589397fda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:10.536191 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf588fa-0838-4801-9b12-59c589397fda None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:10.541448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 505/1017] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 31 04:26:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:10.546945 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf588fa-0838-4801-9b12-59c589397fda None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:10.577127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee614341-caff-4d45-9871-d1d3a4245616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:10.577784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee614341-caff-4d45-9871-d1d3a4245616 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:10.578069 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee614341-caff-4d45-9871-d1d3a4245616 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:10.578339 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee614341-caff-4d45-9871-d1d3a4245616 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:10.579448 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee614341-caff-4d45-9871-d1d3a4245616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:10.581458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee614341-caff-4d45-9871-d1d3a4245616 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:10.583182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 513/1018] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:10.588709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee614341-caff-4d45-9871-d1d3a4245616 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:10.657585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf588fa-0838-4801-9b12-59c589397fda None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:10.695199 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e5d54-cf62-4385-b832-c2b3afd61e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:10.695837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee614341-caff-4d45-9871-d1d3a4245616 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:10.696185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5d54-cf62-4385-b832-c2b3afd61e85 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:10.696185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5d54-cf62-4385-b832-c2b3afd61e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:10.696369 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5d54-cf62-4385-b832-c2b3afd61e85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:10.696987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e5d54-cf62-4385-b832-c2b3afd61e85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:10.698424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e5d54-cf62-4385-b832-c2b3afd61e85 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:10.731375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8aed2d-e95f-4329-b6f3-a4cf9877cfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:10.731375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aed2d-e95f-4329-b6f3-a4cf9877cfb7 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:10.731375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aed2d-e95f-4329-b6f3-a4cf9877cfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:10.731810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aed2d-e95f-4329-b6f3-a4cf9877cfb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:10.732173 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8aed2d-e95f-4329-b6f3-a4cf9877cfb7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:10.733627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8aed2d-e95f-4329-b6f3-a4cf9877cfb7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:10.781291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 506/1019] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:26:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:26:10.819246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 514/1020] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 31 04:26:10 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:26:10.974733 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e461b8-1a55-41a1-a742-94ab74bdcabe None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:10.975078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e461b8-1a55-41a1-a742-94ab74bdcabe None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:10.975183 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e461b8-1a55-41a1-a742-94ab74bdcabe None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:10.976535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 507/1021] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:10.982100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dafff8-82d6-4422-baab-5cabc4a5b382 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:10.982394 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dafff8-82d6-4422-baab-5cabc4a5b382 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:10.982675 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dafff8-82d6-4422-baab-5cabc4a5b382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:10.989719 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:11.003115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-00dafff8-82d6-4422-baab-5cabc4a5b382 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:11.007353 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-00dafff8-82d6-4422-baab-5cabc4a5b382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:11.091344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 515/1022] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:11.365561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e461b8-1a55-41a1-a742-94ab74bdcabe None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:11.385359 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:11.471368 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e461b8-1a55-41a1-a742-94ab74bdcabe None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:11.504999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5136c6d-aa6f-43ab-bd69-27ac6a84d1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:11.505658 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5136c6d-aa6f-43ab-bd69-27ac6a84d1ec None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:11.505938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5136c6d-aa6f-43ab-bd69-27ac6a84d1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:11.506209 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5136c6d-aa6f-43ab-bd69-27ac6a84d1ec None admin] PATH_INFO: `/v3/services/image` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:11.506789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5136c6d-aa6f-43ab-bd69-27ac6a84d1ec None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:11.508142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5136c6d-aa6f-43ab-bd69-27ac6a84d1ec None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-f5136c6d-aa6f-43ab-bd69-27ac6a84d1ec None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:11.516927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:11.518206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:11.519111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:11.519111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:11.519111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:11.519111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:11.519111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:11.519111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:11.519111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:11.519111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:11.519111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:11.519111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:11.519111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:26:11.519111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:11.519111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 04:26:11.519111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:11.521532 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 508/1023] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Aug 31 04:26:11 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:11.524618 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dafff8-82d6-4422-baab-5cabc4a5b382 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:11.627613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dafff8-82d6-4422-baab-5cabc4a5b382 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:11.653686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:11.662651 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d541c-d8f4-44e6-8fe2-07a814a94eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:11.665132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d541c-d8f4-44e6-8fe2-07a814a94eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:11.665132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d541c-d8f4-44e6-8fe2-07a814a94eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:11.665132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d541c-d8f4-44e6-8fe2-07a814a94eb2 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:11.665132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d541c-d8f4-44e6-8fe2-07a814a94eb2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:11.665132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d541c-d8f4-44e6-8fe2-07a814a94eb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:11.666061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d541c-d8f4-44e6-8fe2-07a814a94eb2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:11.676144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 516/1024] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:11.677700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5136c6d-aa6f-43ab-bd69-27ac6a84d1ec None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:11.760695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:11.780439 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5136c6d-aa6f-43ab-bd69-27ac6a84d1ec None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:11.815493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0949825-6121-49f7-8a83-336e322953b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:11.816099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0949825-6121-49f7-8a83-336e322953b0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:11.816437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0949825-6121-49f7-8a83-336e322953b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:11.816645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0949825-6121-49f7-8a83-336e322953b0 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:11.817289 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0949825-6121-49f7-8a83-336e322953b0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:11.817593 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0949825-6121-49f7-8a83-336e322953b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:11.818945 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0949825-6121-49f7-8a83-336e322953b0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:11.848968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 509/1025] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:11.855125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d541c-d8f4-44e6-8fe2-07a814a94eb2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:11.960020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d541c-d8f4-44e6-8fe2-07a814a94eb2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:11.997138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97a79f-e9fa-4fbd-972c-ab9943f5e238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:11.997759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97a79f-e9fa-4fbd-972c-ab9943f5e238 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:11.998033 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97a79f-e9fa-4fbd-972c-ab9943f5e238 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:11.998301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97a79f-e9fa-4fbd-972c-ab9943f5e238 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:11.998991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97a79f-e9fa-4fbd-972c-ab9943f5e238 None admin] RBAC: Adding query filter params (interface=public, service_id=4d1033429efa4a78b6e32c5c13e81177, region_id=RegionOne) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:11.999297 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97a79f-e9fa-4fbd-972c-ab9943f5e238 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:12.000646 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97a79f-e9fa-4fbd-972c-ab9943f5e238 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:12.009487 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 517/1026] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 31 04:26:11 2022] GET /identity/v3/endpoints?service_id=4d1033429efa4a78b6e32c5c13e81177&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:12.011973 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0949825-6121-49f7-8a83-336e322953b0 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:12.115352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0949825-6121-49f7-8a83-336e322953b0 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:12.149827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ac206-91e3-4933-b09b-59310ba4cc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:12.150427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ac206-91e3-4933-b09b-59310ba4cc50 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:12.150704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ac206-91e3-4933-b09b-59310ba4cc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:12.150974 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ac206-91e3-4933-b09b-59310ba4cc50 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:12.151569 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ac206-91e3-4933-b09b-59310ba4cc50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:12.152916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ac206-91e3-4933-b09b-59310ba4cc50 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:12.160508 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 510/1027] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 31 04:26:12 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:26:12.789994 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f17a5-3b59-419a-8f8e-7eee868ccbd4 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:12.790374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f17a5-3b59-419a-8f8e-7eee868ccbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:12.790555 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f17a5-3b59-419a-8f8e-7eee868ccbd4 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:12.792037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 518/1028] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:12.796920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84002637-e82c-47ff-94c0-3d1a5445d9bc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:12.797389 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84002637-e82c-47ff-94c0-3d1a5445d9bc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:12.797551 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84002637-e82c-47ff-94c0-3d1a5445d9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:12.816390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-84002637-e82c-47ff-94c0-3d1a5445d9bc None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:12.817602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-84002637-e82c-47ff-94c0-3d1a5445d9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:12.817811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d422-0f58-4806-8ea2-4f6a2a0b28d5 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:12.818102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d422-0f58-4806-8ea2-4f6a2a0b28d5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:12.818517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d422-0f58-4806-8ea2-4f6a2a0b28d5 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:12.819923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:12.821573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 519/1029] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:26:12.825984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db866f7-b205-4ccc-9a2e-57957ca83184 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:12.826271 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db866f7-b205-4ccc-9a2e-57957ca83184 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:12.826933 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db866f7-b205-4ccc-9a2e-57957ca83184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:12.847300 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1db866f7-b205-4ccc-9a2e-57957ca83184 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:12.848493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1db866f7-b205-4ccc-9a2e-57957ca83184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:12.889129 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 511/1030] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:12.901020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:12.918221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 520/1031] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:26:13.155392 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84002637-e82c-47ff-94c0-3d1a5445d9bc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:13.185574 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db866f7-b205-4ccc-9a2e-57957ca83184 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:13.261723 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84002637-e82c-47ff-94c0-3d1a5445d9bc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:13.297599 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e30201-e5c4-4794-b527-45d9277de259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:13.298262 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e30201-e5c4-4794-b527-45d9277de259 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:13.298573 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e30201-e5c4-4794-b527-45d9277de259 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:13.299017 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e30201-e5c4-4794-b527-45d9277de259 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:13.299948 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e30201-e5c4-4794-b527-45d9277de259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:13.301398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e30201-e5c4-4794-b527-45d9277de259 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:13.301689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db866f7-b205-4ccc-9a2e-57957ca83184 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:13.303150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 512/1032] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:13.308492 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e30201-e5c4-4794-b527-45d9277de259 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:13.318833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:13.337374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d61393-03f6-47ce-9f9b-ea89b003c5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:13.338000 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d61393-03f6-47ce-9f9b-ea89b003c5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:13.338278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d61393-03f6-47ce-9f9b-ea89b003c5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:13.338546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d61393-03f6-47ce-9f9b-ea89b003c5a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:13.349739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d61393-03f6-47ce-9f9b-ea89b003c5a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-70d61393-03f6-47ce-9f9b-ea89b003c5a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:26:13.354541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:13.355603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:13.356522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:13.356522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:13.356522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:13.356522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:13.356522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:26:13.356522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:26:13.356522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:26:13.356522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:26:13.356522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:26:13.356522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:26:13.356522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 04:26:13.356522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:13.356522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 521/1033] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 31 04:26:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:13.363022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d61393-03f6-47ce-9f9b-ea89b003c5a4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:13.413690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:13.420288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e30201-e5c4-4794-b527-45d9277de259 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:13.456701 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af7d36-ed34-4f58-ab52-037b0c83026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:13.457348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af7d36-ed34-4f58-ab52-037b0c83026a None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:13.458076 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af7d36-ed34-4f58-ab52-037b0c83026a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:13.458351 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af7d36-ed34-4f58-ab52-037b0c83026a None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:13.459265 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af7d36-ed34-4f58-ab52-037b0c83026a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:13.461155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af7d36-ed34-4f58-ab52-037b0c83026a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:13.469217 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d61393-03f6-47ce-9f9b-ea89b003c5a4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:13.503673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2bb00-ae54-458e-9faf-f4250703919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:13.504272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2bb00-ae54-458e-9faf-f4250703919e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:13.504550 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2bb00-ae54-458e-9faf-f4250703919e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:13.504862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2bb00-ae54-458e-9faf-f4250703919e None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:13.505518 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2bb00-ae54-458e-9faf-f4250703919e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:13.505820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2bb00-ae54-458e-9faf-f4250703919e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:13.507191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2bb00-ae54-458e-9faf-f4250703919e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:13.515132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 522/1034] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 31 04:26:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:13.521115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2bb00-ae54-458e-9faf-f4250703919e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:13.577884 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 513/1035] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:26:13 2022] POST /identity/v3/users => generated 285 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:26:13.629660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2bb00-ae54-458e-9faf-f4250703919e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:13.639874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:13.667777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c242ff0-c265-4f7f-aa26-07af741a1cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:13.668418 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c242ff0-c265-4f7f-aa26-07af741a1cdc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:13.668699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c242ff0-c265-4f7f-aa26-07af741a1cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:13.668971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c242ff0-c265-4f7f-aa26-07af741a1cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:13.681434 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c242ff0-c265-4f7f-aa26-07af741a1cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:13.682935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c242ff0-c265-4f7f-aa26-07af741a1cdc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-5c242ff0-c265-4f7f-aa26-07af741a1cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:26:13.699102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:13.700175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:26:13.701077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:26:13.701077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:13.701077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:13.701077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 523/1036] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:13.706954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af7d36-ed34-4f58-ab52-037b0c83026a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:13.775034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:13.819042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af7d36-ed34-4f58-ab52-037b0c83026a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:13.853961 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad1f4f-453a-40d8-863f-bdea8199b6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:13.854505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad1f4f-453a-40d8-863f-bdea8199b6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:13.854785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad1f4f-453a-40d8-863f-bdea8199b6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:13.855057 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad1f4f-453a-40d8-863f-bdea8199b6e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:13.855698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad1f4f-453a-40d8-863f-bdea8199b6e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:13.856002 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad1f4f-453a-40d8-863f-bdea8199b6e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:13.857396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad1f4f-453a-40d8-863f-bdea8199b6e3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:13.870533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 514/1037] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:13.876253 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c242ff0-c265-4f7f-aa26-07af741a1cdc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:13.980406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c242ff0-c265-4f7f-aa26-07af741a1cdc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:14.014738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4135ca-4290-4db9-be26-a4146fe016d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:14.015366 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4135ca-4290-4db9-be26-a4146fe016d7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:14.015645 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4135ca-4290-4db9-be26-a4146fe016d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:14.015920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4135ca-4290-4db9-be26-a4146fe016d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:14.024869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4135ca-4290-4db9-be26-a4146fe016d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:14.026432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4135ca-4290-4db9-be26-a4146fe016d7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-3f4135ca-4290-4db9-be26-a4146fe016d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:26:14.038156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:14.039274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:14.040411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:14.040411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:14.040411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:26:14.040411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:26:14.040411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:26:14.040411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:26:14.040411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:26:14.040411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:26:14.040411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:26:14.040411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:14.040411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 524/1038] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 31 04:26:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:14.046892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad1f4f-453a-40d8-863f-bdea8199b6e3 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:14.082087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502bc96-fc34-4de7-9354-1bc8d822764a None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:14.082400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502bc96-fc34-4de7-9354-1bc8d822764a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:14.082640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502bc96-fc34-4de7-9354-1bc8d822764a None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:14.084107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 525/1039] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:14.088864 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94091246-7470-4722-a620-f62ebd6f232e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:14.089144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94091246-7470-4722-a620-f62ebd6f232e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:14.089443 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94091246-7470-4722-a620-f62ebd6f232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:14.107751 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-94091246-7470-4722-a620-f62ebd6f232e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:14.108868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-94091246-7470-4722-a620-f62ebd6f232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:14.124158 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:14.170842 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad1f4f-453a-40d8-863f-bdea8199b6e3 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:14.179112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 526/1040] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:14.197481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:14.209703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e832357-8fb3-4367-b0be-cec5ccf02d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:14.212400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e832357-8fb3-4367-b0be-cec5ccf02d35 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:14.212400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e832357-8fb3-4367-b0be-cec5ccf02d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:14.212400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e832357-8fb3-4367-b0be-cec5ccf02d35 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:14.212400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e832357-8fb3-4367-b0be-cec5ccf02d35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:14.212400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e832357-8fb3-4367-b0be-cec5ccf02d35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:14.213456 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e832357-8fb3-4367-b0be-cec5ccf02d35 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:14.231690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 515/1041] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 31 04:26:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:14.237039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94091246-7470-4722-a620-f62ebd6f232e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:14.338605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94091246-7470-4722-a620-f62ebd6f232e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:14.373917 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c24d0-a2a1-4dc9-87d3-f0661732a5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:14.374466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c24d0-a2a1-4dc9-87d3-f0661732a5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:14.374795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c24d0-a2a1-4dc9-87d3-f0661732a5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:14.374993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c24d0-a2a1-4dc9-87d3-f0661732a5b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:14.394435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:14.444641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c24d0-a2a1-4dc9-87d3-f0661732a5b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:14.446124 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c24d0-a2a1-4dc9-87d3-f0661732a5b3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:14.449063 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e832357-8fb3-4367-b0be-cec5ccf02d35 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:14.552757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e832357-8fb3-4367-b0be-cec5ccf02d35 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:14.556831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 527/1042] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:26:14 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:26:14.557625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c24d0-a2a1-4dc9-87d3-f0661732a5b3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:14.591552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c1648-a8b9-4aa4-b82b-869c67604695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:14.592331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c1648-a8b9-4aa4-b82b-869c67604695 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:14.592616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c1648-a8b9-4aa4-b82b-869c67604695 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:14.592891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c1648-a8b9-4aa4-b82b-869c67604695 None admin] PATH_INFO: `/v3/services/image` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:14.593505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c1648-a8b9-4aa4-b82b-869c67604695 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:14.594863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c1648-a8b9-4aa4-b82b-869c67604695 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-994c1648-a8b9-4aa4-b82b-869c67604695 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:14.603769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:14.604810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:14.605806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 516/1043] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Aug 31 04:26:14 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:14.610966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c1648-a8b9-4aa4-b82b-869c67604695 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:14.612784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:14.659311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:14.670978 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c24d0-a2a1-4dc9-87d3-f0661732a5b3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:14.708526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617a02a-80e0-4b4d-9a09-b4469212115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:14.709346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617a02a-80e0-4b4d-9a09-b4469212115b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:14.709628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617a02a-80e0-4b4d-9a09-b4469212115b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:14.709904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617a02a-80e0-4b4d-9a09-b4469212115b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:14.714941 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c1648-a8b9-4aa4-b82b-869c67604695 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:14.722179 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617a02a-80e0-4b4d-9a09-b4469212115b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:14.723753 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617a02a-80e0-4b4d-9a09-b4469212115b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-7617a02a-80e0-4b4d-9a09-b4469212115b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:26:14.739644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:14.740666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:26:14.742248 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:26:14.742248 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:14.742248 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:14.742248 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 528/1044] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:14.746374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617a02a-80e0-4b4d-9a09-b4469212115b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:14.753329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359cacf-6e49-4d9f-89fa-72ab3dbd7a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:14.753966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359cacf-6e49-4d9f-89fa-72ab3dbd7a28 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:14.754244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359cacf-6e49-4d9f-89fa-72ab3dbd7a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:14.754517 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359cacf-6e49-4d9f-89fa-72ab3dbd7a28 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:14.755168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359cacf-6e49-4d9f-89fa-72ab3dbd7a28 None admin] RBAC: Adding query filter params (name=image) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:14.755473 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359cacf-6e49-4d9f-89fa-72ab3dbd7a28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:14.756884 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359cacf-6e49-4d9f-89fa-72ab3dbd7a28 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:14.762512 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 517/1045] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:14.769133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359cacf-6e49-4d9f-89fa-72ab3dbd7a28 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:14.872277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617a02a-80e0-4b4d-9a09-b4469212115b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:14.874479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:14.875964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359cacf-6e49-4d9f-89fa-72ab3dbd7a28 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:14.885076 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:14.911680 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645ebf7-e71f-4387-ab18-4ad899899cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:14.912336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645ebf7-e71f-4387-ab18-4ad899899cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:14.912722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645ebf7-e71f-4387-ab18-4ad899899cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:14.913011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645ebf7-e71f-4387-ab18-4ad899899cd1 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:14.913703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645ebf7-e71f-4387-ab18-4ad899899cd1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:14.914008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645ebf7-e71f-4387-ab18-4ad899899cd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:14.914843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee1ae-4d5a-4463-a3f8-6f1b69fe6539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:14.915429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645ebf7-e71f-4387-ab18-4ad899899cd1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:14.915529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee1ae-4d5a-4463-a3f8-6f1b69fe6539 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:14.915696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee1ae-4d5a-4463-a3f8-6f1b69fe6539 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:14.915986 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee1ae-4d5a-4463-a3f8-6f1b69fe6539 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:14.916605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beee1ae-4d5a-4463-a3f8-6f1b69fe6539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:14.916907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beee1ae-4d5a-4463-a3f8-6f1b69fe6539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:14.918286 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beee1ae-4d5a-4463-a3f8-6f1b69fe6539 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:14.925240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 518/1046] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:14.926682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645ebf7-e71f-4387-ab18-4ad899899cd1 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:14.931584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 529/1047] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:14.936836 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee1ae-4d5a-4463-a3f8-6f1b69fe6539 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:15.038431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645ebf7-e71f-4387-ab18-4ad899899cd1 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:15.038801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beee1ae-4d5a-4463-a3f8-6f1b69fe6539 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:15.078145 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd690d3-533f-4853-a21f-394291cf316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:15.078778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd690d3-533f-4853-a21f-394291cf316b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:15.079046 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd690d3-533f-4853-a21f-394291cf316b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:15.079321 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd690d3-533f-4853-a21f-394291cf316b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:15.081862 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea619d-2eb4-47b9-bfb9-67a1b4e5be6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:15.082783 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea619d-2eb4-47b9-bfb9-67a1b4e5be6c None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:15.082902 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea619d-2eb4-47b9-bfb9-67a1b4e5be6c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:15.083132 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea619d-2eb4-47b9-bfb9-67a1b4e5be6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:15.083802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea619d-2eb4-47b9-bfb9-67a1b4e5be6c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:15.085155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea619d-2eb4-47b9-bfb9-67a1b4e5be6c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:15.087179 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd690d3-533f-4853-a21f-394291cf316b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:15.088606 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd690d3-533f-4853-a21f-394291cf316b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-ffd690d3-533f-4853-a21f-394291cf316b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:26:15.100506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:15.101677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:15.102602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:26:15.102602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:26:15.102602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:26:15.102602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:26:15.102602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:26:15.102602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:26:15.102602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:26:15.102602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:15.102602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 530/1048] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:15.107340 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd690d3-533f-4853-a21f-394291cf316b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:15.133126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:15.167084 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 519/1049] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:26:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:26:15.213475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd690d3-533f-4853-a21f-394291cf316b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:15.260776 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b197a5a-5474-4900-9b44-f547216e8bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:15.261419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b197a5a-5474-4900-9b44-f547216e8bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:15.261698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b197a5a-5474-4900-9b44-f547216e8bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:15.261966 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b197a5a-5474-4900-9b44-f547216e8bd2 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:15.262671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b197a5a-5474-4900-9b44-f547216e8bd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:15.263026 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b197a5a-5474-4900-9b44-f547216e8bd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:15.264482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b197a5a-5474-4900-9b44-f547216e8bd2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:15.281398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 531/1050] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:15.284928 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea619d-2eb4-47b9-bfb9-67a1b4e5be6c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:15.316945 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:15.391068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea619d-2eb4-47b9-bfb9-67a1b4e5be6c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:15.428541 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f428ea-0406-4b3a-b3b9-13bd3030fb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:15.429071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f428ea-0406-4b3a-b3b9-13bd3030fb93 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:15.429384 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f428ea-0406-4b3a-b3b9-13bd3030fb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:15.429659 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f428ea-0406-4b3a-b3b9-13bd3030fb93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:15.430383 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f428ea-0406-4b3a-b3b9-13bd3030fb93 None admin] RBAC: Adding query filter params (role.id=018c712ded3f43a6af39ad9ea1bcf78e, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=4877b72a6cea410dbb31a35c7acbd5f9) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:15.430700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f428ea-0406-4b3a-b3b9-13bd3030fb93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:15.432127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f428ea-0406-4b3a-b3b9-13bd3030fb93 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:15.437835 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 520/1051] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:26:15 2022] GET /identity/v3/role_assignments?user.id=4877b72a6cea410dbb31a35c7acbd5f9&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=018c712ded3f43a6af39ad9ea1bcf78e => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:15.609239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672692bd-267f-475a-a13f-4dc3c6f6043c None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:15.609567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672692bd-267f-475a-a13f-4dc3c6f6043c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:15.609783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672692bd-267f-475a-a13f-4dc3c6f6043c None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:15.611327 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 532/1052] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:15.616350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f301f7-e48d-42bd-9735-adaf6dce4292 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:15.616632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f301f7-e48d-42bd-9735-adaf6dce4292 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:15.616901 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f301f7-e48d-42bd-9735-adaf6dce4292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:15.634946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-18f301f7-e48d-42bd-9735-adaf6dce4292 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:15.636138 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-18f301f7-e48d-42bd-9735-adaf6dce4292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:15.703560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 521/1053] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:15.977480 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672692bd-267f-475a-a13f-4dc3c6f6043c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:16.058370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:16.085694 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672692bd-267f-475a-a13f-4dc3c6f6043c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:16.119742 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d15f4f-3fc0-497b-83aa-112e862e5034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:16.120360 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15f4f-3fc0-497b-83aa-112e862e5034 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:16.120634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15f4f-3fc0-497b-83aa-112e862e5034 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:16.120899 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15f4f-3fc0-497b-83aa-112e862e5034 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:16.131347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d15f4f-3fc0-497b-83aa-112e862e5034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-a5d15f4f-3fc0-497b-83aa-112e862e5034 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:26:16.136014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:16.136948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:16.138289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:16.138289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:16.138289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:16.138289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:16.138289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:26:16.138289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:26:16.138289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:26:16.138289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:26:16.138289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:26:16.138289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:26:16.138289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:26:16.138289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:16.141509 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 533/1054] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:26:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:16.143225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f301f7-e48d-42bd-9735-adaf6dce4292 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:16.167714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:16.244407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f301f7-e48d-42bd-9735-adaf6dce4292 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:16.279694 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72f557-93da-4e41-ac60-c800500e20cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:16.280313 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72f557-93da-4e41-ac60-c800500e20cf None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:16.280607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72f557-93da-4e41-ac60-c800500e20cf None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:16.280862 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72f557-93da-4e41-ac60-c800500e20cf None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:16.281569 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72f557-93da-4e41-ac60-c800500e20cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:16.281877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72f557-93da-4e41-ac60-c800500e20cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:16.284084 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72f557-93da-4e41-ac60-c800500e20cf None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:16.293959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 522/1055] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:26:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:16.300152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d15f4f-3fc0-497b-83aa-112e862e5034 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:16.401123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d15f4f-3fc0-497b-83aa-112e862e5034 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:16.435781 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c38d9b-f8a1-41c2-904b-c0f913f68b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:16.436647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c38d9b-f8a1-41c2-904b-c0f913f68b1a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:16.437066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c38d9b-f8a1-41c2-904b-c0f913f68b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:16.437512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c38d9b-f8a1-41c2-904b-c0f913f68b1a None admin] PATH_INFO: `/v3/users/9e38a33da2e74538a2c2daee4562b8ac` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:16.447343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:16.453992 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c38d9b-f8a1-41c2-904b-c0f913f68b1a None admin] RBAC: Authorizing `identity:get_user(user_id=9e38a33da2e74538a2c2daee4562b8ac)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:16.455572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c38d9b-f8a1-41c2-904b-c0f913f68b1a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:16.461517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 534/1056] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:26:16 2022] GET /identity/v3/users/9e38a33da2e74538a2c2daee4562b8ac => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:16.463142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72f557-93da-4e41-ac60-c800500e20cf None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:16.549823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:16.566597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72f557-93da-4e41-ac60-c800500e20cf None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:16.599803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e5d3d-8208-467c-bb9b-8bf94a940405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:16.600405 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e5d3d-8208-467c-bb9b-8bf94a940405 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:16.600677 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e5d3d-8208-467c-bb9b-8bf94a940405 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:16.600948 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e5d3d-8208-467c-bb9b-8bf94a940405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:16.667084 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e5d3d-8208-467c-bb9b-8bf94a940405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:16.668507 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e5d3d-8208-467c-bb9b-8bf94a940405 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:16.750426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:16.768608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 523/1057] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:26:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:26:16.774641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c38d9b-f8a1-41c2-904b-c0f913f68b1a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:16.884851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c38d9b-f8a1-41c2-904b-c0f913f68b1a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:16.919116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50877d93-08d8-46a1-a71a-248e66500cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:16.919737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50877d93-08d8-46a1-a71a-248e66500cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:16.920010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50877d93-08d8-46a1-a71a-248e66500cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:16.920278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50877d93-08d8-46a1-a71a-248e66500cf8 None admin] PATH_INFO: `/v3/projects/311828d232794368b5da1e09ee7bc8b3` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:16.921416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50877d93-08d8-46a1-a71a-248e66500cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=311828d232794368b5da1e09ee7bc8b3)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:16.922915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50877d93-08d8-46a1-a71a-248e66500cf8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:16.925390 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 535/1058] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:26:16 2022] GET /identity/v3/projects/311828d232794368b5da1e09ee7bc8b3 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:16.931203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e5d3d-8208-467c-bb9b-8bf94a940405 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:17.029730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e5d3d-8208-467c-bb9b-8bf94a940405 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:17.068614 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070a7e6-4452-43e4-9c5b-c473bf6c300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:17.069255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070a7e6-4452-43e4-9c5b-c473bf6c300c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:17.069542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070a7e6-4452-43e4-9c5b-c473bf6c300c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:17.069810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070a7e6-4452-43e4-9c5b-c473bf6c300c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:17.070528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070a7e6-4452-43e4-9c5b-c473bf6c300c None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=311828d232794368b5da1e09ee7bc8b3, user.id=9e38a33da2e74538a2c2daee4562b8ac) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:17.076196 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070a7e6-4452-43e4-9c5b-c473bf6c300c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:17.076196 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070a7e6-4452-43e4-9c5b-c473bf6c300c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:17.085890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 524/1059] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:26:16 2022] GET /identity/v3/role_assignments?user.id=9e38a33da2e74538a2c2daee4562b8ac&scope.project.id=311828d232794368b5da1e09ee7bc8b3&role.id=1896db68dc754d5293037ab100ce46d9 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:17.166927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188144f-1eea-4f03-aa8c-7cda38c3f149 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:17.167433 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188144f-1eea-4f03-aa8c-7cda38c3f149 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:17.167433 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188144f-1eea-4f03-aa8c-7cda38c3f149 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:17.168738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 536/1060] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:26:17.175016 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee7884-be13-48df-977f-3c5441aa1b67 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:17.175527 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee7884-be13-48df-977f-3c5441aa1b67 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:17.175527 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee7884-be13-48df-977f-3c5441aa1b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:17.195222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0aee7884-be13-48df-977f-3c5441aa1b67 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:17.196432 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0aee7884-be13-48df-977f-3c5441aa1b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:17.244162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:17.268267 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 525/1061] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:17.368730 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5f43-aa82-4cfa-9f2b-ce1502728486 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:17.369052 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5f43-aa82-4cfa-9f2b-ce1502728486 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:17.369315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5f43-aa82-4cfa-9f2b-ce1502728486 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:17.370787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 537/1062] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:17.375655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f531f99-59e1-42b8-b186-fb84eda2cfdb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:17.375946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f531f99-59e1-42b8-b186-fb84eda2cfdb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:17.376221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f531f99-59e1-42b8-b186-fb84eda2cfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:17.395138 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5f531f99-59e1-42b8-b186-fb84eda2cfdb None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:17.396324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5f531f99-59e1-42b8-b186-fb84eda2cfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:17.473325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 526/1063] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:17.542406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f5f43-aa82-4cfa-9f2b-ce1502728486 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:17.606654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:17.645079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f5f43-aa82-4cfa-9f2b-ce1502728486 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:17.678639 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348a526-0587-40b9-a42a-875563b49402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:17.679232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348a526-0587-40b9-a42a-875563b49402 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:17.679506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348a526-0587-40b9-a42a-875563b49402 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:17.679773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348a526-0587-40b9-a42a-875563b49402 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:17.749324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f531f99-59e1-42b8-b186-fb84eda2cfdb None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:17.749502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348a526-0587-40b9-a42a-875563b49402 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:17.749502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348a526-0587-40b9-a42a-875563b49402 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:17.815175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:17.855902 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f531f99-59e1-42b8-b186-fb84eda2cfdb None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:17.856090 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 538/1064] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:26:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:26:17.862287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348a526-0587-40b9-a42a-875563b49402 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:17.867826 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:17.892826 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3572a-3834-4b6d-90dc-caa30fb6dee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:17.893497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3572a-3834-4b6d-90dc-caa30fb6dee8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:17.893777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3572a-3834-4b6d-90dc-caa30fb6dee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:17.894052 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3572a-3834-4b6d-90dc-caa30fb6dee8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:17.904908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3572a-3834-4b6d-90dc-caa30fb6dee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-45e3572a-3834-4b6d-90dc-caa30fb6dee8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:26:17.910214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:17.911145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:17.912034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:17.912034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:17.912034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:17.912034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:17.912034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:26:17.912034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:26:17.912034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:26:17.912034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:26:17.912034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:26:17.912034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:26:17.912034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 04:26:17.912034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:17.912034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 527/1065] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 31 04:26:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:17.917729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3572a-3834-4b6d-90dc-caa30fb6dee8 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:17.975332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348a526-0587-40b9-a42a-875563b49402 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:18.013445 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8737f0-760a-4681-8a45-a37e59a7a755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:18.013986 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8737f0-760a-4681-8a45-a37e59a7a755 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:18.014256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8737f0-760a-4681-8a45-a37e59a7a755 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:18.014521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8737f0-760a-4681-8a45-a37e59a7a755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:18.026269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8737f0-760a-4681-8a45-a37e59a7a755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:18.027704 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8737f0-760a-4681-8a45-a37e59a7a755 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:18.027921 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3572a-3834-4b6d-90dc-caa30fb6dee8 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-de8737f0-760a-4681-8a45-a37e59a7a755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:26:18.045690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:18.046702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:26:18.047604 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:26:18.047604 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:18.047604 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:18.052429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 539/1066] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:18.053356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8737f0-760a-4681-8a45-a37e59a7a755 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:18.067189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf340490-4e3e-4c3f-8e75-4e5c184707a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:18.067794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf340490-4e3e-4c3f-8e75-4e5c184707a4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:18.068067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf340490-4e3e-4c3f-8e75-4e5c184707a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:18.068334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf340490-4e3e-4c3f-8e75-4e5c184707a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:18.068986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf340490-4e3e-4c3f-8e75-4e5c184707a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:18.069341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf340490-4e3e-4c3f-8e75-4e5c184707a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:18.070692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf340490-4e3e-4c3f-8e75-4e5c184707a4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:18.076027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:18.088775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 528/1067] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 31 04:26:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:18.090228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf340490-4e3e-4c3f-8e75-4e5c184707a4 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:18.123895 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:18.163805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8737f0-760a-4681-8a45-a37e59a7a755 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:18.199025 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf340490-4e3e-4c3f-8e75-4e5c184707a4 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:18.201997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3204df-1c6c-4ee2-8c6a-1b2875c8bd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:18.202674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3204df-1c6c-4ee2-8c6a-1b2875c8bd51 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:18.202943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3204df-1c6c-4ee2-8c6a-1b2875c8bd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:18.203208 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3204df-1c6c-4ee2-8c6a-1b2875c8bd51 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:18.203845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3204df-1c6c-4ee2-8c6a-1b2875c8bd51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:18.204139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3204df-1c6c-4ee2-8c6a-1b2875c8bd51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:18.205880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3204df-1c6c-4ee2-8c6a-1b2875c8bd51 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:18.218224 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 540/1068] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:18.234897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7059e-a51e-491d-ad9f-a59e440d6631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:18.235552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7059e-a51e-491d-ad9f-a59e440d6631 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:18.236101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7059e-a51e-491d-ad9f-a59e440d6631 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:18.236485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7059e-a51e-491d-ad9f-a59e440d6631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:18.248158 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7059e-a51e-491d-ad9f-a59e440d6631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:18.249851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7059e-a51e-491d-ad9f-a59e440d6631 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-dbd7059e-a51e-491d-ad9f-a59e440d6631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:26:18.266445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:18.268122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:26:18.269086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:26:18.269086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:18.269086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:18.273446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 529/1069] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:18.274711 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3204df-1c6c-4ee2-8c6a-1b2875c8bd51 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:18.357595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:18.381218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3204df-1c6c-4ee2-8c6a-1b2875c8bd51 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:18.420381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3dec0-121b-40e8-bdb6-c3a82d1a57d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:18.421019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3dec0-121b-40e8-bdb6-c3a82d1a57d8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:18.421286 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3dec0-121b-40e8-bdb6-c3a82d1a57d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:18.421565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3dec0-121b-40e8-bdb6-c3a82d1a57d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:18.422207 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3dec0-121b-40e8-bdb6-c3a82d1a57d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:18.422509 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3dec0-121b-40e8-bdb6-c3a82d1a57d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:18.424539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3dec0-121b-40e8-bdb6-c3a82d1a57d8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:18.436471 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 541/1070] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:18.442597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7059e-a51e-491d-ad9f-a59e440d6631 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:18.526386 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:18.543998 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7059e-a51e-491d-ad9f-a59e440d6631 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:18.577639 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d55c4b-cda1-4bb1-9213-8b87c5bc5bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:18.578261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55c4b-cda1-4bb1-9213-8b87c5bc5bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:18.578535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55c4b-cda1-4bb1-9213-8b87c5bc5bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:18.578802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55c4b-cda1-4bb1-9213-8b87c5bc5bf2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:18.586248 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d55c4b-cda1-4bb1-9213-8b87c5bc5bf2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:18.587670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d55c4b-cda1-4bb1-9213-8b87c5bc5bf2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-e9d55c4b-cda1-4bb1-9213-8b87c5bc5bf2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:26:18.599495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:18.600626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:18.601769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:18.601769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:18.601769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:26:18.601769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:26:18.601769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:26:18.601769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:26:18.601769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:26:18.601769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:26:18.601769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:26:18.601769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:18.602541 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 530/1071] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 31 04:26:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:18.606564 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3dec0-121b-40e8-bdb6-c3a82d1a57d8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:18.705682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3dec0-121b-40e8-bdb6-c3a82d1a57d8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:18.747249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1320a00-0c46-4de6-8d2a-7ce8c78c2c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:18.747853 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1320a00-0c46-4de6-8d2a-7ce8c78c2c30 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:18.748128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1320a00-0c46-4de6-8d2a-7ce8c78c2c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:18.748394 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1320a00-0c46-4de6-8d2a-7ce8c78c2c30 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:18.749126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1320a00-0c46-4de6-8d2a-7ce8c78c2c30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:18.749472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1320a00-0c46-4de6-8d2a-7ce8c78c2c30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:18.750897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1320a00-0c46-4de6-8d2a-7ce8c78c2c30 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:18.753702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:18.769982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 542/1072] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 31 04:26:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:18.775834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d55c4b-cda1-4bb1-9213-8b87c5bc5bf2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:18.878692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d55c4b-cda1-4bb1-9213-8b87c5bc5bf2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:18.913508 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25706a64-2fe5-49e5-983a-12f2c2d58c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:18.914132 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25706a64-2fe5-49e5-983a-12f2c2d58c8d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:18.914406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25706a64-2fe5-49e5-983a-12f2c2d58c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:18.914674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25706a64-2fe5-49e5-983a-12f2c2d58c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:18.925030 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25706a64-2fe5-49e5-983a-12f2c2d58c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:18.926482 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25706a64-2fe5-49e5-983a-12f2c2d58c8d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:18.928147 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-25706a64-2fe5-49e5-983a-12f2c2d58c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:26:18.941885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:18.943045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:26:18.943983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:26:18.943983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:18.943983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:18.943983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 531/1073] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:18.949013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1320a00-0c46-4de6-8d2a-7ce8c78c2c30 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:18.998361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87150-0430-466f-b05a-43a5ac4ae215 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:18.998666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87150-0430-466f-b05a-43a5ac4ae215 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:18.998913 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87150-0430-466f-b05a-43a5ac4ae215 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:19.000361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 532/1074] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:19.008430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e9eba-b3a1-4300-ad03-2ab81afe4bac None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:19.008709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e9eba-b3a1-4300-ad03-2ab81afe4bac None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:19.008978 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e9eba-b3a1-4300-ad03-2ab81afe4bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:19.027526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-313e9eba-b3a1-4300-ad03-2ab81afe4bac None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:19.028918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-313e9eba-b3a1-4300-ad03-2ab81afe4bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:19.051685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1320a00-0c46-4de6-8d2a-7ce8c78c2c30 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:19.087096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567a061-63d5-4e76-b7db-80d9a046eacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:19.087692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a061-63d5-4e76-b7db-80d9a046eacc None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:19.087966 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a061-63d5-4e76-b7db-80d9a046eacc None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:19.088231 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a061-63d5-4e76-b7db-80d9a046eacc None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:19.088863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567a061-63d5-4e76-b7db-80d9a046eacc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:19.089158 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567a061-63d5-4e76-b7db-80d9a046eacc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:19.090542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567a061-63d5-4e76-b7db-80d9a046eacc None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:19.099851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 533/1075] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:26:19.102515 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 543/1076] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:19.108009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e9eba-b3a1-4300-ad03-2ab81afe4bac None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:19.209507 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e9eba-b3a1-4300-ad03-2ab81afe4bac None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:19.233216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:19.243912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db7ca-91d3-4f96-a804-830307763d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:19.244534 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db7ca-91d3-4f96-a804-830307763d81 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:19.244809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db7ca-91d3-4f96-a804-830307763d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:19.254130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db7ca-91d3-4f96-a804-830307763d81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:19.254130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34db7ca-91d3-4f96-a804-830307763d81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:19.254130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34db7ca-91d3-4f96-a804-830307763d81 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c34db7ca-91d3-4f96-a804-830307763d81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:26:19.264893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:19.265812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:19.266816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:26:19.266816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:26:19.266816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:26:19.266816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:26:19.266816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:26:19.266816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:26:19.266816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:26:19.266816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:19.266816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 534/1077] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:26:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:19.272446 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567a061-63d5-4e76-b7db-80d9a046eacc None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:19.327059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:19.364891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db7ca-91d3-4f96-a804-830307763d81 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:19.373289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567a061-63d5-4e76-b7db-80d9a046eacc None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:19.408462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e9d7a-70ee-4d6c-883a-284c53f603f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:19.409060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e9d7a-70ee-4d6c-883a-284c53f603f1 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:19.409371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e9d7a-70ee-4d6c-883a-284c53f603f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:19.409643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e9d7a-70ee-4d6c-883a-284c53f603f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:19.410334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e9d7a-70ee-4d6c-883a-284c53f603f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:19.410641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e9d7a-70ee-4d6c-883a-284c53f603f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:19.412071 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e9d7a-70ee-4d6c-883a-284c53f603f1 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:19.424222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 544/1078] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:26:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:19.430176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e9d7a-70ee-4d6c-883a-284c53f603f1 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:19.464789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db7ca-91d3-4f96-a804-830307763d81 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:19.498020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89fb2a-cde0-449b-98e5-204f6ae075ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:19.498643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89fb2a-cde0-449b-98e5-204f6ae075ab None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:19.498916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89fb2a-cde0-449b-98e5-204f6ae075ab None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:19.499188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89fb2a-cde0-449b-98e5-204f6ae075ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:19.511012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89fb2a-cde0-449b-98e5-204f6ae075ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-fa89fb2a-cde0-449b-98e5-204f6ae075ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:26:19.515742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:19.516774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:19.518344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:19.518344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:19.518344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:19.518344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:19.518344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:26:19.518344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:26:19.518344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:26:19.518344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:26:19.518344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:26:19.518344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:26:19.518344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:26:19.518344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:19.518344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 535/1079] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:26:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:19.523441 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89fb2a-cde0-449b-98e5-204f6ae075ab None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:19.532290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e9d7a-70ee-4d6c-883a-284c53f603f1 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:19.546817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:19.566217 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be861b-f433-44aa-8e80-caf93a9e3c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:19.566862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be861b-f433-44aa-8e80-caf93a9e3c78 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:19.567134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be861b-f433-44aa-8e80-caf93a9e3c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:19.567402 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be861b-f433-44aa-8e80-caf93a9e3c78 None admin] PATH_INFO: `/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/4877b72a6cea410dbb31a35c7acbd5f9/roles/018c712ded3f43a6af39ad9ea1bcf78e` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:19.567689 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:19.569523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be861b-f433-44aa-8e80-caf93a9e3c78 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff768fb064ce4d53b2e46ea611d3d103, user_id=4877b72a6cea410dbb31a35c7acbd5f9, role_id=018c712ded3f43a6af39ad9ea1bcf78e)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:19.571173 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be861b-f433-44aa-8e80-caf93a9e3c78 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:19.619959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89fb2a-cde0-449b-98e5-204f6ae075ab None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:19.640141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 545/1080] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:26:19 2022] PUT /identity/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/4877b72a6cea410dbb31a35c7acbd5f9/roles/018c712ded3f43a6af39ad9ea1bcf78e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:26:19.654530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f8eaa-1dfb-4b03-b238-e67e7c4301f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:19.655161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f8eaa-1dfb-4b03-b238-e67e7c4301f5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:19.655437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f8eaa-1dfb-4b03-b238-e67e7c4301f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:19.655705 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f8eaa-1dfb-4b03-b238-e67e7c4301f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:19.656381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f8eaa-1dfb-4b03-b238-e67e7c4301f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:19.656683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f8eaa-1dfb-4b03-b238-e67e7c4301f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:19.658898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f8eaa-1dfb-4b03-b238-e67e7c4301f5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:19.668359 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 536/1081] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:26:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:19.674618 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be861b-f433-44aa-8e80-caf93a9e3c78 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:19.784616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be861b-f433-44aa-8e80-caf93a9e3c78 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:19.817641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b1e0f-48ff-46c8-ba21-c131919f4ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:19.818649 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b1e0f-48ff-46c8-ba21-c131919f4ede None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:19.818649 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b1e0f-48ff-46c8-ba21-c131919f4ede None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:19.818849 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b1e0f-48ff-46c8-ba21-c131919f4ede None admin] PATH_INFO: `/v3/users/9e38a33da2e74538a2c2daee4562b8ac` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:19.819953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b1e0f-48ff-46c8-ba21-c131919f4ede None admin] RBAC: Authorizing `identity:get_user(user_id=9e38a33da2e74538a2c2daee4562b8ac)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:19.821413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b1e0f-48ff-46c8-ba21-c131919f4ede None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:19.822983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 546/1082] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:26:19 2022] GET /identity/v3/users/9e38a33da2e74538a2c2daee4562b8ac => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:19.828868 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f8eaa-1dfb-4b03-b238-e67e7c4301f5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:19.959573 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f8eaa-1dfb-4b03-b238-e67e7c4301f5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:19.966529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:19.993137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296233ec-9d09-4316-9e7c-6fc488d29bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:19.993783 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296233ec-9d09-4316-9e7c-6fc488d29bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:19.994060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296233ec-9d09-4316-9e7c-6fc488d29bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:19.994357 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296233ec-9d09-4316-9e7c-6fc488d29bd4 None admin] PATH_INFO: `/v3/projects/311828d232794368b5da1e09ee7bc8b3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:19.995463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296233ec-9d09-4316-9e7c-6fc488d29bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=311828d232794368b5da1e09ee7bc8b3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:19.996879 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296233ec-9d09-4316-9e7c-6fc488d29bd4 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:19.998615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 537/1083] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:26:19 2022] GET /identity/v3/projects/311828d232794368b5da1e09ee7bc8b3 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:20.005178 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b1e0f-48ff-46c8-ba21-c131919f4ede None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:20.058883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:20.115599 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b1e0f-48ff-46c8-ba21-c131919f4ede None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:20.150403 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aabb21-7de9-4c7f-ac47-77420ee5945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:20.151053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aabb21-7de9-4c7f-ac47-77420ee5945b None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:20.151329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aabb21-7de9-4c7f-ac47-77420ee5945b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:20.151600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aabb21-7de9-4c7f-ac47-77420ee5945b None admin] PATH_INFO: `/v3/projects/311828d232794368b5da1e09ee7bc8b3/users/9e38a33da2e74538a2c2daee4562b8ac/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:20.153498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aabb21-7de9-4c7f-ac47-77420ee5945b None admin] RBAC: Authorizing `identity:create_grant(project_id=311828d232794368b5da1e09ee7bc8b3, user_id=9e38a33da2e74538a2c2daee4562b8ac, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:20.154926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aabb21-7de9-4c7f-ac47-77420ee5945b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:20.234131 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 547/1084] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:26:20 2022] PUT /identity/v3/projects/311828d232794368b5da1e09ee7bc8b3/users/9e38a33da2e74538a2c2daee4562b8ac/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:26:21.544210 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1414d74-5b87-4d31-ba99-31e276dd7bb2 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:21.544738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1414d74-5b87-4d31-ba99-31e276dd7bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:21.544738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1414d74-5b87-4d31-ba99-31e276dd7bb2 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:21.546111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 538/1085] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:21.551693 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042f243-e01a-4934-9f4c-15bb5c46d641 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:21.552109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042f243-e01a-4934-9f4c-15bb5c46d641 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:21.552238 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042f243-e01a-4934-9f4c-15bb5c46d641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:21.570152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d042f243-e01a-4934-9f4c-15bb5c46d641 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:21.571309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d042f243-e01a-4934-9f4c-15bb5c46d641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:21.636454 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 548/1086] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:21.902639 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1414d74-5b87-4d31-ba99-31e276dd7bb2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:22.001870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1414d74-5b87-4d31-ba99-31e276dd7bb2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:22.035317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fdbdf-ebcc-4599-9c9a-b09563c158a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:22.035933 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fdbdf-ebcc-4599-9c9a-b09563c158a1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:22.036213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fdbdf-ebcc-4599-9c9a-b09563c158a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:22.036486 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fdbdf-ebcc-4599-9c9a-b09563c158a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:22.046657 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fdbdf-ebcc-4599-9c9a-b09563c158a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c63fdbdf-ebcc-4599-9c9a-b09563c158a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:26:22.051715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:22.052712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:22.053987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:22.053987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:22.053987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:22.053987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:22.053987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:26:22.053987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:26:22.053987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:26:22.053987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:26:22.053987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:26:22.053987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:26:22.053987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 04:26:22.053987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:22.057488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 539/1087] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 31 04:26:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:22.058893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042f243-e01a-4934-9f4c-15bb5c46d641 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:22.090018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:22.155069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25f5f-2ab6-4891-beda-d0adaffbf36e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:22.155273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25f5f-2ab6-4891-beda-d0adaffbf36e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:22.155555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25f5f-2ab6-4891-beda-d0adaffbf36e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:22.156960 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 540/1088] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:26:22.162603 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344e076-0aad-42cb-9a23-e37110738f3e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:22.162752 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042f243-e01a-4934-9f4c-15bb5c46d641 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:22.162888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344e076-0aad-42cb-9a23-e37110738f3e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:22.163162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344e076-0aad-42cb-9a23-e37110738f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:22.181451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a344e076-0aad-42cb-9a23-e37110738f3e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:22.182656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a344e076-0aad-42cb-9a23-e37110738f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:22.197269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba66c6-d740-4ce2-bae6-bc4ee40878d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:22.197870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba66c6-d740-4ce2-bae6-bc4ee40878d2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:22.198144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba66c6-d740-4ce2-bae6-bc4ee40878d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:22.198412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba66c6-d740-4ce2-bae6-bc4ee40878d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:22.199071 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba66c6-d740-4ce2-bae6-bc4ee40878d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:22.199368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba66c6-d740-4ce2-bae6-bc4ee40878d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:22.200713 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba66c6-d740-4ce2-bae6-bc4ee40878d2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:22.208816 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 549/1089] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 31 04:26:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:22.209069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:22.214491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba66c6-d740-4ce2-bae6-bc4ee40878d2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:22.262706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 541/1090] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:26:22.340671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:22.349059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba66c6-d740-4ce2-bae6-bc4ee40878d2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:22.389104 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ac99d-bd60-486e-b6ac-cbbd359c8f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:22.390637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ac99d-bd60-486e-b6ac-cbbd359c8f23 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:22.390637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ac99d-bd60-486e-b6ac-cbbd359c8f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:22.390637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ac99d-bd60-486e-b6ac-cbbd359c8f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:22.404566 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ac99d-bd60-486e-b6ac-cbbd359c8f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:22.406593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ac99d-bd60-486e-b6ac-cbbd359c8f23 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-046ac99d-bd60-486e-b6ac-cbbd359c8f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:26:22.422162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:22.423183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:26:22.424279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:26:22.424279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:22.424279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:22.424279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 550/1091] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:22.430822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344e076-0aad-42cb-9a23-e37110738f3e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:22.546227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344e076-0aad-42cb-9a23-e37110738f3e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:22.586012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61dd24-f19c-4687-b838-95075f98de00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:22.587079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61dd24-f19c-4687-b838-95075f98de00 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:22.587575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61dd24-f19c-4687-b838-95075f98de00 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:22.588037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61dd24-f19c-4687-b838-95075f98de00 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:22.588864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61dd24-f19c-4687-b838-95075f98de00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:22.589171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61dd24-f19c-4687-b838-95075f98de00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:22.590600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61dd24-f19c-4687-b838-95075f98de00 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:22.590712 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ac99d-bd60-486e-b6ac-cbbd359c8f23 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:22.604186 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 542/1092] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:22.610180 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61dd24-f19c-4687-b838-95075f98de00 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:22.643983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:22.711915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ac99d-bd60-486e-b6ac-cbbd359c8f23 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:22.736884 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61dd24-f19c-4687-b838-95075f98de00 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:22.755245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd724c-c0be-4be7-b623-fc50cfd2237b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:22.755873 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd724c-c0be-4be7-b623-fc50cfd2237b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:22.756152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd724c-c0be-4be7-b623-fc50cfd2237b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:22.756435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd724c-c0be-4be7-b623-fc50cfd2237b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:22.768221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd724c-c0be-4be7-b623-fc50cfd2237b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-79cd724c-c0be-4be7-b623-fc50cfd2237b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:26:22.773304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:22.774266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:22.775125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:22.775125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:22.775125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:22.775125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:22.775125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:26:22.775125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:26:22.775125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:26:22.775125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:26:22.775125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:26:22.775125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:26:22.775125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:26:22.775125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:22.775785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77ca83-4bcb-4314-a11a-57a4a0417f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:22.775785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77ca83-4bcb-4314-a11a-57a4a0417f09 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:22.775785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77ca83-4bcb-4314-a11a-57a4a0417f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:22.775785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77ca83-4bcb-4314-a11a-57a4a0417f09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:22.776847 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 551/1093] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:26:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:22.783739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd724c-c0be-4be7-b623-fc50cfd2237b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:22.784134 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77ca83-4bcb-4314-a11a-57a4a0417f09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:22.785989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77ca83-4bcb-4314-a11a-57a4a0417f09 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:22.793077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-cc77ca83-4bcb-4314-a11a-57a4a0417f09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:26:22.802939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:22.804808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:22.805853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:22.805853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:22.805853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:26:22.805853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:26:22.805853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:26:22.805853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:26:22.805853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:26:22.805853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:26:22.805853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 04:26:22.805853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:22.805853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 543/1094] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 31 04:26:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:22.810664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77ca83-4bcb-4314-a11a-57a4a0417f09 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:22.912398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:22.914597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd724c-c0be-4be7-b623-fc50cfd2237b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:22.929481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77ca83-4bcb-4314-a11a-57a4a0417f09 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:22.951397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a42de-6a7f-4ced-b0d2-afd3764a2374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:22.952226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a42de-6a7f-4ced-b0d2-afd3764a2374 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:22.952226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a42de-6a7f-4ced-b0d2-afd3764a2374 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:22.952226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a42de-6a7f-4ced-b0d2-afd3764a2374 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:22.953713 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a42de-6a7f-4ced-b0d2-afd3764a2374 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:22.953884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a42de-6a7f-4ced-b0d2-afd3764a2374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:22.955517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a42de-6a7f-4ced-b0d2-afd3764a2374 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:22.965435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 552/1095] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:26:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:22.968079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879506a2-0bc7-41c7-886c-f4c66c7ca002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:22.968691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879506a2-0bc7-41c7-886c-f4c66c7ca002 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:22.968966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879506a2-0bc7-41c7-886c-f4c66c7ca002 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:22.969262 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879506a2-0bc7-41c7-886c-f4c66c7ca002 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:22.970775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879506a2-0bc7-41c7-886c-f4c66c7ca002 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:22.971100 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879506a2-0bc7-41c7-886c-f4c66c7ca002 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:22.971691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a42de-6a7f-4ced-b0d2-afd3764a2374 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:22.972525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879506a2-0bc7-41c7-886c-f4c66c7ca002 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:22.992353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 544/1096] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 31 04:26:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:22.998026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879506a2-0bc7-41c7-886c-f4c66c7ca002 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:23.054518 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:23.092822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a42de-6a7f-4ced-b0d2-afd3764a2374 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:23.127794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5afa19-4997-4644-b1e6-25cea02c2398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:23.128424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5afa19-4997-4644-b1e6-25cea02c2398 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:23.128704 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5afa19-4997-4644-b1e6-25cea02c2398 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:23.128979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5afa19-4997-4644-b1e6-25cea02c2398 None admin] PATH_INFO: `/v3/users/9e38a33da2e74538a2c2daee4562b8ac` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:23.129654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879506a2-0bc7-41c7-886c-f4c66c7ca002 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:23.130145 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5afa19-4997-4644-b1e6-25cea02c2398 None admin] RBAC: Authorizing `identity:get_user(user_id=9e38a33da2e74538a2c2daee4562b8ac)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:23.131585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5afa19-4997-4644-b1e6-25cea02c2398 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:23.133164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 553/1097] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:26:22 2022] GET /identity/v3/users/9e38a33da2e74538a2c2daee4562b8ac => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:23.138899 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5afa19-4997-4644-b1e6-25cea02c2398 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:23.168564 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8beb7-19c8-49dd-b612-1db06a45b309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:23.169174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8beb7-19c8-49dd-b612-1db06a45b309 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:23.169483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8beb7-19c8-49dd-b612-1db06a45b309 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:23.169757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8beb7-19c8-49dd-b612-1db06a45b309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:23.181578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:23.237729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5afa19-4997-4644-b1e6-25cea02c2398 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:23.239271 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8beb7-19c8-49dd-b612-1db06a45b309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:23.240727 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8beb7-19c8-49dd-b612-1db06a45b309 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:23.270849 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8ddf1-7632-4cb7-a91e-2f0b7d3e2db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:23.271441 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8ddf1-7632-4cb7-a91e-2f0b7d3e2db6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:23.271711 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8ddf1-7632-4cb7-a91e-2f0b7d3e2db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:23.271977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8ddf1-7632-4cb7-a91e-2f0b7d3e2db6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:23.276108 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:23.343165 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 545/1098] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:26:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:26:23.343388 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8ddf1-7632-4cb7-a91e-2f0b7d3e2db6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:23.343388 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8ddf1-7632-4cb7-a91e-2f0b7d3e2db6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:23.344263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8beb7-19c8-49dd-b612-1db06a45b309 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:23.386803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:23.440928 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 554/1099] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:26:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 04:26:23.446260 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8beb7-19c8-49dd-b612-1db06a45b309 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:23.446895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8ddf1-7632-4cb7-a91e-2f0b7d3e2db6 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:23.476032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0106966-7b12-4f6c-98d4-8561a7d90b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:23.476658 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0106966-7b12-4f6c-98d4-8561a7d90b7c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:23.476958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0106966-7b12-4f6c-98d4-8561a7d90b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:23.477251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0106966-7b12-4f6c-98d4-8561a7d90b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:23.479951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:23.494682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0106966-7b12-4f6c-98d4-8561a7d90b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:23.494682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0106966-7b12-4f6c-98d4-8561a7d90b7c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c0106966-7b12-4f6c-98d4-8561a7d90b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:26:23.504340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:23.505329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:26:23.506258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:26:23.506258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:26:23.506258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:23.506258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 546/1100] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:23.510997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0106966-7b12-4f6c-98d4-8561a7d90b7c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:23.545525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8ddf1-7632-4cb7-a91e-2f0b7d3e2db6 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:23.580132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fb31e-7d5e-4e23-adbc-4b471befb5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:23.580751 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fb31e-7d5e-4e23-adbc-4b471befb5ba None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:23.581028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fb31e-7d5e-4e23-adbc-4b471befb5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:23.581335 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fb31e-7d5e-4e23-adbc-4b471befb5ba None admin] PATH_INFO: `/v3/projects/311828d232794368b5da1e09ee7bc8b3` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:23.582450 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fb31e-7d5e-4e23-adbc-4b471befb5ba None admin] RBAC: Authorizing `identity:get_project(project_id=311828d232794368b5da1e09ee7bc8b3)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:23.583871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fb31e-7d5e-4e23-adbc-4b471befb5ba None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:23.585514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 555/1101] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:26:23 2022] GET /identity/v3/projects/311828d232794368b5da1e09ee7bc8b3 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:23.591415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fb31e-7d5e-4e23-adbc-4b471befb5ba None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:23.601334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:23.608055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0106966-7b12-4f6c-98d4-8561a7d90b7c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:23.641216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da29f4-5505-418e-b18e-84728757a9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:23.641844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da29f4-5505-418e-b18e-84728757a9db None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:23.642120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da29f4-5505-418e-b18e-84728757a9db None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:23.642390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da29f4-5505-418e-b18e-84728757a9db None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:23.643021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da29f4-5505-418e-b18e-84728757a9db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:23.643332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da29f4-5505-418e-b18e-84728757a9db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:23.644656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da29f4-5505-418e-b18e-84728757a9db None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:23.655980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 547/1102] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:23.662007 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da29f4-5505-418e-b18e-84728757a9db None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:23.694114 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fb31e-7d5e-4e23-adbc-4b471befb5ba None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:23.696383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:23.732117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204043e-39cf-44f3-bc9d-faeda94a7e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:23.732717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204043e-39cf-44f3-bc9d-faeda94a7e43 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:23.732996 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204043e-39cf-44f3-bc9d-faeda94a7e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:23.733297 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204043e-39cf-44f3-bc9d-faeda94a7e43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:23.734028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204043e-39cf-44f3-bc9d-faeda94a7e43 None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=311828d232794368b5da1e09ee7bc8b3, user.id=9e38a33da2e74538a2c2daee4562b8ac) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:23.734336 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204043e-39cf-44f3-bc9d-faeda94a7e43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:23.736387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204043e-39cf-44f3-bc9d-faeda94a7e43 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:23.745126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 556/1103] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:26:23 2022] GET /identity/v3/role_assignments?user.id=9e38a33da2e74538a2c2daee4562b8ac&scope.project.id=311828d232794368b5da1e09ee7bc8b3&role.id=1896db68dc754d5293037ab100ce46d9 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:23.780710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da29f4-5505-418e-b18e-84728757a9db None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:23.817342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4612c5-f680-4a86-b900-480c7f828c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:23.817983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4612c5-f680-4a86-b900-480c7f828c87 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:23.818253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4612c5-f680-4a86-b900-480c7f828c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:23.818519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4612c5-f680-4a86-b900-480c7f828c87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:23.825880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4612c5-f680-4a86-b900-480c7f828c87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:23.827355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4612c5-f680-4a86-b900-480c7f828c87 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-8c4612c5-f680-4a86-b900-480c7f828c87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:26:23.839853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:23.840989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:23.847530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:26:23.847530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:26:23.847530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:26:23.847530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:26:23.847530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:26:23.847530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:26:23.847530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:26:23.847530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:23.847530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 548/1104] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:26:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:26:23.848039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204043e-39cf-44f3-bc9d-faeda94a7e43 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:23.951800 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204043e-39cf-44f3-bc9d-faeda94a7e43 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:23.985052 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500455f0-a5cc-4fad-9a77-37569c181fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:23.986381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500455f0-a5cc-4fad-9a77-37569c181fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:23.986656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500455f0-a5cc-4fad-9a77-37569c181fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:23.986924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500455f0-a5cc-4fad-9a77-37569c181fa5 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:23.987608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500455f0-a5cc-4fad-9a77-37569c181fa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:23.987909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500455f0-a5cc-4fad-9a77-37569c181fa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:23.989355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500455f0-a5cc-4fad-9a77-37569c181fa5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:24.006126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 557/1105] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:26:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:24.007174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4612c5-f680-4a86-b900-480c7f828c87 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:24.023343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:24.113890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4612c5-f680-4a86-b900-480c7f828c87 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:24.152398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f171e-c9c9-41bf-97ef-1b082d053de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:24.152990 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f171e-c9c9-41bf-97ef-1b082d053de1 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:24.153298 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f171e-c9c9-41bf-97ef-1b082d053de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:24.153566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f171e-c9c9-41bf-97ef-1b082d053de1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:24.154275 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f171e-c9c9-41bf-97ef-1b082d053de1 None admin] RBAC: Adding query filter params (role.id=018c712ded3f43a6af39ad9ea1bcf78e, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=4877b72a6cea410dbb31a35c7acbd5f9) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:24.154575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f171e-c9c9-41bf-97ef-1b082d053de1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:24.155987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f171e-c9c9-41bf-97ef-1b082d053de1 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:24.162339 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 549/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:26:24 2022] GET /identity/v3/role_assignments?user.id=4877b72a6cea410dbb31a35c7acbd5f9&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=018c712ded3f43a6af39ad9ea1bcf78e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:26:25.727890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709d53-fee7-4fbe-97ae-18f2e970befe None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:25.728427 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709d53-fee7-4fbe-97ae-18f2e970befe None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:25.728427 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709d53-fee7-4fbe-97ae-18f2e970befe None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:25.729784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 558/1107] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:25.734931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c83d8-97df-42bb-a49b-33edf16746a3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:25.735339 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c83d8-97df-42bb-a49b-33edf16746a3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:25.735467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c83d8-97df-42bb-a49b-33edf16746a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:25.753712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-270c83d8-97df-42bb-a49b-33edf16746a3 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:25.754878 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-270c83d8-97df-42bb-a49b-33edf16746a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:25.819569 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 550/1108] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:26:26.086361 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709d53-fee7-4fbe-97ae-18f2e970befe None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:26.115011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:26.187643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709d53-fee7-4fbe-97ae-18f2e970befe None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:26.219613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be393aa9-8650-418a-95b0-6794b7a5a786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:26.220828 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be393aa9-8650-418a-95b0-6794b7a5a786 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:26.221281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be393aa9-8650-418a-95b0-6794b7a5a786 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:26.221549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be393aa9-8650-418a-95b0-6794b7a5a786 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:26.222680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be393aa9-8650-418a-95b0-6794b7a5a786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:26.224096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be393aa9-8650-418a-95b0-6794b7a5a786 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:26.225647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 559/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:26.231368 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c83d8-97df-42bb-a49b-33edf16746a3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:26.241573 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:26.327511 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c83d8-97df-42bb-a49b-33edf16746a3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:26.359985 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821f9a3-52f2-40a6-840a-d6049cfacfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:26.360793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821f9a3-52f2-40a6-840a-d6049cfacfbc None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:26.360909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821f9a3-52f2-40a6-840a-d6049cfacfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:26.361169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821f9a3-52f2-40a6-840a-d6049cfacfbc None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:26.361854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821f9a3-52f2-40a6-840a-d6049cfacfbc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:26.363243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821f9a3-52f2-40a6-840a-d6049cfacfbc None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:26.446738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 551/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:26:26 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:26:28.412017 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17721ef-73c8-4f7e-8df3-2f119b71a663 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:28.412526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17721ef-73c8-4f7e-8df3-2f119b71a663 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:28.412526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17721ef-73c8-4f7e-8df3-2f119b71a663 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:28.413825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 560/1111] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:28.418956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72915095-b22e-4be5-806d-baedbdfbe53b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:28.419326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72915095-b22e-4be5-806d-baedbdfbe53b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:28.419508 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72915095-b22e-4be5-806d-baedbdfbe53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:28.437720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-72915095-b22e-4be5-806d-baedbdfbe53b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:28.439602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-72915095-b22e-4be5-806d-baedbdfbe53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:28.496184 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:28.504842 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 552/1112] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:28.772779 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17721ef-73c8-4f7e-8df3-2f119b71a663 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:28.867698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:28.875882 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17721ef-73c8-4f7e-8df3-2f119b71a663 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:28.912187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc12f1-3544-4532-b886-db6fe02b656c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:28.912810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc12f1-3544-4532-b886-db6fe02b656c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:28.913087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc12f1-3544-4532-b886-db6fe02b656c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:28.913396 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc12f1-3544-4532-b886-db6fe02b656c None admin] PATH_INFO: `/v3/roles/0c9ebbeca1134eb4914025ef4cf80f5c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:28.914771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc12f1-3544-4532-b886-db6fe02b656c None admin] RBAC: Authorizing `identity:get_role(role_id=0c9ebbeca1134eb4914025ef4cf80f5c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:28.916172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc12f1-3544-4532-b886-db6fe02b656c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:28.917518 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 561/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:26:28 2022] GET /identity/v3/roles/0c9ebbeca1134eb4914025ef4cf80f5c => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:28.924180 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72915095-b22e-4be5-806d-baedbdfbe53b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:29.023903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72915095-b22e-4be5-806d-baedbdfbe53b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:29.057616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbac220-800c-48c4-b135-7e68e11ce2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:29.058247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac220-800c-48c4-b135-7e68e11ce2bb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:29.058523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac220-800c-48c4-b135-7e68e11ce2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:29.058795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac220-800c-48c4-b135-7e68e11ce2bb None admin] PATH_INFO: `/v3/users/a75675247f334d2c914e0e35a8417a52` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:29.072051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbac220-800c-48c4-b135-7e68e11ce2bb None admin] RBAC: Authorizing `identity:get_user(user_id=a75675247f334d2c914e0e35a8417a52)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:29.073585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbac220-800c-48c4-b135-7e68e11ce2bb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:29.075217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 553/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:26:28 2022] GET /identity/v3/users/a75675247f334d2c914e0e35a8417a52 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:29.081468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc12f1-3544-4532-b886-db6fe02b656c None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:29.180649 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc12f1-3544-4532-b886-db6fe02b656c None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:29.213374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e440aeb-b0ec-40c4-8cdd-90aeab318067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:29.213960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e440aeb-b0ec-40c4-8cdd-90aeab318067 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:29.214232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e440aeb-b0ec-40c4-8cdd-90aeab318067 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:29.214498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e440aeb-b0ec-40c4-8cdd-90aeab318067 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:29.243645 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:29.279632 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e440aeb-b0ec-40c4-8cdd-90aeab318067 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:29.280995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e440aeb-b0ec-40c4-8cdd-90aeab318067 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:29.374551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 562/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:26:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:26:29.380416 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbac220-800c-48c4-b135-7e68e11ce2bb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:29.431168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:29.477695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbac220-800c-48c4-b135-7e68e11ce2bb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:29.509455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa458e-bb34-49c0-b6bc-9953833ded0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:29.510065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa458e-bb34-49c0-b6bc-9953833ded0d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:29.510340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa458e-bb34-49c0-b6bc-9953833ded0d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:29.510608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa458e-bb34-49c0-b6bc-9953833ded0d None admin] PATH_INFO: `/v3/projects/311828d232794368b5da1e09ee7bc8b3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:29.511695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa458e-bb34-49c0-b6bc-9953833ded0d None admin] RBAC: Authorizing `identity:get_project(project_id=311828d232794368b5da1e09ee7bc8b3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:29.513104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa458e-bb34-49c0-b6bc-9953833ded0d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:29.514735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 554/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:26:29 2022] GET /identity/v3/projects/311828d232794368b5da1e09ee7bc8b3 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:29.521513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e440aeb-b0ec-40c4-8cdd-90aeab318067 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:29.581858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:29.616905 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e440aeb-b0ec-40c4-8cdd-90aeab318067 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:29.650002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d13de5-15be-44dd-ad33-b73499e33a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:29.650584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d13de5-15be-44dd-ad33-b73499e33a51 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:29.650857 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d13de5-15be-44dd-ad33-b73499e33a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:29.651126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d13de5-15be-44dd-ad33-b73499e33a51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:29.651834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d13de5-15be-44dd-ad33-b73499e33a51 None admin] RBAC: Adding query filter params (role.id=0c9ebbeca1134eb4914025ef4cf80f5c, scope.project.id=311828d232794368b5da1e09ee7bc8b3, user.id=a75675247f334d2c914e0e35a8417a52) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:29.652138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d13de5-15be-44dd-ad33-b73499e33a51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:29.653584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d13de5-15be-44dd-ad33-b73499e33a51 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:29.659399 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 563/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:26:29 2022] GET /identity/v3/role_assignments?user.id=a75675247f334d2c914e0e35a8417a52&scope.project.id=311828d232794368b5da1e09ee7bc8b3&role.id=0c9ebbeca1134eb4914025ef4cf80f5c => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:31.533080 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2e536-527a-4447-8aeb-700c4d746c7a None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:31.533648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2e536-527a-4447-8aeb-700c4d746c7a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:31.533648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2e536-527a-4447-8aeb-700c4d746c7a None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:31.534911 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 555/1118] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:31.539945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5b2c8-4254-444b-9407-16977f1a0d18 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:31.540326 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5b2c8-4254-444b-9407-16977f1a0d18 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:31.540489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5b2c8-4254-444b-9407-16977f1a0d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:31.558800 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-17e5b2c8-4254-444b-9407-16977f1a0d18 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:31.559966 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-17e5b2c8-4254-444b-9407-16977f1a0d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:31.624567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 564/1119] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:31.902546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2e536-527a-4447-8aeb-700c4d746c7a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:32.001813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2e536-527a-4447-8aeb-700c4d746c7a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:32.024441 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:32.040614 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbc481-fb4f-4a76-a74c-31f908f18b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:32.041263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc481-fb4f-4a76-a74c-31f908f18b3a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:32.041537 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc481-fb4f-4a76-a74c-31f908f18b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:32.041805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc481-fb4f-4a76-a74c-31f908f18b3a None admin] PATH_INFO: `/v3/roles/0c9ebbeca1134eb4914025ef4cf80f5c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:32.043207 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbc481-fb4f-4a76-a74c-31f908f18b3a None admin] RBAC: Authorizing `identity:get_role(role_id=0c9ebbeca1134eb4914025ef4cf80f5c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:32.044677 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbc481-fb4f-4a76-a74c-31f908f18b3a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:32.046125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 556/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:26:31 2022] GET /identity/v3/roles/0c9ebbeca1134eb4914025ef4cf80f5c => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:32.053013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5b2c8-4254-444b-9407-16977f1a0d18 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:32.120288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:32.162098 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5b2c8-4254-444b-9407-16977f1a0d18 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:32.195794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9faa8-1d3e-47a1-ae4b-034da2932cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:32.196409 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9faa8-1d3e-47a1-ae4b-034da2932cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:32.196681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9faa8-1d3e-47a1-ae4b-034da2932cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:32.196943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9faa8-1d3e-47a1-ae4b-034da2932cd8 None admin] PATH_INFO: `/v3/users/a75675247f334d2c914e0e35a8417a52` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:32.198052 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9faa8-1d3e-47a1-ae4b-034da2932cd8 None admin] RBAC: Authorizing `identity:get_user(user_id=a75675247f334d2c914e0e35a8417a52)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:32.199467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9faa8-1d3e-47a1-ae4b-034da2932cd8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:32.201009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 565/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:26:32 2022] GET /identity/v3/users/a75675247f334d2c914e0e35a8417a52 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:32.206895 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbc481-fb4f-4a76-a74c-31f908f18b3a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:32.301785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbc481-fb4f-4a76-a74c-31f908f18b3a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:32.333597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1029d95-8c28-4880-bfc1-26c51f259434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:32.334203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1029d95-8c28-4880-bfc1-26c51f259434 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:32.334514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1029d95-8c28-4880-bfc1-26c51f259434 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:32.334781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1029d95-8c28-4880-bfc1-26c51f259434 None admin] PATH_INFO: `/v3/projects/311828d232794368b5da1e09ee7bc8b3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:32.335869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1029d95-8c28-4880-bfc1-26c51f259434 None admin] RBAC: Authorizing `identity:get_project(project_id=311828d232794368b5da1e09ee7bc8b3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:32.337292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1029d95-8c28-4880-bfc1-26c51f259434 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:32.338876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 557/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:26:32 2022] GET /identity/v3/projects/311828d232794368b5da1e09ee7bc8b3 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:32.344682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9faa8-1d3e-47a1-ae4b-034da2932cd8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:32.443707 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9faa8-1d3e-47a1-ae4b-034da2932cd8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:32.470510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:32.479241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad7051-f3ad-4fde-ae7c-83bec53ddbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:32.479896 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad7051-f3ad-4fde-ae7c-83bec53ddbe3 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:32.480483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad7051-f3ad-4fde-ae7c-83bec53ddbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:32.480483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad7051-f3ad-4fde-ae7c-83bec53ddbe3 None admin] PATH_INFO: `/v3/projects/311828d232794368b5da1e09ee7bc8b3/users/a75675247f334d2c914e0e35a8417a52/roles/0c9ebbeca1134eb4914025ef4cf80f5c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:32.482579 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad7051-f3ad-4fde-ae7c-83bec53ddbe3 None admin] RBAC: Authorizing `identity:create_grant(project_id=311828d232794368b5da1e09ee7bc8b3, user_id=a75675247f334d2c914e0e35a8417a52, role_id=0c9ebbeca1134eb4914025ef4cf80f5c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:32.484004 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad7051-f3ad-4fde-ae7c-83bec53ddbe3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:32.556553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 566/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:26:32 2022] PUT /identity/v3/projects/311828d232794368b5da1e09ee7bc8b3/users/a75675247f334d2c914e0e35a8417a52/roles/0c9ebbeca1134eb4914025ef4cf80f5c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:26:34.414156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e07d6-9371-403f-9621-fabfc99d9c8f None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:34.414671 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e07d6-9371-403f-9621-fabfc99d9c8f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:34.414671 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e07d6-9371-403f-9621-fabfc99d9c8f None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:34.415992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 558/1124] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:34.421303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037742-fa73-4495-9f7d-34b52badb511 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:34.421691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037742-fa73-4495-9f7d-34b52badb511 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:34.421856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037742-fa73-4495-9f7d-34b52badb511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:34.440068 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3a037742-fa73-4495-9f7d-34b52badb511 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:34.441309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3a037742-fa73-4495-9f7d-34b52badb511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:34.505019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 567/1125] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:34.781906 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e07d6-9371-403f-9621-fabfc99d9c8f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:34.843730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:34.888162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e07d6-9371-403f-9621-fabfc99d9c8f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:34.924907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268efd40-567f-4bb6-9450-afca43056690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:34.925568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268efd40-567f-4bb6-9450-afca43056690 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:34.925846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268efd40-567f-4bb6-9450-afca43056690 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:34.926119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268efd40-567f-4bb6-9450-afca43056690 None admin] PATH_INFO: `/v3/roles/0c9ebbeca1134eb4914025ef4cf80f5c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:34.927515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268efd40-567f-4bb6-9450-afca43056690 None admin] RBAC: Authorizing `identity:get_role(role_id=0c9ebbeca1134eb4914025ef4cf80f5c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:34.928870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268efd40-567f-4bb6-9450-afca43056690 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:34.930225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 559/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:26:34 2022] GET /identity/v3/roles/0c9ebbeca1134eb4914025ef4cf80f5c => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:34.936043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037742-fa73-4495-9f7d-34b52badb511 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:35.034833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037742-fa73-4495-9f7d-34b52badb511 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:35.050964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:35.067828 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54575c-e615-4e62-9cae-66dac770cd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:35.068443 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54575c-e615-4e62-9cae-66dac770cd20 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:35.068717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54575c-e615-4e62-9cae-66dac770cd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:35.068984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54575c-e615-4e62-9cae-66dac770cd20 None admin] PATH_INFO: `/v3/users/a75675247f334d2c914e0e35a8417a52` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:35.070227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54575c-e615-4e62-9cae-66dac770cd20 None admin] RBAC: Authorizing `identity:get_user(user_id=a75675247f334d2c914e0e35a8417a52)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:35.071652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54575c-e615-4e62-9cae-66dac770cd20 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:35.073246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 568/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:26:34 2022] GET /identity/v3/users/a75675247f334d2c914e0e35a8417a52 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:35.078926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268efd40-567f-4bb6-9450-afca43056690 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:35.177579 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268efd40-567f-4bb6-9450-afca43056690 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:35.199677 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:35.210733 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b72e8-a46a-491c-bf11-c81cc4fa94ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:35.217570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b72e8-a46a-491c-bf11-c81cc4fa94ea None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:35.217570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b72e8-a46a-491c-bf11-c81cc4fa94ea None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:35.217570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b72e8-a46a-491c-bf11-c81cc4fa94ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:35.277608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b72e8-a46a-491c-bf11-c81cc4fa94ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:35.279051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b72e8-a46a-491c-bf11-c81cc4fa94ea None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:35.375388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 560/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:26:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:26:35.381929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54575c-e615-4e62-9cae-66dac770cd20 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:35.479188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54575c-e615-4e62-9cae-66dac770cd20 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:35.512019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6010143-786c-4804-899d-f4c123e3dad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:35.512625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6010143-786c-4804-899d-f4c123e3dad5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:35.512900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6010143-786c-4804-899d-f4c123e3dad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:35.513168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6010143-786c-4804-899d-f4c123e3dad5 None admin] PATH_INFO: `/v3/projects/311828d232794368b5da1e09ee7bc8b3` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:35.514294 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6010143-786c-4804-899d-f4c123e3dad5 None admin] RBAC: Authorizing `identity:get_project(project_id=311828d232794368b5da1e09ee7bc8b3)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:35.515709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6010143-786c-4804-899d-f4c123e3dad5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:35.517501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 569/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:26:35 2022] GET /identity/v3/projects/311828d232794368b5da1e09ee7bc8b3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:35.523817 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b72e8-a46a-491c-bf11-c81cc4fa94ea None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:35.549247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:35.622201 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b72e8-a46a-491c-bf11-c81cc4fa94ea None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:35.654776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cfeb2-8f84-43b1-9782-1b6ca2b67fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:35.655306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cfeb2-8f84-43b1-9782-1b6ca2b67fca None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:35.655576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cfeb2-8f84-43b1-9782-1b6ca2b67fca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:35.655840 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cfeb2-8f84-43b1-9782-1b6ca2b67fca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:35.656555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cfeb2-8f84-43b1-9782-1b6ca2b67fca None admin] RBAC: Adding query filter params (role.id=0c9ebbeca1134eb4914025ef4cf80f5c, scope.project.id=311828d232794368b5da1e09ee7bc8b3, user.id=a75675247f334d2c914e0e35a8417a52) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:35.656857 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cfeb2-8f84-43b1-9782-1b6ca2b67fca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:35.658812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cfeb2-8f84-43b1-9782-1b6ca2b67fca None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:35.664303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 561/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:26:35 2022] GET /identity/v3/role_assignments?user.id=a75675247f334d2c914e0e35a8417a52&scope.project.id=311828d232794368b5da1e09ee7bc8b3&role.id=0c9ebbeca1134eb4914025ef4cf80f5c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:37.589660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3774b-893d-40a3-b4bd-c65c7879a5fa None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:37.590182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3774b-893d-40a3-b4bd-c65c7879a5fa None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:37.590182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3774b-893d-40a3-b4bd-c65c7879a5fa None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:37.591548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 570/1131] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:37.596619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3333e3-b8a6-4f3e-8bcc-b75ac21f2008 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:37.597066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3333e3-b8a6-4f3e-8bcc-b75ac21f2008 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:37.597159 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3333e3-b8a6-4f3e-8bcc-b75ac21f2008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:37.615411 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5f3333e3-b8a6-4f3e-8bcc-b75ac21f2008 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:37.616589 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5f3333e3-b8a6-4f3e-8bcc-b75ac21f2008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:37.681056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 562/1132] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:26:37.959584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3774b-893d-40a3-b4bd-c65c7879a5fa None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:38.013181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:38.062366 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3774b-893d-40a3-b4bd-c65c7879a5fa None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:38.097636 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216da24-79e7-42bc-9fde-beabf12b7883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:38.098251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216da24-79e7-42bc-9fde-beabf12b7883 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:38.098524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216da24-79e7-42bc-9fde-beabf12b7883 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:38.098788 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216da24-79e7-42bc-9fde-beabf12b7883 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:38.099877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216da24-79e7-42bc-9fde-beabf12b7883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:38.101318 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216da24-79e7-42bc-9fde-beabf12b7883 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:38.102838 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 571/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:38.108541 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3333e3-b8a6-4f3e-8bcc-b75ac21f2008 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:38.126167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:38.203849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3333e3-b8a6-4f3e-8bcc-b75ac21f2008 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:38.237052 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86270332-8e86-4afd-bcb6-e8b35b4091ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:38.237615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270332-8e86-4afd-bcb6-e8b35b4091ca None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:38.237889 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270332-8e86-4afd-bcb6-e8b35b4091ca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:38.238156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270332-8e86-4afd-bcb6-e8b35b4091ca None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:38.238806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86270332-8e86-4afd-bcb6-e8b35b4091ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:38.240195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86270332-8e86-4afd-bcb6-e8b35b4091ca None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:38.326914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 563/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 31 04:26:38 2022] POST /identity/v3/projects => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:26:40.256876 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6e6d6-9731-4350-af25-45a4a5f3b14f None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:40.257464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6e6d6-9731-4350-af25-45a4a5f3b14f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:40.257464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6e6d6-9731-4350-af25-45a4a5f3b14f None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:40.258794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 572/1135] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:40.263812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b265d8-432f-4556-a985-35ff5b2df359 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:40.264204 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b265d8-432f-4556-a985-35ff5b2df359 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:40.264357 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b265d8-432f-4556-a985-35ff5b2df359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:40.283183 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a1b265d8-432f-4556-a985-35ff5b2df359 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:40.284355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a1b265d8-432f-4556-a985-35ff5b2df359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:40.345823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:40.350220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 564/1136] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:40.620149 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6e6d6-9731-4350-af25-45a4a5f3b14f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:40.723044 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6e6d6-9731-4350-af25-45a4a5f3b14f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:40.743070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:40.756234 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb95ee-d608-4e4b-a544-1084e21f7d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:40.756845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb95ee-d608-4e4b-a544-1084e21f7d92 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:40.757116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb95ee-d608-4e4b-a544-1084e21f7d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:40.757412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb95ee-d608-4e4b-a544-1084e21f7d92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:40.763835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb95ee-d608-4e4b-a544-1084e21f7d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:40.763835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb95ee-d608-4e4b-a544-1084e21f7d92 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:40.763835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 573/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:26:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:40.767635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b265d8-432f-4556-a985-35ff5b2df359 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:40.864636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b265d8-432f-4556-a985-35ff5b2df359 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:40.897058 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19678d-65ca-4259-9bd8-b154f6e22395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:40.897877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19678d-65ca-4259-9bd8-b154f6e22395 None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:40.898152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19678d-65ca-4259-9bd8-b154f6e22395 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:40.898419 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19678d-65ca-4259-9bd8-b154f6e22395 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:40.899068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19678d-65ca-4259-9bd8-b154f6e22395 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:40.900465 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19678d-65ca-4259-9bd8-b154f6e22395 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:40.977855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 565/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:26:40 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:26:42.899314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5423ec-36c3-4e3e-8423-0f7e8e045275 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:42.899882 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5423ec-36c3-4e3e-8423-0f7e8e045275 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:42.899882 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5423ec-36c3-4e3e-8423-0f7e8e045275 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:42.901182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 574/1139] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:42.906214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82a7c0-a47f-4e4e-a719-27f962000b65 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:42.906618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82a7c0-a47f-4e4e-a719-27f962000b65 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:42.906757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82a7c0-a47f-4e4e-a719-27f962000b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:42.924966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2a82a7c0-a47f-4e4e-a719-27f962000b65 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:42.926177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2a82a7c0-a47f-4e4e-a719-27f962000b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:42.974949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:42.991412 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 566/1140] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:43.274082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5423ec-36c3-4e3e-8423-0f7e8e045275 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:43.376856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5423ec-36c3-4e3e-8423-0f7e8e045275 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:43.410401 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce8160-39f9-47b9-8cbf-1a6206426123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:43.411008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce8160-39f9-47b9-8cbf-1a6206426123 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:43.411284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce8160-39f9-47b9-8cbf-1a6206426123 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:43.411551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce8160-39f9-47b9-8cbf-1a6206426123 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:43.421361 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce8160-39f9-47b9-8cbf-1a6206426123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-80ce8160-39f9-47b9-8cbf-1a6206426123 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:26:43.426738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:43.427916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:43.429011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:43.429011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:43.429011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:43.429011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:43.429011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:26:43.429011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:26:43.429011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:26:43.429011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:26:43.429011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:26:43.429011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:26:43.429011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:26:43.429011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:43.429011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 575/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:26:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:43.433932 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82a7c0-a47f-4e4e-a719-27f962000b65 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:43.529688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82a7c0-a47f-4e4e-a719-27f962000b65 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:43.562298 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56926bc-fabd-4020-8ee4-80f8d08e4bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:43.562894 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56926bc-fabd-4020-8ee4-80f8d08e4bca None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:43.563172 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56926bc-fabd-4020-8ee4-80f8d08e4bca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:43.563634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56926bc-fabd-4020-8ee4-80f8d08e4bca None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:43.564357 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56926bc-fabd-4020-8ee4-80f8d08e4bca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:43.564662 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56926bc-fabd-4020-8ee4-80f8d08e4bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:43.566039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56926bc-fabd-4020-8ee4-80f8d08e4bca None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:43.573779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 567/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:26:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:43.579901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce8160-39f9-47b9-8cbf-1a6206426123 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:43.628302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:43.677686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce8160-39f9-47b9-8cbf-1a6206426123 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:43.711116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd13d-d5ce-456c-bf82-729e21e80109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:43.711720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd13d-d5ce-456c-bf82-729e21e80109 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:43.711997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd13d-d5ce-456c-bf82-729e21e80109 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:43.712270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd13d-d5ce-456c-bf82-729e21e80109 None admin] PATH_INFO: `/v3/users/ed15c1ce7afd47d2aa2a5bbbbd71aed7` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:43.725449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecd13d-d5ce-456c-bf82-729e21e80109 None admin] RBAC: Authorizing `identity:get_user(user_id=ed15c1ce7afd47d2aa2a5bbbbd71aed7)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:43.726877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecd13d-d5ce-456c-bf82-729e21e80109 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:43.728443 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 576/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:26:43 2022] GET /identity/v3/users/ed15c1ce7afd47d2aa2a5bbbbd71aed7 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:43.734310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56926bc-fabd-4020-8ee4-80f8d08e4bca None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:43.786884 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:43.832664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56926bc-fabd-4020-8ee4-80f8d08e4bca None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:43.865818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21c4f6-26c9-47ae-9636-d3f2e06f1957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:43.866420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21c4f6-26c9-47ae-9636-d3f2e06f1957 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:43.866701 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21c4f6-26c9-47ae-9636-d3f2e06f1957 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:43.867207 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21c4f6-26c9-47ae-9636-d3f2e06f1957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:43.932678 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21c4f6-26c9-47ae-9636-d3f2e06f1957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:43.934141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21c4f6-26c9-47ae-9636-d3f2e06f1957 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:43.979335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:44.028889 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 568/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:26:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:26:44.035609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd13d-d5ce-456c-bf82-729e21e80109 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:44.133456 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd13d-d5ce-456c-bf82-729e21e80109 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:44.140574 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:44.168497 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d8b11-1bf5-4e0c-b308-d9ce44e41f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:44.169111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d8b11-1bf5-4e0c-b308-d9ce44e41f8a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:44.169489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d8b11-1bf5-4e0c-b308-d9ce44e41f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:44.169761 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d8b11-1bf5-4e0c-b308-d9ce44e41f8a None admin] PATH_INFO: `/v3/projects/728e3f8ea8db4c05a4c51e5de11a90b8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:44.171066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d8b11-1bf5-4e0c-b308-d9ce44e41f8a None admin] RBAC: Authorizing `identity:get_project(project_id=728e3f8ea8db4c05a4c51e5de11a90b8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:44.172637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d8b11-1bf5-4e0c-b308-d9ce44e41f8a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:44.175040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 577/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:26:44 2022] GET /identity/v3/projects/728e3f8ea8db4c05a4c51e5de11a90b8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:44.180744 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21c4f6-26c9-47ae-9636-d3f2e06f1957 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:44.277360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21c4f6-26c9-47ae-9636-d3f2e06f1957 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:44.311060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04bac9-e14a-42fe-a8a1-03ff77c68ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:44.311595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04bac9-e14a-42fe-a8a1-03ff77c68ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:44.311874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04bac9-e14a-42fe-a8a1-03ff77c68ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:44.312145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04bac9-e14a-42fe-a8a1-03ff77c68ae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:44.312866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04bac9-e14a-42fe-a8a1-03ff77c68ae5 None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=728e3f8ea8db4c05a4c51e5de11a90b8, user.id=ed15c1ce7afd47d2aa2a5bbbbd71aed7) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:44.313174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04bac9-e14a-42fe-a8a1-03ff77c68ae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:44.315179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04bac9-e14a-42fe-a8a1-03ff77c68ae5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:44.320524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 569/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:26:44 2022] GET /identity/v3/role_assignments?user.id=ed15c1ce7afd47d2aa2a5bbbbd71aed7&scope.project.id=728e3f8ea8db4c05a4c51e5de11a90b8&role.id=1896db68dc754d5293037ab100ce46d9 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:46.163736 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51df5d-6a37-4214-a0ef-8061c6b0952b None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:46.164283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51df5d-6a37-4214-a0ef-8061c6b0952b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:46.164283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51df5d-6a37-4214-a0ef-8061c6b0952b None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:46.165661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 578/1147] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:46.170635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a791b65-1393-4825-8e65-2635f479d3ad None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:46.171038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a791b65-1393-4825-8e65-2635f479d3ad None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:46.171180 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a791b65-1393-4825-8e65-2635f479d3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:46.189951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3a791b65-1393-4825-8e65-2635f479d3ad None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:46.191128 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3a791b65-1393-4825-8e65-2635f479d3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:46.198263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:46.255341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 570/1148] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:46.523460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51df5d-6a37-4214-a0ef-8061c6b0952b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:46.621724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51df5d-6a37-4214-a0ef-8061c6b0952b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:46.655874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12248230-aa4e-454c-8244-bea3e61af86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:46.656480 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12248230-aa4e-454c-8244-bea3e61af86d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:46.656755 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12248230-aa4e-454c-8244-bea3e61af86d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:46.657055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12248230-aa4e-454c-8244-bea3e61af86d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:46.667344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12248230-aa4e-454c-8244-bea3e61af86d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-12248230-aa4e-454c-8244-bea3e61af86d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:26:46.672047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:46.673254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:46.674218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:46.674218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:46.674218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:46.674218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:46.674218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:26:46.674218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:26:46.674218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:26:46.674218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:26:46.674218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:26:46.674218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:26:46.674218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:26:46.674218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:46.674218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 579/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:26:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:46.679345 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a791b65-1393-4825-8e65-2635f479d3ad None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:46.774290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a791b65-1393-4825-8e65-2635f479d3ad None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:46.806228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b7a2b-bd15-4493-a013-30897476c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:46.806815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7a2b-bd15-4493-a013-30897476c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:46.807089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7a2b-bd15-4493-a013-30897476c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:46.807355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7a2b-bd15-4493-a013-30897476c0a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:46.808000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b7a2b-bd15-4493-a013-30897476c0a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:46.808296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b7a2b-bd15-4493-a013-30897476c0a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:46.809677 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b7a2b-bd15-4493-a013-30897476c0a7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:46.817960 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 571/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:26:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:46.823587 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12248230-aa4e-454c-8244-bea3e61af86d None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:46.857698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:46.921564 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12248230-aa4e-454c-8244-bea3e61af86d None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:46.955019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b9c7d-da1b-4484-84e9-623193a93051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:46.955637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b9c7d-da1b-4484-84e9-623193a93051 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:46.955917 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b9c7d-da1b-4484-84e9-623193a93051 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:46.956189 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b9c7d-da1b-4484-84e9-623193a93051 None admin] PATH_INFO: `/v3/users/ed15c1ce7afd47d2aa2a5bbbbd71aed7` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:46.957337 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b9c7d-da1b-4484-84e9-623193a93051 None admin] RBAC: Authorizing `identity:get_user(user_id=ed15c1ce7afd47d2aa2a5bbbbd71aed7)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:46.958760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b9c7d-da1b-4484-84e9-623193a93051 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:46.960420 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 580/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:26:46 2022] GET /identity/v3/users/ed15c1ce7afd47d2aa2a5bbbbd71aed7 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:46.966072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b7a2b-bd15-4493-a013-30897476c0a7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:46.970338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:47.067680 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b7a2b-bd15-4493-a013-30897476c0a7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:47.101158 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f9902-f446-42ab-9035-b6733666b1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:47.101800 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f9902-f446-42ab-9035-b6733666b1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:47.102073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f9902-f446-42ab-9035-b6733666b1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:47.102339 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f9902-f446-42ab-9035-b6733666b1d0 None admin] PATH_INFO: `/v3/projects/728e3f8ea8db4c05a4c51e5de11a90b8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:47.103428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f9902-f446-42ab-9035-b6733666b1d0 None admin] RBAC: Authorizing `identity:get_project(project_id=728e3f8ea8db4c05a4c51e5de11a90b8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:47.104830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f9902-f446-42ab-9035-b6733666b1d0 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:47.106476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 572/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:26:46 2022] GET /identity/v3/projects/728e3f8ea8db4c05a4c51e5de11a90b8 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:47.112603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b9c7d-da1b-4484-84e9-623193a93051 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:47.211109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b9c7d-da1b-4484-84e9-623193a93051 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:47.212593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:47.244638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38f3b7-70e9-4c9b-9d54-046eb33ee75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:47.245299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38f3b7-70e9-4c9b-9d54-046eb33ee75e None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:47.245575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38f3b7-70e9-4c9b-9d54-046eb33ee75e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:47.245841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38f3b7-70e9-4c9b-9d54-046eb33ee75e None admin] PATH_INFO: `/v3/projects/728e3f8ea8db4c05a4c51e5de11a90b8/users/ed15c1ce7afd47d2aa2a5bbbbd71aed7/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:47.247681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38f3b7-70e9-4c9b-9d54-046eb33ee75e None admin] RBAC: Authorizing `identity:create_grant(project_id=728e3f8ea8db4c05a4c51e5de11a90b8, user_id=ed15c1ce7afd47d2aa2a5bbbbd71aed7, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:47.249090 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38f3b7-70e9-4c9b-9d54-046eb33ee75e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:47.348607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 581/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:26:47 2022] PUT /identity/v3/projects/728e3f8ea8db4c05a4c51e5de11a90b8/users/ed15c1ce7afd47d2aa2a5bbbbd71aed7/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:26:49.236568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f7134-e662-48a9-8d55-ce39b20a6f5e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:49.237099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f7134-e662-48a9-8d55-ce39b20a6f5e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:49.237099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f7134-e662-48a9-8d55-ce39b20a6f5e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:49.238484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 573/1154] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:49.243642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4b5b7-201d-4e51-8437-e99730d9ab55 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:49.244080 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4b5b7-201d-4e51-8437-e99730d9ab55 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:49.244173 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4b5b7-201d-4e51-8437-e99730d9ab55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:49.262939 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1bd4b5b7-201d-4e51-8437-e99730d9ab55 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:49.264111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1bd4b5b7-201d-4e51-8437-e99730d9ab55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:49.330910 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 582/1155] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:49.605439 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f7134-e662-48a9-8d55-ce39b20a6f5e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:49.676408 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:49.705250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f7134-e662-48a9-8d55-ce39b20a6f5e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:49.738377 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664b0c6-f12e-4f4d-86f5-ba83bdc4474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:49.738990 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664b0c6-f12e-4f4d-86f5-ba83bdc4474f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:49.739268 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664b0c6-f12e-4f4d-86f5-ba83bdc4474f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:49.739539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664b0c6-f12e-4f4d-86f5-ba83bdc4474f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:49.749174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664b0c6-f12e-4f4d-86f5-ba83bdc4474f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4664b0c6-f12e-4f4d-86f5-ba83bdc4474f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:26:49.754213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:49.755373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:49.756372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:49.756372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:49.756372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:49.756372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:49.756372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:26:49.756372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:26:49.756372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:26:49.756372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:26:49.756372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:26:49.756372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:26:49.756372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:26:49.756372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:26:49.756372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 574/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:26:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:49.761418 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4b5b7-201d-4e51-8437-e99730d9ab55 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:49.849612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:49.859142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4b5b7-201d-4e51-8437-e99730d9ab55 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:49.891327 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36c77b-4041-41f8-acc5-e543e9c36787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:49.891937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c77b-4041-41f8-acc5-e543e9c36787 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:49.892207 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c77b-4041-41f8-acc5-e543e9c36787 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:49.892506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c77b-4041-41f8-acc5-e543e9c36787 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:49.893363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36c77b-4041-41f8-acc5-e543e9c36787 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:49.893744 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36c77b-4041-41f8-acc5-e543e9c36787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:49.895387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36c77b-4041-41f8-acc5-e543e9c36787 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:49.903672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 583/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:26:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:49.910224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664b0c6-f12e-4f4d-86f5-ba83bdc4474f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:50.006329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664b0c6-f12e-4f4d-86f5-ba83bdc4474f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:50.034819 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:50.039560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d252d-80ea-4038-9284-758615f1d9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:50.040176 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d252d-80ea-4038-9284-758615f1d9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:50.040450 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d252d-80ea-4038-9284-758615f1d9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:50.040720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d252d-80ea-4038-9284-758615f1d9e7 None admin] PATH_INFO: `/v3/users/ed15c1ce7afd47d2aa2a5bbbbd71aed7` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:50.041854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d252d-80ea-4038-9284-758615f1d9e7 None admin] RBAC: Authorizing `identity:get_user(user_id=ed15c1ce7afd47d2aa2a5bbbbd71aed7)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:50.043268 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d252d-80ea-4038-9284-758615f1d9e7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:50.044833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 575/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:26:49 2022] GET /identity/v3/users/ed15c1ce7afd47d2aa2a5bbbbd71aed7 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:50.051315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36c77b-4041-41f8-acc5-e543e9c36787 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:50.148719 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36c77b-4041-41f8-acc5-e543e9c36787 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:50.181082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd69a7b-d837-41ae-b3c3-21db62790cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:50.181697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd69a7b-d837-41ae-b3c3-21db62790cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:50.181971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd69a7b-d837-41ae-b3c3-21db62790cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:50.182239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd69a7b-d837-41ae-b3c3-21db62790cd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:50.205951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:50.247842 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd69a7b-d837-41ae-b3c3-21db62790cd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:50.249287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd69a7b-d837-41ae-b3c3-21db62790cd7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:50.345041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 584/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:26:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:26:50.350842 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d252d-80ea-4038-9284-758615f1d9e7 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:50.448516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d252d-80ea-4038-9284-758615f1d9e7 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:50.480371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9efa1-0f62-4e9c-a3a8-ab5dc9cd12b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:50.480975 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9efa1-0f62-4e9c-a3a8-ab5dc9cd12b8 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:50.481274 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9efa1-0f62-4e9c-a3a8-ab5dc9cd12b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:50.481545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9efa1-0f62-4e9c-a3a8-ab5dc9cd12b8 None admin] PATH_INFO: `/v3/projects/728e3f8ea8db4c05a4c51e5de11a90b8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:50.482631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9efa1-0f62-4e9c-a3a8-ab5dc9cd12b8 None admin] RBAC: Authorizing `identity:get_project(project_id=728e3f8ea8db4c05a4c51e5de11a90b8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:50.484057 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9efa1-0f62-4e9c-a3a8-ab5dc9cd12b8 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:50.486482 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 576/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:26:50 2022] GET /identity/v3/projects/728e3f8ea8db4c05a4c51e5de11a90b8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:50.492646 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd69a7b-d837-41ae-b3c3-21db62790cd7 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:50.546901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:50.590911 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd69a7b-d837-41ae-b3c3-21db62790cd7 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:50.626030 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530e464-ed4c-4684-a9fd-352df5661106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:50.626771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530e464-ed4c-4684-a9fd-352df5661106 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:50.627049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530e464-ed4c-4684-a9fd-352df5661106 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:50.627322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530e464-ed4c-4684-a9fd-352df5661106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:50.628040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530e464-ed4c-4684-a9fd-352df5661106 None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=728e3f8ea8db4c05a4c51e5de11a90b8, user.id=ed15c1ce7afd47d2aa2a5bbbbd71aed7) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:50.628347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530e464-ed4c-4684-a9fd-352df5661106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:50.629795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530e464-ed4c-4684-a9fd-352df5661106 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:50.635396 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 585/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:26:50 2022] GET /identity/v3/role_assignments?user.id=ed15c1ce7afd47d2aa2a5bbbbd71aed7&scope.project.id=728e3f8ea8db4c05a4c51e5de11a90b8&role.id=1896db68dc754d5293037ab100ce46d9 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:52.549353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cd41f-1e35-4d9e-a756-3dffdf77673d None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:52.549898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cd41f-1e35-4d9e-a756-3dffdf77673d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:52.549898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cd41f-1e35-4d9e-a756-3dffdf77673d None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:52.551211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 577/1162] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:52.556409 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8491521-7076-4937-ab92-556d2d4f8afc None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:52.556833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8491521-7076-4937-ab92-556d2d4f8afc None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:52.556993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8491521-7076-4937-ab92-556d2d4f8afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:52.575528 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f8491521-7076-4937-ab92-556d2d4f8afc None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:52.576716 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f8491521-7076-4937-ab92-556d2d4f8afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:52.641768 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 586/1163] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:52.908713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cd41f-1e35-4d9e-a756-3dffdf77673d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:52.974286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:53.007479 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cd41f-1e35-4d9e-a756-3dffdf77673d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:53.040407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3ab1f-ddce-4fe3-8010-475993836b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:53.040992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3ab1f-ddce-4fe3-8010-475993836b98 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:53.041288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3ab1f-ddce-4fe3-8010-475993836b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:53.041555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3ab1f-ddce-4fe3-8010-475993836b98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:53.116247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3ab1f-ddce-4fe3-8010-475993836b98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:53.117738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3ab1f-ddce-4fe3-8010-475993836b98 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:53.179584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:53.212328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 578/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:26:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:26:53.218283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8491521-7076-4937-ab92-556d2d4f8afc None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:53.265479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:53.315459 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8491521-7076-4937-ab92-556d2d4f8afc None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:53.347533 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e43de-163a-4f64-b3f3-a449ab70d899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:53.348139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e43de-163a-4f64-b3f3-a449ab70d899 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:53.348413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e43de-163a-4f64-b3f3-a449ab70d899 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:53.348679 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e43de-163a-4f64-b3f3-a449ab70d899 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:53.355044 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e43de-163a-4f64-b3f3-a449ab70d899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:53.356462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e43de-163a-4f64-b3f3-a449ab70d899 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-dc8e43de-163a-4f64-b3f3-a449ab70d899 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:26:53.368061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:26:53.369307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:26:53.370367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 587/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 31 04:26:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:26:53.375060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3ab1f-ddce-4fe3-8010-475993836b98 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:53.470509 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3ab1f-ddce-4fe3-8010-475993836b98 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:53.503270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0c876-260a-40e8-ad91-f4755074049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:53.503864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0c876-260a-40e8-ad91-f4755074049e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:53.504142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0c876-260a-40e8-ad91-f4755074049e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:53.504417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0c876-260a-40e8-ad91-f4755074049e None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:53.505061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0c876-260a-40e8-ad91-f4755074049e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:26:53.505391 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0c876-260a-40e8-ad91-f4755074049e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:53.506743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0c876-260a-40e8-ad91-f4755074049e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:53.513680 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 579/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 31 04:26:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:55.408216 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b213ef-085a-460a-9b7c-043ce73d2962 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:55.408739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b213ef-085a-460a-9b7c-043ce73d2962 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:55.408739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b213ef-085a-460a-9b7c-043ce73d2962 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:55.410229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 588/1167] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:55.415316 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2212cf-876d-45ad-afbd-800f56338eee None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:55.415690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2212cf-876d-45ad-afbd-800f56338eee None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:55.415854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2212cf-876d-45ad-afbd-800f56338eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:55.433748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0e2212cf-876d-45ad-afbd-800f56338eee None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:55.434930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0e2212cf-876d-45ad-afbd-800f56338eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:55.459939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:55.499038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 580/1168] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:55.769612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b213ef-085a-460a-9b7c-043ce73d2962 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:55.868640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b213ef-085a-460a-9b7c-043ce73d2962 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:55.878969 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:55.903069 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e116a7f-a567-4913-9738-b56601e39ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:55.903649 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e116a7f-a567-4913-9738-b56601e39ed5 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:55.903925 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e116a7f-a567-4913-9738-b56601e39ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:55.909238 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e116a7f-a567-4913-9738-b56601e39ed5 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:55.909238 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e116a7f-a567-4913-9738-b56601e39ed5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:55.909238 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e116a7f-a567-4913-9738-b56601e39ed5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:55.980160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 589/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Wed Aug 31 04:26:55 2022] POST /identity/v3/domains => generated 267 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:26:57.933115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5faeb-32b4-42b2-85f2-af31e31ec2e1 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:57.933703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5faeb-32b4-42b2-85f2-af31e31ec2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:57.933861 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5faeb-32b4-42b2-85f2-af31e31ec2e1 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:57.935216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 581/1170] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:26:57.941337 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee099726-7a79-403e-80d8-4ee8cb5b0061 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:57.941715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee099726-7a79-403e-80d8-4ee8cb5b0061 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:57.941887 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee099726-7a79-403e-80d8-4ee8cb5b0061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:57.960440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ee099726-7a79-403e-80d8-4ee8cb5b0061 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:26:57.961657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ee099726-7a79-403e-80d8-4ee8cb5b0061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:26:58.025973 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 590/1171] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:26:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:26:58.295788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5faeb-32b4-42b2-85f2-af31e31ec2e1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:58.393274 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5faeb-32b4-42b2-85f2-af31e31ec2e1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:58.426191 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf057b-c233-4bca-8b23-5f92123b3ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:58.426808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf057b-c233-4bca-8b23-5f92123b3ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:58.427088 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf057b-c233-4bca-8b23-5f92123b3ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:58.427362 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf057b-c233-4bca-8b23-5f92123b3ab5 None admin] PATH_INFO: `/v3/domains/206fe9f0868b48ab9902262ab34e1382` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:58.437377 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf057b-c233-4bca-8b23-5f92123b3ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=206fe9f0868b48ab9902262ab34e1382)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:58.439329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf057b-c233-4bca-8b23-5f92123b3ab5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:58.441020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 582/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Wed Aug 31 04:26:58 2022] GET /identity/v3/domains/206fe9f0868b48ab9902262ab34e1382 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:26:58.446762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee099726-7a79-403e-80d8-4ee8cb5b0061 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:26:58.540199 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:26:58.543843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee099726-7a79-403e-80d8-4ee8cb5b0061 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:26:58.575777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684aaed2-6359-4b4b-a1da-ca9b9fb87b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:26:58.576310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aaed2-6359-4b4b-a1da-ca9b9fb87b80 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:26:58.576588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aaed2-6359-4b4b-a1da-ca9b9fb87b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:26:58.576858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aaed2-6359-4b4b-a1da-ca9b9fb87b80 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:26:58.577546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aaed2-6359-4b4b-a1da-ca9b9fb87b80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:26:58.579502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aaed2-6359-4b4b-a1da-ca9b9fb87b80 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:26:58.661021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 591/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 31 04:26:58 2022] POST /identity/v3/projects => generated 361 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:27:00.587034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf0045-073b-4428-a08f-9d84417abc63 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:00.587581 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf0045-073b-4428-a08f-9d84417abc63 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:00.587581 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf0045-073b-4428-a08f-9d84417abc63 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:00.588909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 583/1174] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:27:00.594017 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5e4e-df6e-4e2e-8285-b6eadf40946a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:00.595030 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5e4e-df6e-4e2e-8285-b6eadf40946a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:00.595278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5e4e-df6e-4e2e-8285-b6eadf40946a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:00.613038 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-72bb5e4e-df6e-4e2e-8285-b6eadf40946a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:27:00.614231 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-72bb5e4e-df6e-4e2e-8285-b6eadf40946a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:27:00.679092 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 592/1175] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:27:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:27:00.944521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf0045-073b-4428-a08f-9d84417abc63 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:00.969073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:01.050454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf0045-073b-4428-a08f-9d84417abc63 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:01.084222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea1baa-e285-4cf5-a20d-0b28141e552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:01.084838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea1baa-e285-4cf5-a20d-0b28141e552c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:01.085114 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea1baa-e285-4cf5-a20d-0b28141e552c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:01.085410 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea1baa-e285-4cf5-a20d-0b28141e552c None admin] PATH_INFO: `/v3/domains/206fe9f0868b48ab9902262ab34e1382` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:01.086506 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea1baa-e285-4cf5-a20d-0b28141e552c None admin] RBAC: Authorizing `identity:get_domain(domain_id=206fe9f0868b48ab9902262ab34e1382)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:01.087916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea1baa-e285-4cf5-a20d-0b28141e552c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:01.089494 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 584/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Wed Aug 31 04:27:00 2022] GET /identity/v3/domains/206fe9f0868b48ab9902262ab34e1382 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:27:01.095148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb5e4e-df6e-4e2e-8285-b6eadf40946a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:01.175857 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:01.194860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb5e4e-df6e-4e2e-8285-b6eadf40946a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:01.228492 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d42f43-bd5d-46ea-a607-67f624458480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:01.229477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42f43-bd5d-46ea-a607-67f624458480 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:01.229755 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42f43-bd5d-46ea-a607-67f624458480 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:01.230024 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42f43-bd5d-46ea-a607-67f624458480 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:01.230675 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d42f43-bd5d-46ea-a607-67f624458480 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:01.232094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d42f43-bd5d-46ea-a607-67f624458480 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:01.336462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 593/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:27:01 2022] POST /identity/v3/users => generated 311 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:27:03.288182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a09ba7-2c44-4ab1-850e-ca80977ec4af None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:03.288763 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a09ba7-2c44-4ab1-850e-ca80977ec4af None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:03.288763 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a09ba7-2c44-4ab1-850e-ca80977ec4af None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:03.290101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 585/1178] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:27:03.295096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d1119-86eb-4051-a7d1-aee643b95d96 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:03.295509 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d1119-86eb-4051-a7d1-aee643b95d96 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:03.295627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d1119-86eb-4051-a7d1-aee643b95d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:03.314045 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1a0d1119-86eb-4051-a7d1-aee643b95d96 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:27:03.315280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1a0d1119-86eb-4051-a7d1-aee643b95d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:27:03.379281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 594/1179] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:27:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:27:03.652523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a09ba7-2c44-4ab1-850e-ca80977ec4af None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:03.740620 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:03.750777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a09ba7-2c44-4ab1-850e-ca80977ec4af None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:03.784365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40921571-32c5-4e99-9df3-4b5234f0faca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:03.784980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40921571-32c5-4e99-9df3-4b5234f0faca None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:03.785278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40921571-32c5-4e99-9df3-4b5234f0faca None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:03.785550 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40921571-32c5-4e99-9df3-4b5234f0faca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:03.795267 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40921571-32c5-4e99-9df3-4b5234f0faca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-40921571-32c5-4e99-9df3-4b5234f0faca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:27:03.800130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:27:03.801125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:27:03.802103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:27:03.802103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:27:03.802103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:27:03.802103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:27:03.802103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:27:03.802103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:27:03.802103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:27:03.802103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:27:03.802103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:27:03.802103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:27:03.802103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:27:03.802103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:27:03.802103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 586/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:27:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:27:03.807423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d1119-86eb-4051-a7d1-aee643b95d96 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:03.871817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:03.906410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d1119-86eb-4051-a7d1-aee643b95d96 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:03.940764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858da166-dccf-43be-9b9b-18813c5f7118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:03.941379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858da166-dccf-43be-9b9b-18813c5f7118 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:03.941662 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858da166-dccf-43be-9b9b-18813c5f7118 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:03.941931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858da166-dccf-43be-9b9b-18813c5f7118 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:03.942589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858da166-dccf-43be-9b9b-18813c5f7118 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:27:03.942889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858da166-dccf-43be-9b9b-18813c5f7118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:03.944243 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858da166-dccf-43be-9b9b-18813c5f7118 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:03.952021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 595/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:27:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:27:03.958946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40921571-32c5-4e99-9df3-4b5234f0faca None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:04.054837 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40921571-32c5-4e99-9df3-4b5234f0faca None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:04.090106 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf009e0-10fc-49c0-8253-3a5420fb26c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:04.090726 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf009e0-10fc-49c0-8253-3a5420fb26c2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:04.091001 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf009e0-10fc-49c0-8253-3a5420fb26c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:04.091268 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf009e0-10fc-49c0-8253-3a5420fb26c2 None admin] PATH_INFO: `/v3/users/a74db4a759bc4a27a65966b3a6075035` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:04.103905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf009e0-10fc-49c0-8253-3a5420fb26c2 None admin] RBAC: Authorizing `identity:get_user(user_id=a74db4a759bc4a27a65966b3a6075035)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:04.105364 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf009e0-10fc-49c0-8253-3a5420fb26c2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:04.106949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 587/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:27:03 2022] GET /identity/v3/users/a74db4a759bc4a27a65966b3a6075035 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:27:04.113016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858da166-dccf-43be-9b9b-18813c5f7118 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:04.210569 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858da166-dccf-43be-9b9b-18813c5f7118 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:04.234956 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:04.242330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2867eb3-4169-4a87-8f15-6ebf43b35898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:04.244800 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867eb3-4169-4a87-8f15-6ebf43b35898 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:04.244800 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867eb3-4169-4a87-8f15-6ebf43b35898 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:04.244800 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867eb3-4169-4a87-8f15-6ebf43b35898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:04.309056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2867eb3-4169-4a87-8f15-6ebf43b35898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:04.310520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2867eb3-4169-4a87-8f15-6ebf43b35898 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:04.404697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 596/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:27:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:27:04.411258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf009e0-10fc-49c0-8253-3a5420fb26c2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:04.421719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:04.507584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf009e0-10fc-49c0-8253-3a5420fb26c2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:04.540043 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd792c6f-154f-4230-96d1-c52002b260a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:04.540654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd792c6f-154f-4230-96d1-c52002b260a3 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:04.540929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd792c6f-154f-4230-96d1-c52002b260a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:04.541214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd792c6f-154f-4230-96d1-c52002b260a3 None admin] PATH_INFO: `/v3/projects/08dd81c5e92b4745b4d06c6817d0d734` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:04.542321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd792c6f-154f-4230-96d1-c52002b260a3 None admin] RBAC: Authorizing `identity:get_project(project_id=08dd81c5e92b4745b4d06c6817d0d734)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:04.543725 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd792c6f-154f-4230-96d1-c52002b260a3 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:04.545353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 588/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:27:04 2022] GET /identity/v3/projects/08dd81c5e92b4745b4d06c6817d0d734 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:27:04.552387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2867eb3-4169-4a87-8f15-6ebf43b35898 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:04.580368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:04.650570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2867eb3-4169-4a87-8f15-6ebf43b35898 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:04.684659 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0fffe-cd55-4be1-941e-3a220073af10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:04.685266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0fffe-cd55-4be1-941e-3a220073af10 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:04.685547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0fffe-cd55-4be1-941e-3a220073af10 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:04.685818 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0fffe-cd55-4be1-941e-3a220073af10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:04.686533 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0fffe-cd55-4be1-941e-3a220073af10 None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=08dd81c5e92b4745b4d06c6817d0d734, user.id=a74db4a759bc4a27a65966b3a6075035) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:27:04.686837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0fffe-cd55-4be1-941e-3a220073af10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:04.688430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0fffe-cd55-4be1-941e-3a220073af10 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:04.693813 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 597/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:27:04 2022] GET /identity/v3/role_assignments?user.id=a74db4a759bc4a27a65966b3a6075035&scope.project.id=08dd81c5e92b4745b4d06c6817d0d734&role.id=1896db68dc754d5293037ab100ce46d9 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:27:06.574717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03debcb8-9b39-4d9b-97a0-cdf640276f38 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:06.575253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03debcb8-9b39-4d9b-97a0-cdf640276f38 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:06.575253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03debcb8-9b39-4d9b-97a0-cdf640276f38 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:06.576606 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 589/1186] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:27:06.582491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab82949-fe8c-4bce-9524-0196519ee746 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:06.582872 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab82949-fe8c-4bce-9524-0196519ee746 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:06.583034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab82949-fe8c-4bce-9524-0196519ee746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:06.600670 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6ab82949-fe8c-4bce-9524-0196519ee746 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:27:06.601867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6ab82949-fe8c-4bce-9524-0196519ee746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:27:06.665974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 598/1187] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:27:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:27:06.931425 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03debcb8-9b39-4d9b-97a0-cdf640276f38 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:07.007481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:07.030594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03debcb8-9b39-4d9b-97a0-cdf640276f38 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:07.063721 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350be39d-3567-44a5-a32b-494aab3cd17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:07.064530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350be39d-3567-44a5-a32b-494aab3cd17e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:07.064805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350be39d-3567-44a5-a32b-494aab3cd17e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:07.065071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350be39d-3567-44a5-a32b-494aab3cd17e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:07.074803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350be39d-3567-44a5-a32b-494aab3cd17e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-350be39d-3567-44a5-a32b-494aab3cd17e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:27:07.080266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:27:07.081496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:27:07.082556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:27:07.082556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:27:07.082556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:27:07.082556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:27:07.082556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:27:07.082556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:27:07.082556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:27:07.082556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:27:07.082556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:27:07.082556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:27:07.082556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:27:07.082556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:27:07.082556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 590/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:27:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:27:07.087409 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab82949-fe8c-4bce-9524-0196519ee746 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:07.110444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:07.189235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab82949-fe8c-4bce-9524-0196519ee746 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:07.223488 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62feed2-2387-4e95-a592-a8813e276677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:07.224079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62feed2-2387-4e95-a592-a8813e276677 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:07.224356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62feed2-2387-4e95-a592-a8813e276677 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:07.224630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62feed2-2387-4e95-a592-a8813e276677 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:07.225315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62feed2-2387-4e95-a592-a8813e276677 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:27:07.225619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62feed2-2387-4e95-a592-a8813e276677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:07.226989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62feed2-2387-4e95-a592-a8813e276677 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:07.234810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 599/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:27:07.241645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350be39d-3567-44a5-a32b-494aab3cd17e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:07.340473 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350be39d-3567-44a5-a32b-494aab3cd17e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:07.373307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f01184-0de5-4d3a-ae8e-8e215fc6f4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:07.373921 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f01184-0de5-4d3a-ae8e-8e215fc6f4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:07.374195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f01184-0de5-4d3a-ae8e-8e215fc6f4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:07.374462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f01184-0de5-4d3a-ae8e-8e215fc6f4d5 None admin] PATH_INFO: `/v3/users/a74db4a759bc4a27a65966b3a6075035` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:07.375607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f01184-0de5-4d3a-ae8e-8e215fc6f4d5 None admin] RBAC: Authorizing `identity:get_user(user_id=a74db4a759bc4a27a65966b3a6075035)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:07.377010 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f01184-0de5-4d3a-ae8e-8e215fc6f4d5 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:07.378603 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 591/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:27:07 2022] GET /identity/v3/users/a74db4a759bc4a27a65966b3a6075035 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:27:07.384405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62feed2-2387-4e95-a592-a8813e276677 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:07.467136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:07.482506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62feed2-2387-4e95-a592-a8813e276677 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:07.514665 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb19cc3-f4ba-47d0-bdaf-8e48ef53d620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:07.515268 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb19cc3-f4ba-47d0-bdaf-8e48ef53d620 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:07.515541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb19cc3-f4ba-47d0-bdaf-8e48ef53d620 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:07.515808 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb19cc3-f4ba-47d0-bdaf-8e48ef53d620 None admin] PATH_INFO: `/v3/projects/08dd81c5e92b4745b4d06c6817d0d734` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:07.517478 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb19cc3-f4ba-47d0-bdaf-8e48ef53d620 None admin] RBAC: Authorizing `identity:get_project(project_id=08dd81c5e92b4745b4d06c6817d0d734)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:07.518898 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb19cc3-f4ba-47d0-bdaf-8e48ef53d620 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:07.520479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 600/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:27:07 2022] GET /identity/v3/projects/08dd81c5e92b4745b4d06c6817d0d734 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:27:07.526661 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f01184-0de5-4d3a-ae8e-8e215fc6f4d5 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:07.530358 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:07.623848 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f01184-0de5-4d3a-ae8e-8e215fc6f4d5 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:07.657312 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48baa4-5ac7-4a44-a890-44281e3e5923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:07.658046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48baa4-5ac7-4a44-a890-44281e3e5923 None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:07.658320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48baa4-5ac7-4a44-a890-44281e3e5923 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:07.658585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48baa4-5ac7-4a44-a890-44281e3e5923 None admin] PATH_INFO: `/v3/projects/08dd81c5e92b4745b4d06c6817d0d734/users/a74db4a759bc4a27a65966b3a6075035/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:07.660470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48baa4-5ac7-4a44-a890-44281e3e5923 None admin] RBAC: Authorizing `identity:create_grant(project_id=08dd81c5e92b4745b4d06c6817d0d734, user_id=a74db4a759bc4a27a65966b3a6075035, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:07.661898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48baa4-5ac7-4a44-a890-44281e3e5923 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:07.754862 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 592/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:27:07 2022] PUT /identity/v3/projects/08dd81c5e92b4745b4d06c6817d0d734/users/a74db4a759bc4a27a65966b3a6075035/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:27:09.633618 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88013d-bfa7-41de-a8b0-23797be89f8c None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:09.634183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88013d-bfa7-41de-a8b0-23797be89f8c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:09.634183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88013d-bfa7-41de-a8b0-23797be89f8c None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:09.635502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 601/1193] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:27:09.640648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415471-4ac6-46d9-8ff9-8392571adcc7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:09.641580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415471-4ac6-46d9-8ff9-8392571adcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:09.641792 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415471-4ac6-46d9-8ff9-8392571adcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:09.660314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-13415471-4ac6-46d9-8ff9-8392571adcc7 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:27:09.661528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-13415471-4ac6-46d9-8ff9-8392571adcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:27:09.718776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:09.727584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 593/1194] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:27:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:27:10.003513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88013d-bfa7-41de-a8b0-23797be89f8c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:10.104130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88013d-bfa7-41de-a8b0-23797be89f8c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:10.141117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52e0ac-344b-4664-bd24-d07025532314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:10.142331 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e0ac-344b-4664-bd24-d07025532314 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:10.142604 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e0ac-344b-4664-bd24-d07025532314 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:10.142871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e0ac-344b-4664-bd24-d07025532314 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:10.153355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52e0ac-344b-4664-bd24-d07025532314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2b52e0ac-344b-4664-bd24-d07025532314 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:27:10.158163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:27:10.159290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:27:10.160219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:27:10.160219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:27:10.160219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:27:10.160219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:27:10.160219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:27:10.160219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:27:10.160219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:27:10.160219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:27:10.160219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:27:10.160219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:27:10.160219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:27:10.160219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:27:10.160219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 602/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:27:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:27:10.165272 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13415471-4ac6-46d9-8ff9-8392571adcc7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:10.259493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13415471-4ac6-46d9-8ff9-8392571adcc7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:10.292172 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba5777-05c8-4970-b61e-789cf2dd244f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:10.292757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba5777-05c8-4970-b61e-789cf2dd244f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:10.293035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba5777-05c8-4970-b61e-789cf2dd244f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:10.293330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba5777-05c8-4970-b61e-789cf2dd244f None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:10.293984 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba5777-05c8-4970-b61e-789cf2dd244f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:27:10.294280 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba5777-05c8-4970-b61e-789cf2dd244f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:10.295620 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba5777-05c8-4970-b61e-789cf2dd244f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:10.303979 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 594/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:27:10.309719 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52e0ac-344b-4664-bd24-d07025532314 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:10.326283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:10.408954 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52e0ac-344b-4664-bd24-d07025532314 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:10.442173 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67981b80-01f6-42e1-8ba2-56f83d60127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:10.442776 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67981b80-01f6-42e1-8ba2-56f83d60127f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:10.443049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67981b80-01f6-42e1-8ba2-56f83d60127f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:10.443318 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67981b80-01f6-42e1-8ba2-56f83d60127f None admin] PATH_INFO: `/v3/users/a74db4a759bc4a27a65966b3a6075035` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:10.444412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67981b80-01f6-42e1-8ba2-56f83d60127f None admin] RBAC: Authorizing `identity:get_user(user_id=a74db4a759bc4a27a65966b3a6075035)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:10.445859 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67981b80-01f6-42e1-8ba2-56f83d60127f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:10.447391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 603/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 31 04:27:10 2022] GET /identity/v3/users/a74db4a759bc4a27a65966b3a6075035 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:27:10.453328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba5777-05c8-4970-b61e-789cf2dd244f None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:10.516692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:10.558998 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba5777-05c8-4970-b61e-789cf2dd244f None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:10.591322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9bdf5-58e5-4f87-94dd-caafa59fc023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:10.591916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9bdf5-58e5-4f87-94dd-caafa59fc023 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:10.592193 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9bdf5-58e5-4f87-94dd-caafa59fc023 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:10.592464 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9bdf5-58e5-4f87-94dd-caafa59fc023 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:10.657541 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9bdf5-58e5-4f87-94dd-caafa59fc023 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:10.658961 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9bdf5-58e5-4f87-94dd-caafa59fc023 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:10.710770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:10.753704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 595/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:27:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:27:10.759622 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67981b80-01f6-42e1-8ba2-56f83d60127f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:10.840040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:10.858816 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67981b80-01f6-42e1-8ba2-56f83d60127f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:10.892290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e96d4-e7df-44db-9328-36899d3117a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:10.892896 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e96d4-e7df-44db-9328-36899d3117a9 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:10.893168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e96d4-e7df-44db-9328-36899d3117a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:10.893465 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e96d4-e7df-44db-9328-36899d3117a9 None admin] PATH_INFO: `/v3/projects/08dd81c5e92b4745b4d06c6817d0d734` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:10.894550 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e96d4-e7df-44db-9328-36899d3117a9 None admin] RBAC: Authorizing `identity:get_project(project_id=08dd81c5e92b4745b4d06c6817d0d734)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:10.895967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e96d4-e7df-44db-9328-36899d3117a9 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:10.897709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 604/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 31 04:27:10 2022] GET /identity/v3/projects/08dd81c5e92b4745b4d06c6817d0d734 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:27:10.904171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9bdf5-58e5-4f87-94dd-caafa59fc023 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:27:10.999098 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9bdf5-58e5-4f87-94dd-caafa59fc023 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:27:11.031233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da855050-fa3c-4504-8045-7d2563401a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:27:11.032372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da855050-fa3c-4504-8045-7d2563401a7c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:27:11.032643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da855050-fa3c-4504-8045-7d2563401a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:27:11.032905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da855050-fa3c-4504-8045-7d2563401a7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:27:11.033634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da855050-fa3c-4504-8045-7d2563401a7c None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=08dd81c5e92b4745b4d06c6817d0d734, user.id=a74db4a759bc4a27a65966b3a6075035) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:27:11.033933 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da855050-fa3c-4504-8045-7d2563401a7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:27:11.035333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da855050-fa3c-4504-8045-7d2563401a7c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:27:11.040792 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 596/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:27:10 2022] GET /identity/v3/role_assignments?user.id=a74db4a759bc4a27a65966b3a6075035&scope.project.id=08dd81c5e92b4745b4d06c6817d0d734&role.id=1896db68dc754d5293037ab100ce46d9 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:27:20.888123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=26 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:27:21.038321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:23.055443 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4fec3-8c4d-4bab-a5e6-808ec4eff457 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:23.055894 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4fec3-8c4d-4bab-a5e6-808ec4eff457 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:23.055990 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4fec3-8c4d-4bab-a5e6-808ec4eff457 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:23.057350 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 605/1201] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:28:23.062574 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3d360-b8d3-47d7-a3bc-d9acaf691a84 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:23.063600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3d360-b8d3-47d7-a3bc-d9acaf691a84 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:23.063845 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3d360-b8d3-47d7-a3bc-d9acaf691a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:23.082203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-54e3d360-b8d3-47d7-a3bc-d9acaf691a84 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:28:23.083409 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-54e3d360-b8d3-47d7-a3bc-d9acaf691a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:28:23.150135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 597/1202] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:28:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:28:23.417510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4fec3-8c4d-4bab-a5e6-808ec4eff457 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:23.517431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4fec3-8c4d-4bab-a5e6-808ec4eff457 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:23.559478 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a7b00-87de-4888-81cb-c6588a51b80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:23.560097 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a7b00-87de-4888-81cb-c6588a51b80b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:23.560373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a7b00-87de-4888-81cb-c6588a51b80b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:23.560644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a7b00-87de-4888-81cb-c6588a51b80b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:23.570624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a7b00-87de-4888-81cb-c6588a51b80b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:23.572063 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a7b00-87de-4888-81cb-c6588a51b80b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d27a7b00-87de-4888-81cb-c6588a51b80b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:28:23.586877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:23.588210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:28:23.589240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:28:23.589240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:23.589240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:23.589240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 606/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:23.594676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3d360-b8d3-47d7-a3bc-d9acaf691a84 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:23.691557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3d360-b8d3-47d7-a3bc-d9acaf691a84 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:23.718861 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:23.725391 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73c40c-6f5a-463e-96c5-4c8c5d0ef7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:23.733249 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73c40c-6f5a-463e-96c5-4c8c5d0ef7ee None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:23.733249 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73c40c-6f5a-463e-96c5-4c8c5d0ef7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:23.733249 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73c40c-6f5a-463e-96c5-4c8c5d0ef7ee None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:23.733249 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73c40c-6f5a-463e-96c5-4c8c5d0ef7ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:23.733249 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73c40c-6f5a-463e-96c5-4c8c5d0ef7ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:23.733249 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73c40c-6f5a-463e-96c5-4c8c5d0ef7ee None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:23.740417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 598/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:23.746416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a7b00-87de-4888-81cb-c6588a51b80b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:23.800272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:23.848671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a7b00-87de-4888-81cb-c6588a51b80b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:23.882381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61abef-105d-4b5c-a3f9-001fb6577049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:23.883082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61abef-105d-4b5c-a3f9-001fb6577049 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:23.883354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61abef-105d-4b5c-a3f9-001fb6577049 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:23.883620 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61abef-105d-4b5c-a3f9-001fb6577049 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:23.884253 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61abef-105d-4b5c-a3f9-001fb6577049 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:23.885782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61abef-105d-4b5c-a3f9-001fb6577049 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:23.973436 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 607/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 31 04:28:23 2022] POST /identity/v3/users => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:28:26.049924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d76b6-0a96-4528-b796-4f09a9fc6fe7 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:26.050484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d76b6-0a96-4528-b796-4f09a9fc6fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:26.050484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d76b6-0a96-4528-b796-4f09a9fc6fe7 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:26.051871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 599/1206] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:28:26.057103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0ae09-cba6-4b4c-b08a-20aa228c121f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:26.057526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0ae09-cba6-4b4c-b08a-20aa228c121f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:26.057690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0ae09-cba6-4b4c-b08a-20aa228c121f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:26.076537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-85e0ae09-cba6-4b4c-b08a-20aa228c121f None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:28:26.077823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-85e0ae09-cba6-4b4c-b08a-20aa228c121f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:28:26.145260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 608/1207] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:28:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:28:26.412965 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d76b6-0a96-4528-b796-4f09a9fc6fe7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:26.512627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d76b6-0a96-4528-b796-4f09a9fc6fe7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:26.545682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1f469-0c71-4247-bfa4-a2a5d02b3a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:26.546296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1f469-0c71-4247-bfa4-a2a5d02b3a57 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:26.546571 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1f469-0c71-4247-bfa4-a2a5d02b3a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:26.546836 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1f469-0c71-4247-bfa4-a2a5d02b3a57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:26.557322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1f469-0c71-4247-bfa4-a2a5d02b3a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c4f1f469-0c71-4247-bfa4-a2a5d02b3a57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:28:26.562046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:26.563444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:26.564613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:26.564613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:26.564613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:26.564613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:26.564613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:28:26.564613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:28:26.564613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:28:26.564613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:28:26.564613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:28:26.564613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:28:26.564613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:28:26.564613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:26.564613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 600/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:28:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:26.569321 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0ae09-cba6-4b4c-b08a-20aa228c121f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:26.611598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:26.668646 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0ae09-cba6-4b4c-b08a-20aa228c121f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:26.701549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992ca50-3db4-48f5-85d4-34f83cc928a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:26.702155 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992ca50-3db4-48f5-85d4-34f83cc928a3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:26.702439 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992ca50-3db4-48f5-85d4-34f83cc928a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:26.702725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992ca50-3db4-48f5-85d4-34f83cc928a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:26.703692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992ca50-3db4-48f5-85d4-34f83cc928a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:26.704046 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992ca50-3db4-48f5-85d4-34f83cc928a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:26.705789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992ca50-3db4-48f5-85d4-34f83cc928a3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:26.720586 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 609/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:28:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:26.726416 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1f469-0c71-4247-bfa4-a2a5d02b3a57 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:26.785473 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:26.833759 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1f469-0c71-4247-bfa4-a2a5d02b3a57 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:26.867070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36c9de-0ee4-425f-af6d-220c22dce375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:26.867684 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36c9de-0ee4-425f-af6d-220c22dce375 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:26.867955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36c9de-0ee4-425f-af6d-220c22dce375 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:26.868220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36c9de-0ee4-425f-af6d-220c22dce375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:26.878301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36c9de-0ee4-425f-af6d-220c22dce375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:26.879721 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36c9de-0ee4-425f-af6d-220c22dce375 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-7f36c9de-0ee4-425f-af6d-220c22dce375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:28:26.893914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:26.895037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:28:26.896190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:28:26.896190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:26.896190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:26.896190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 601/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:26.901362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992ca50-3db4-48f5-85d4-34f83cc928a3 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:26.997538 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:27.000518 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992ca50-3db4-48f5-85d4-34f83cc928a3 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:27.033233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e161b-e928-48a4-a954-2cbec4cc70a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:27.033832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e161b-e928-48a4-a954-2cbec4cc70a4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:27.034103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e161b-e928-48a4-a954-2cbec4cc70a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:27.034370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e161b-e928-48a4-a954-2cbec4cc70a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:27.034999 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e161b-e928-48a4-a954-2cbec4cc70a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:27.035297 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e161b-e928-48a4-a954-2cbec4cc70a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:27.036650 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e161b-e928-48a4-a954-2cbec4cc70a4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:27.048023 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 610/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:27.054608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36c9de-0ee4-425f-af6d-220c22dce375 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:27.166227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36c9de-0ee4-425f-af6d-220c22dce375 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:27.167710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:27.200306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50bb50-b9d6-479e-8169-f0d45303c734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:27.200921 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50bb50-b9d6-479e-8169-f0d45303c734 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:27.201219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50bb50-b9d6-479e-8169-f0d45303c734 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:27.201496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50bb50-b9d6-479e-8169-f0d45303c734 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:27.208631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50bb50-b9d6-479e-8169-f0d45303c734 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:27.210160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50bb50-b9d6-479e-8169-f0d45303c734 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-0e50bb50-b9d6-479e-8169-f0d45303c734 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:28:27.222111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:27.223135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:27.224360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:27.224360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:27.224360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:28:27.224360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:28:27.224360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:28:27.224360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:28:27.224360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:28:27.224360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:28:27.224360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 04:28:27.224360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:27.224360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 602/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:27.229229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e161b-e928-48a4-a954-2cbec4cc70a4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:27.329203 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e161b-e928-48a4-a954-2cbec4cc70a4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:27.363572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f38cb-b122-486f-a03c-5576d9cb2949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:27.364239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f38cb-b122-486f-a03c-5576d9cb2949 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:27.364515 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f38cb-b122-486f-a03c-5576d9cb2949 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:27.364784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f38cb-b122-486f-a03c-5576d9cb2949 None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:27.365529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f38cb-b122-486f-a03c-5576d9cb2949 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:27.365833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f38cb-b122-486f-a03c-5576d9cb2949 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:27.367258 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f38cb-b122-486f-a03c-5576d9cb2949 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:27.390848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 611/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 31 04:28:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:27.396992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50bb50-b9d6-479e-8169-f0d45303c734 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:27.505208 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50bb50-b9d6-479e-8169-f0d45303c734 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:27.543881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956908b-31fa-478e-827b-05e7e1c0ffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:27.544494 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956908b-31fa-478e-827b-05e7e1c0ffad None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:27.544769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956908b-31fa-478e-827b-05e7e1c0ffad None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:27.545037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956908b-31fa-478e-827b-05e7e1c0ffad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:27.576348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:27.614716 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956908b-31fa-478e-827b-05e7e1c0ffad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:27.616092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956908b-31fa-478e-827b-05e7e1c0ffad None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:27.716058 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 603/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:28:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:28:27.722620 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f38cb-b122-486f-a03c-5576d9cb2949 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:27.741267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:27.821067 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f38cb-b122-486f-a03c-5576d9cb2949 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:27.855890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5860959-5d57-41ad-a824-a0252f7ffc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:27.856507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5860959-5d57-41ad-a824-a0252f7ffc40 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:27.856831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5860959-5d57-41ad-a824-a0252f7ffc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:27.857100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5860959-5d57-41ad-a824-a0252f7ffc40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:27.867221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5860959-5d57-41ad-a824-a0252f7ffc40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:27.868631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5860959-5d57-41ad-a824-a0252f7ffc40 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-f5860959-5d57-41ad-a824-a0252f7ffc40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:28:27.883367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:27.884475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:28:27.885432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:28:27.885432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:27.885432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:27.885432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 612/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:27.890358 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956908b-31fa-478e-827b-05e7e1c0ffad None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:27.951737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:27.989126 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956908b-31fa-478e-827b-05e7e1c0ffad None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:28.034520 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9eddd-bc77-4c52-8af2-9c98896cf0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:28.035129 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9eddd-bc77-4c52-8af2-9c98896cf0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:28.035412 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9eddd-bc77-4c52-8af2-9c98896cf0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:28.035676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9eddd-bc77-4c52-8af2-9c98896cf0d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:28.036315 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9eddd-bc77-4c52-8af2-9c98896cf0d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:28.036616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9eddd-bc77-4c52-8af2-9c98896cf0d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:28.038010 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9eddd-bc77-4c52-8af2-9c98896cf0d2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:28.053907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 604/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:28.059393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5860959-5d57-41ad-a824-a0252f7ffc40 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:28.133087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:28.164083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5860959-5d57-41ad-a824-a0252f7ffc40 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:28.198479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ce776-2a34-437e-acf1-088d8ced9738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:28.199096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ce776-2a34-437e-acf1-088d8ced9738 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:28.199397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ce776-2a34-437e-acf1-088d8ced9738 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:28.199757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ce776-2a34-437e-acf1-088d8ced9738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:28.207123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ce776-2a34-437e-acf1-088d8ced9738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:28.208560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ce776-2a34-437e-acf1-088d8ced9738 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-6b9ce776-2a34-437e-acf1-088d8ced9738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:28:28.220011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:28.221109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:28.222496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:28:28.222496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:28:28.222496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:28:28.222496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:28:28.222496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:28:28.222496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:28:28.222496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:28:28.222496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:28.222496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 613/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:28.227066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9eddd-bc77-4c52-8af2-9c98896cf0d2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:28.329488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9eddd-bc77-4c52-8af2-9c98896cf0d2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:28.352414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:28.364507 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf0ac0-c09f-44a4-9699-9dfc0472895f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:28.365121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf0ac0-c09f-44a4-9699-9dfc0472895f None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:28.365427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf0ac0-c09f-44a4-9699-9dfc0472895f None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:28.365694 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf0ac0-c09f-44a4-9699-9dfc0472895f None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:28.366380 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf0ac0-c09f-44a4-9699-9dfc0472895f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:28.366681 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf0ac0-c09f-44a4-9699-9dfc0472895f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:28.368154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf0ac0-c09f-44a4-9699-9dfc0472895f None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:28.380874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 605/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:28.387037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ce776-2a34-437e-acf1-088d8ced9738 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:28.487539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ce776-2a34-437e-acf1-088d8ced9738 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:28.515119 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:28.520774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8399e-3e16-4483-b786-852cf247759c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:28.521391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8399e-3e16-4483-b786-852cf247759c None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:28.521669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8399e-3e16-4483-b786-852cf247759c None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:28.521937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8399e-3e16-4483-b786-852cf247759c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:28.522652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8399e-3e16-4483-b786-852cf247759c None admin] RBAC: Adding query filter params (role.id=8646bae8724e4a26bb49cd7cb1d39593, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=a4ad954bbb7749ee8861e8da98619006) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:28.522993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8399e-3e16-4483-b786-852cf247759c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:28.524665 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8399e-3e16-4483-b786-852cf247759c None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:28.529816 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 614/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:28:28 2022] GET /identity/v3/role_assignments?user.id=a4ad954bbb7749ee8861e8da98619006&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=8646bae8724e4a26bb49cd7cb1d39593 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:30.383781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c299-dd9a-475b-ac5f-0bf22865df7f None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:30.384336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c299-dd9a-475b-ac5f-0bf22865df7f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:30.384336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c299-dd9a-475b-ac5f-0bf22865df7f None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:30.385608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 606/1220] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:28:30.391409 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a8570-45cb-4fb9-9450-a77f1bcf6269 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:30.391978 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a8570-45cb-4fb9-9450-a77f1bcf6269 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:30.392320 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a8570-45cb-4fb9-9450-a77f1bcf6269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:30.410608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3f7a8570-45cb-4fb9-9450-a77f1bcf6269 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:28:30.411853 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3f7a8570-45cb-4fb9-9450-a77f1bcf6269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:28:30.479071 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 615/1221] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:28:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:28:30.753126 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9c299-dd9a-475b-ac5f-0bf22865df7f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:30.853860 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9c299-dd9a-475b-ac5f-0bf22865df7f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:30.887783 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcce1e3-688d-41be-97fb-317160973497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:30.888430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcce1e3-688d-41be-97fb-317160973497 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:30.888710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcce1e3-688d-41be-97fb-317160973497 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:30.888982 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcce1e3-688d-41be-97fb-317160973497 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:30.899145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcce1e3-688d-41be-97fb-317160973497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3fcce1e3-688d-41be-97fb-317160973497 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:28:30.904385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:30.905563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:30.907279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:30.907279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:30.907279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:30.907279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:30.907279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:28:30.907279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:28:30.907279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:28:30.907279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:28:30.907279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:28:30.907279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:28:30.907279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:28:30.907279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:30.907279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 607/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:28:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:30.912063 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a8570-45cb-4fb9-9450-a77f1bcf6269 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:31.011714 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a8570-45cb-4fb9-9450-a77f1bcf6269 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:31.037600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:31.048022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c74c3-b72a-40a3-b647-b7d950a4e96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:31.048625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c74c3-b72a-40a3-b647-b7d950a4e96e None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:31.048913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c74c3-b72a-40a3-b647-b7d950a4e96e None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:31.049170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c74c3-b72a-40a3-b647-b7d950a4e96e None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:31.049867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c74c3-b72a-40a3-b647-b7d950a4e96e None admin] RBAC: Adding query filter params (name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:31.050171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c74c3-b72a-40a3-b647-b7d950a4e96e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:31.051545 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c74c3-b72a-40a3-b647-b7d950a4e96e None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:31.059639 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 616/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:28:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:31.066119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcce1e3-688d-41be-97fb-317160973497 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:31.109312 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:31.164168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcce1e3-688d-41be-97fb-317160973497 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:31.198323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14991f0-9a53-419c-88a7-82fa4f29de75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:31.198947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14991f0-9a53-419c-88a7-82fa4f29de75 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:31.199232 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14991f0-9a53-419c-88a7-82fa4f29de75 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:31.199506 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14991f0-9a53-419c-88a7-82fa4f29de75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:31.210006 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14991f0-9a53-419c-88a7-82fa4f29de75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:31.211467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14991f0-9a53-419c-88a7-82fa4f29de75 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-c14991f0-9a53-419c-88a7-82fa4f29de75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:28:31.225957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:31.227101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:28:31.228318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:28:31.228318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:31.228318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:31.228318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 608/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:31.232936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c74c3-b72a-40a3-b647-b7d950a4e96e None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:31.333702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c74c3-b72a-40a3-b647-b7d950a4e96e None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:31.367525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc2252-68a3-4a08-b321-c48724cf6589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:31.368121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc2252-68a3-4a08-b321-c48724cf6589 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:31.368400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc2252-68a3-4a08-b321-c48724cf6589 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:31.368673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc2252-68a3-4a08-b321-c48724cf6589 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:31.369358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc2252-68a3-4a08-b321-c48724cf6589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:31.369662 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc2252-68a3-4a08-b321-c48724cf6589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:31.371035 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc2252-68a3-4a08-b321-c48724cf6589 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:31.382494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 617/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:31.388323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14991f0-9a53-419c-88a7-82fa4f29de75 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:31.483567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:31.490446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14991f0-9a53-419c-88a7-82fa4f29de75 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:31.524231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76b921-9641-48c6-9c6f-50ed8d7be3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:31.525165 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76b921-9641-48c6-9c6f-50ed8d7be3ec None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:31.525477 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76b921-9641-48c6-9c6f-50ed8d7be3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:31.525745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76b921-9641-48c6-9c6f-50ed8d7be3ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:31.533371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76b921-9641-48c6-9c6f-50ed8d7be3ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:31.534784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76b921-9641-48c6-9c6f-50ed8d7be3ec None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3d76b921-9641-48c6-9c6f-50ed8d7be3ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:28:31.546546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:31.547850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:31.549350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:31.549350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:31.549350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:28:31.549350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:28:31.549350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:28:31.549350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:28:31.549350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:28:31.549350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:28:31.549350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 04:28:31.549350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:31.549350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 609/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:31.553610 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc2252-68a3-4a08-b321-c48724cf6589 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:31.604470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:31.656928 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc2252-68a3-4a08-b321-c48724cf6589 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:31.690557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e748045-c1b8-4645-9f8f-cbc76dec92ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:31.691141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e748045-c1b8-4645-9f8f-cbc76dec92ef None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:31.691416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e748045-c1b8-4645-9f8f-cbc76dec92ef None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:31.691683 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e748045-c1b8-4645-9f8f-cbc76dec92ef None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:31.692398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e748045-c1b8-4645-9f8f-cbc76dec92ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:31.692698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e748045-c1b8-4645-9f8f-cbc76dec92ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:31.694145 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e748045-c1b8-4645-9f8f-cbc76dec92ef None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:31.712794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 618/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 31 04:28:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:31.718620 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76b921-9641-48c6-9c6f-50ed8d7be3ec None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:31.821671 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76b921-9641-48c6-9c6f-50ed8d7be3ec None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:31.855715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75b2f-2717-4467-aece-ffc833fe1e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:31.856275 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75b2f-2717-4467-aece-ffc833fe1e85 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:31.856551 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75b2f-2717-4467-aece-ffc833fe1e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:31.856821 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75b2f-2717-4467-aece-ffc833fe1e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:31.867887 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa75b2f-2717-4467-aece-ffc833fe1e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:31.869338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa75b2f-2717-4467-aece-ffc833fe1e85 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-5fa75b2f-2717-4467-aece-ffc833fe1e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:28:31.883242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:31.884426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:28:31.885955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:28:31.885955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:31.885955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:31.885955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 610/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:28:31.891649 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e748045-c1b8-4645-9f8f-cbc76dec92ef None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:31.991883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e748045-c1b8-4645-9f8f-cbc76dec92ef None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:31.994228 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:32.025121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d7fe5-4d0e-4ff1-a37b-5d7aea3bd790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:32.026058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d7fe5-4d0e-4ff1-a37b-5d7aea3bd790 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:32.026058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d7fe5-4d0e-4ff1-a37b-5d7aea3bd790 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:32.026306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d7fe5-4d0e-4ff1-a37b-5d7aea3bd790 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:32.026938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d7fe5-4d0e-4ff1-a37b-5d7aea3bd790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:32.027237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d7fe5-4d0e-4ff1-a37b-5d7aea3bd790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:32.028585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d7fe5-4d0e-4ff1-a37b-5d7aea3bd790 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:32.040145 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 619/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:32.046186 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75b2f-2717-4467-aece-ffc833fe1e85 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:32.055881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:32.145013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75b2f-2717-4467-aece-ffc833fe1e85 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:32.177546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310defb-ed34-403b-a710-6f01d6c3ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:32.178158 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310defb-ed34-403b-a710-6f01d6c3ef48 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:32.178429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310defb-ed34-403b-a710-6f01d6c3ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:32.178694 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310defb-ed34-403b-a710-6f01d6c3ef48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:32.185076 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310defb-ed34-403b-a710-6f01d6c3ef48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:32.186529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310defb-ed34-403b-a710-6f01d6c3ef48 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-3310defb-ed34-403b-a710-6f01d6c3ef48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:28:32.198213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:32.199338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:32.200597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:28:32.200597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:28:32.200597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:28:32.200597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:28:32.200597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:28:32.200597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:28:32.200597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:28:32.200597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:32.200597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 611/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:32.205670 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d7fe5-4d0e-4ff1-a37b-5d7aea3bd790 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:32.306903 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d7fe5-4d0e-4ff1-a37b-5d7aea3bd790 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:32.340472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401d59a-413a-4eed-8ce8-2f3e8f264015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:32.341066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401d59a-413a-4eed-8ce8-2f3e8f264015 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:32.341381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401d59a-413a-4eed-8ce8-2f3e8f264015 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:32.341654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401d59a-413a-4eed-8ce8-2f3e8f264015 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:32.342341 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401d59a-413a-4eed-8ce8-2f3e8f264015 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:32.342647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401d59a-413a-4eed-8ce8-2f3e8f264015 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:32.344638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401d59a-413a-4eed-8ce8-2f3e8f264015 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:32.356310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 620/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:32.362594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310defb-ed34-403b-a710-6f01d6c3ef48 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:32.429256 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:32.463592 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310defb-ed34-403b-a710-6f01d6c3ef48 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:32.496855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8cf86-010d-4d9c-a043-9cc2df44889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:32.497490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cf86-010d-4d9c-a043-9cc2df44889d None admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:32.497764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cf86-010d-4d9c-a043-9cc2df44889d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:32.498031 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cf86-010d-4d9c-a043-9cc2df44889d None admin] PATH_INFO: `/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/a4ad954bbb7749ee8861e8da98619006/roles/8646bae8724e4a26bb49cd7cb1d39593` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:32.513304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8cf86-010d-4d9c-a043-9cc2df44889d None admin] RBAC: Authorizing `identity:create_grant(project_id=ff768fb064ce4d53b2e46ea611d3d103, user_id=a4ad954bbb7749ee8861e8da98619006, role_id=8646bae8724e4a26bb49cd7cb1d39593)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:32.514797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8cf86-010d-4d9c-a043-9cc2df44889d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:32.594862 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 612/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:28:32 2022] PUT /identity/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/a4ad954bbb7749ee8861e8da98619006/roles/8646bae8724e4a26bb49cd7cb1d39593 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:28:34.477486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb97c9-46e4-4d36-ad41-482c598ef3ef None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:34.478010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb97c9-46e4-4d36-ad41-482c598ef3ef None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:34.478010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb97c9-46e4-4d36-ad41-482c598ef3ef None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:34.479342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 621/1233] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:28:34.485001 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a3b6e-4c36-401a-8a9e-a328ff301c74 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:34.485451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a3b6e-4c36-401a-8a9e-a328ff301c74 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:34.485586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a3b6e-4c36-401a-8a9e-a328ff301c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:34.503821 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-dc7a3b6e-4c36-401a-8a9e-a328ff301c74 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:28:34.505022 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dc7a3b6e-4c36-401a-8a9e-a328ff301c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:28:34.570544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 613/1234] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:28:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:28:34.857295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb97c9-46e4-4d36-ad41-482c598ef3ef None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:34.884841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:34.965069 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb97c9-46e4-4d36-ad41-482c598ef3ef None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:34.999909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223b519-d0b6-4e7a-aea7-2746ca169a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:35.000556 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223b519-d0b6-4e7a-aea7-2746ca169a09 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:35.000833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223b519-d0b6-4e7a-aea7-2746ca169a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:35.001102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223b519-d0b6-4e7a-aea7-2746ca169a09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:35.011056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223b519-d0b6-4e7a-aea7-2746ca169a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-f223b519-d0b6-4e7a-aea7-2746ca169a09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:28:35.016423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:35.017616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:35.018880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:35.018880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:35.018880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:35.018880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:35.018880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:28:35.018880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:28:35.018880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:28:35.018880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:28:35.018880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:28:35.018880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:28:35.018880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 04:28:35.018880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:35.018880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 622/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 31 04:28:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:35.023523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a3b6e-4c36-401a-8a9e-a328ff301c74 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:35.070189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:35.128429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a3b6e-4c36-401a-8a9e-a328ff301c74 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:35.161992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785b47b-f56d-4582-a1e9-aa85d38bf279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:35.162595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785b47b-f56d-4582-a1e9-aa85d38bf279 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:35.162867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785b47b-f56d-4582-a1e9-aa85d38bf279 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:35.163135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785b47b-f56d-4582-a1e9-aa85d38bf279 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:35.163787 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785b47b-f56d-4582-a1e9-aa85d38bf279 None admin] RBAC: Adding query filter params (name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:35.164081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785b47b-f56d-4582-a1e9-aa85d38bf279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:35.165574 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785b47b-f56d-4582-a1e9-aa85d38bf279 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:35.178036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 614/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 31 04:28:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:35.187690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223b519-d0b6-4e7a-aea7-2746ca169a09 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:35.265458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:35.285791 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223b519-d0b6-4e7a-aea7-2746ca169a09 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:35.319931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc7dfa-08ab-41fb-a8d0-7230fd6903dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:35.320562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc7dfa-08ab-41fb-a8d0-7230fd6903dd None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:35.320838 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc7dfa-08ab-41fb-a8d0-7230fd6903dd None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:35.321110 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc7dfa-08ab-41fb-a8d0-7230fd6903dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:35.331805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc7dfa-08ab-41fb-a8d0-7230fd6903dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:35.333278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc7dfa-08ab-41fb-a8d0-7230fd6903dd None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-64cc7dfa-08ab-41fb-a8d0-7230fd6903dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:28:35.349523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:35.358500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:28:35.360036 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:28:35.360036 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:35.360036 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:35.360036 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 623/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:35.360421 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785b47b-f56d-4582-a1e9-aa85d38bf279 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:35.471216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785b47b-f56d-4582-a1e9-aa85d38bf279 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:35.481378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:35.507637 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eab79b-53b8-4f27-8d12-0a0e2dcc2516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:35.508265 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab79b-53b8-4f27-8d12-0a0e2dcc2516 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:35.508511 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab79b-53b8-4f27-8d12-0a0e2dcc2516 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:35.508811 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab79b-53b8-4f27-8d12-0a0e2dcc2516 None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:35.509489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eab79b-53b8-4f27-8d12-0a0e2dcc2516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:35.509796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eab79b-53b8-4f27-8d12-0a0e2dcc2516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:35.511148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eab79b-53b8-4f27-8d12-0a0e2dcc2516 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:35.523300 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 615/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:35.529310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc7dfa-08ab-41fb-a8d0-7230fd6903dd None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:35.636273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc7dfa-08ab-41fb-a8d0-7230fd6903dd None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:35.674544 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5145c-a465-4305-9c39-b6e023e338b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:35.675167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5145c-a465-4305-9c39-b6e023e338b7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:35.675442 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5145c-a465-4305-9c39-b6e023e338b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:35.675713 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5145c-a465-4305-9c39-b6e023e338b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:35.678356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:35.683260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5145c-a465-4305-9c39-b6e023e338b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:35.684720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5145c-a465-4305-9c39-b6e023e338b7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-6df5145c-a465-4305-9c39-b6e023e338b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:28:35.696397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:35.702301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:35.703985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:35.703985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:35.703985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:28:35.703985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:28:35.703985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:28:35.703985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:28:35.703985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:28:35.703985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:28:35.703985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 04:28:35.703985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:35.703985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 624/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:35.704627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eab79b-53b8-4f27-8d12-0a0e2dcc2516 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:35.803139 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eab79b-53b8-4f27-8d12-0a0e2dcc2516 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:35.836602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ac380-d0fd-49c1-bb2a-b97b91c9548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:35.837219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac380-d0fd-49c1-bb2a-b97b91c9548a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:35.837504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac380-d0fd-49c1-bb2a-b97b91c9548a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:35.837774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac380-d0fd-49c1-bb2a-b97b91c9548a None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:35.838580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ac380-d0fd-49c1-bb2a-b97b91c9548a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:35.838878 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ac380-d0fd-49c1-bb2a-b97b91c9548a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:35.840292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ac380-d0fd-49c1-bb2a-b97b91c9548a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:35.857613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 616/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 31 04:28:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:35.864459 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5145c-a465-4305-9c39-b6e023e338b7 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:35.967180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5145c-a465-4305-9c39-b6e023e338b7 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:36.002502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf71a87-499a-43a6-bb39-a20b112bc769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:36.003096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf71a87-499a-43a6-bb39-a20b112bc769 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:36.003374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf71a87-499a-43a6-bb39-a20b112bc769 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:36.003646 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf71a87-499a-43a6-bb39-a20b112bc769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:36.065681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:36.072084 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf71a87-499a-43a6-bb39-a20b112bc769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:36.073571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf71a87-499a-43a6-bb39-a20b112bc769 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:36.172674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 625/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:28:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:28:36.178881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ac380-d0fd-49c1-bb2a-b97b91c9548a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:36.205666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:36.279044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ac380-d0fd-49c1-bb2a-b97b91c9548a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:36.312528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b2f34-99c0-4f93-adaa-506203c2a243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:36.313177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b2f34-99c0-4f93-adaa-506203c2a243 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:36.313521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b2f34-99c0-4f93-adaa-506203c2a243 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:36.313790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b2f34-99c0-4f93-adaa-506203c2a243 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:36.323377 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b2f34-99c0-4f93-adaa-506203c2a243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:36.324801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b2f34-99c0-4f93-adaa-506203c2a243 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-b62b2f34-99c0-4f93-adaa-506203c2a243 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:28:36.340028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:36.341222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:28:36.342500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:28:36.342500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:36.342500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:36.342500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 617/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:36.347826 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf71a87-499a-43a6-bb39-a20b112bc769 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:36.441337 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:36.447047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf71a87-499a-43a6-bb39-a20b112bc769 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:36.480796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10727a-7218-4dce-b755-b3c835ebd6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:36.481420 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10727a-7218-4dce-b755-b3c835ebd6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:36.481698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10727a-7218-4dce-b755-b3c835ebd6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:36.481970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10727a-7218-4dce-b755-b3c835ebd6a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:36.482605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10727a-7218-4dce-b755-b3c835ebd6a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:36.482907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10727a-7218-4dce-b755-b3c835ebd6a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:36.484263 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10727a-7218-4dce-b755-b3c835ebd6a5 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:36.496972 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 626/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:36.502801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b2f34-99c0-4f93-adaa-506203c2a243 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:36.583602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:36.605083 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b2f34-99c0-4f93-adaa-506203c2a243 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:36.637365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09144e3e-26f6-4d3a-bc85-db783ff1aed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:36.637983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09144e3e-26f6-4d3a-bc85-db783ff1aed6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:36.638261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09144e3e-26f6-4d3a-bc85-db783ff1aed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:36.638534 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09144e3e-26f6-4d3a-bc85-db783ff1aed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:36.646616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09144e3e-26f6-4d3a-bc85-db783ff1aed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:36.653278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09144e3e-26f6-4d3a-bc85-db783ff1aed6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-09144e3e-26f6-4d3a-bc85-db783ff1aed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:28:36.660171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:36.661270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:36.662407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:28:36.662407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:28:36.662407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:28:36.662407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:28:36.662407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:28:36.662407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:28:36.662407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:28:36.662407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:36.662407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 618/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:28:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:36.667257 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10727a-7218-4dce-b755-b3c835ebd6a5 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:36.773143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10727a-7218-4dce-b755-b3c835ebd6a5 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:36.806285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1860c-0816-4ee5-a9e3-d70e79b30b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:36.806874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1860c-0816-4ee5-a9e3-d70e79b30b96 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:36.807148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1860c-0816-4ee5-a9e3-d70e79b30b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:36.807415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1860c-0816-4ee5-a9e3-d70e79b30b96 None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:36.808093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1860c-0816-4ee5-a9e3-d70e79b30b96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:36.808393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1860c-0816-4ee5-a9e3-d70e79b30b96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:36.809912 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1860c-0816-4ee5-a9e3-d70e79b30b96 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:36.821691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 627/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:28:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:36.827971 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09144e3e-26f6-4d3a-bc85-db783ff1aed6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:36.926652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09144e3e-26f6-4d3a-bc85-db783ff1aed6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:36.960838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c03ea8-d113-4d3a-8a69-1fb57665b506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:36.962214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c03ea8-d113-4d3a-8a69-1fb57665b506 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:36.962497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c03ea8-d113-4d3a-8a69-1fb57665b506 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:36.962765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c03ea8-d113-4d3a-8a69-1fb57665b506 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:36.963480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c03ea8-d113-4d3a-8a69-1fb57665b506 None admin] RBAC: Adding query filter params (role.id=8646bae8724e4a26bb49cd7cb1d39593, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=a4ad954bbb7749ee8861e8da98619006) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:36.963783 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c03ea8-d113-4d3a-8a69-1fb57665b506 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:36.965282 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c03ea8-d113-4d3a-8a69-1fb57665b506 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:36.971489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 619/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:28:36 2022] GET /identity/v3/role_assignments?user.id=a4ad954bbb7749ee8861e8da98619006&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=8646bae8724e4a26bb49cd7cb1d39593 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:38.899344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4ee0-32cf-406b-8b3c-6c6a970168e4 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:38.900177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4ee0-32cf-406b-8b3c-6c6a970168e4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:38.900177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4ee0-32cf-406b-8b3c-6c6a970168e4 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:38.901569 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 628/1247] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:28:38.907606 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c73df3-8624-4473-aa1f-1d42f0106459 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:38.908044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c73df3-8624-4473-aa1f-1d42f0106459 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:38.908145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c73df3-8624-4473-aa1f-1d42f0106459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:38.914624 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:38.927011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-66c73df3-8624-4473-aa1f-1d42f0106459 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:28:38.928201 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-66c73df3-8624-4473-aa1f-1d42f0106459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:28:39.001022 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 620/1248] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:28:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:28:39.277303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb4ee0-32cf-406b-8b3c-6c6a970168e4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:39.295433 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:39.389811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb4ee0-32cf-406b-8b3c-6c6a970168e4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:39.426737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f280665-d91b-40c8-83d4-25e1b7d1c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:39.427346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280665-d91b-40c8-83d4-25e1b7d1c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:39.427622 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280665-d91b-40c8-83d4-25e1b7d1c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:39.427892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f280665-d91b-40c8-83d4-25e1b7d1c6e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:39.438210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f280665-d91b-40c8-83d4-25e1b7d1c6e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-2f280665-d91b-40c8-83d4-25e1b7d1c6e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:28:39.443066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:39.444191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:39.445460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:39.445460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:39.445460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:39.445460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:39.445460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:28:39.445460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:28:39.445460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:28:39.445460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:28:39.445460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:28:39.445460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:28:39.445460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:28:39.445460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:39.445460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 629/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:28:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:39.450266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c73df3-8624-4473-aa1f-1d42f0106459 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:39.549080 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c73df3-8624-4473-aa1f-1d42f0106459 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:39.577718 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:39.582948 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe3029-e172-4592-9a9f-070f8493dceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:39.583554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe3029-e172-4592-9a9f-070f8493dceb None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:39.583853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe3029-e172-4592-9a9f-070f8493dceb None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:39.584125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe3029-e172-4592-9a9f-070f8493dceb None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:39.584784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe3029-e172-4592-9a9f-070f8493dceb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:39.585086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe3029-e172-4592-9a9f-070f8493dceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:39.586564 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe3029-e172-4592-9a9f-070f8493dceb None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:39.595092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 621/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:28:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:39.600977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f280665-d91b-40c8-83d4-25e1b7d1c6e0 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:39.680957 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:39.704391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f280665-d91b-40c8-83d4-25e1b7d1c6e0 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:39.738716 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bd554-fa70-46bc-930e-2db41d294223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:39.739347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bd554-fa70-46bc-930e-2db41d294223 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:39.739692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bd554-fa70-46bc-930e-2db41d294223 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:39.740025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bd554-fa70-46bc-930e-2db41d294223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:39.749780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bd554-fa70-46bc-930e-2db41d294223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:39.751831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bd554-fa70-46bc-930e-2db41d294223 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-554bd554-fa70-46bc-930e-2db41d294223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:28:39.768039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:39.770503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:28:39.771435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:28:39.771435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:39.771435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:39.771435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 630/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:39.776060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe3029-e172-4592-9a9f-070f8493dceb None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:39.873992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe3029-e172-4592-9a9f-070f8493dceb None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:39.907541 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb554f3-48e2-4af9-a63b-7b083f1fb43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:39.908140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb554f3-48e2-4af9-a63b-7b083f1fb43a None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:39.908722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb554f3-48e2-4af9-a63b-7b083f1fb43a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:39.908722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb554f3-48e2-4af9-a63b-7b083f1fb43a None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:39.909323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb554f3-48e2-4af9-a63b-7b083f1fb43a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:39.909627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb554f3-48e2-4af9-a63b-7b083f1fb43a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:39.910981 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb554f3-48e2-4af9-a63b-7b083f1fb43a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:39.923649 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 622/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:39.929510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bd554-fa70-46bc-930e-2db41d294223 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:40.027305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bd554-fa70-46bc-930e-2db41d294223 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:40.055032 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:40.062761 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9df9c0-506f-4db9-96fc-a6efdb948fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:40.063380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df9c0-506f-4db9-96fc-a6efdb948fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:40.063650 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df9c0-506f-4db9-96fc-a6efdb948fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:40.066229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df9c0-506f-4db9-96fc-a6efdb948fc4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:40.071457 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9df9c0-506f-4db9-96fc-a6efdb948fc4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:40.072931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9df9c0-506f-4db9-96fc-a6efdb948fc4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-cc9df9c0-506f-4db9-96fc-a6efdb948fc4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:28:40.084062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:40.085051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:40.086332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:40.086332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:40.086332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:28:40.086332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:28:40.086332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:28:40.086332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:28:40.086332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:28:40.086332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:28:40.086332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 04:28:40.086332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:40.086332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 631/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:40.091039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb554f3-48e2-4af9-a63b-7b083f1fb43a None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:40.146743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:40.191308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb554f3-48e2-4af9-a63b-7b083f1fb43a None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:40.224566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176f6cd-7cdd-4cb8-8e18-b7a11fe7f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:40.225161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176f6cd-7cdd-4cb8-8e18-b7a11fe7f576 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:40.225466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176f6cd-7cdd-4cb8-8e18-b7a11fe7f576 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:40.225734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176f6cd-7cdd-4cb8-8e18-b7a11fe7f576 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:40.226444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176f6cd-7cdd-4cb8-8e18-b7a11fe7f576 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:40.226746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176f6cd-7cdd-4cb8-8e18-b7a11fe7f576 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:40.228252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176f6cd-7cdd-4cb8-8e18-b7a11fe7f576 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:40.245480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 623/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 31 04:28:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:40.251528 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9df9c0-506f-4db9-96fc-a6efdb948fc4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:40.353802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9df9c0-506f-4db9-96fc-a6efdb948fc4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:40.388281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd29edd-3260-417f-a42a-e203970381a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:40.388883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29edd-3260-417f-a42a-e203970381a4 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:40.389159 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29edd-3260-417f-a42a-e203970381a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:40.389456 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29edd-3260-417f-a42a-e203970381a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:40.445576 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:40.457964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd29edd-3260-417f-a42a-e203970381a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:40.459405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd29edd-3260-417f-a42a-e203970381a4 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:40.556914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 632/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:28:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:28:40.562703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176f6cd-7cdd-4cb8-8e18-b7a11fe7f576 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:40.659426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176f6cd-7cdd-4cb8-8e18-b7a11fe7f576 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:40.672245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:40.692255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c69b5-5ff0-4a3a-8dbc-b64a2909e5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:40.692868 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c69b5-5ff0-4a3a-8dbc-b64a2909e5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:40.693140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c69b5-5ff0-4a3a-8dbc-b64a2909e5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:40.693432 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c69b5-5ff0-4a3a-8dbc-b64a2909e5d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:40.706656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c69b5-5ff0-4a3a-8dbc-b64a2909e5d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:40.706656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c69b5-5ff0-4a3a-8dbc-b64a2909e5d2 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-370c69b5-5ff0-4a3a-8dbc-b64a2909e5d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:28:40.719556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:40.720653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:28:40.721746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:28:40.721746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:40.721746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:40.721746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 624/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:40.726375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd29edd-3260-417f-a42a-e203970381a4 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:40.813816 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:40.825481 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd29edd-3260-417f-a42a-e203970381a4 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:40.859024 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe750e9-7d4b-49a3-9b67-c500c98e8d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:40.860232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe750e9-7d4b-49a3-9b67-c500c98e8d0b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:40.860501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe750e9-7d4b-49a3-9b67-c500c98e8d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:40.860769 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe750e9-7d4b-49a3-9b67-c500c98e8d0b None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:40.861434 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe750e9-7d4b-49a3-9b67-c500c98e8d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:40.861774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe750e9-7d4b-49a3-9b67-c500c98e8d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:40.868202 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe750e9-7d4b-49a3-9b67-c500c98e8d0b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:40.874200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 633/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:40.880016 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c69b5-5ff0-4a3a-8dbc-b64a2909e5d2 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:40.979051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c69b5-5ff0-4a3a-8dbc-b64a2909e5d2 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:41.012766 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a272e17-c567-49fd-a2a8-e42003470875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:41.013402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a272e17-c567-49fd-a2a8-e42003470875 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:41.013678 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a272e17-c567-49fd-a2a8-e42003470875 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:41.013943 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a272e17-c567-49fd-a2a8-e42003470875 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:41.021272 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a272e17-c567-49fd-a2a8-e42003470875 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:41.022686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a272e17-c567-49fd-a2a8-e42003470875 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-4a272e17-c567-49fd-a2a8-e42003470875 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:28:41.034872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:41.035968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:41.037089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:28:41.037089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:28:41.037089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:28:41.037089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:28:41.037089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:28:41.037089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:28:41.037089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:28:41.037089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:41.037089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 625/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:28:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:41.041882 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe750e9-7d4b-49a3-9b67-c500c98e8d0b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:41.143926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe750e9-7d4b-49a3-9b67-c500c98e8d0b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:41.178181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af967a3-8091-4a95-9327-4db899f5994d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:41.178783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af967a3-8091-4a95-9327-4db899f5994d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:41.179057 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af967a3-8091-4a95-9327-4db899f5994d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:41.179326 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af967a3-8091-4a95-9327-4db899f5994d None admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:41.180014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af967a3-8091-4a95-9327-4db899f5994d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:41.180367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af967a3-8091-4a95-9327-4db899f5994d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:41.181877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af967a3-8091-4a95-9327-4db899f5994d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:41.194776 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 634/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:28:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:41.201127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a272e17-c567-49fd-a2a8-e42003470875 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:41.226452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:41.300976 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a272e17-c567-49fd-a2a8-e42003470875 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:41.335593 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d255b-6321-4b47-8c6d-c0f69dd35043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:41.336190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d255b-6321-4b47-8c6d-c0f69dd35043 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:41.336467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d255b-6321-4b47-8c6d-c0f69dd35043 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:41.336739 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d255b-6321-4b47-8c6d-c0f69dd35043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:41.337482 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d255b-6321-4b47-8c6d-c0f69dd35043 None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=a4ad954bbb7749ee8861e8da98619006) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:41.337786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d255b-6321-4b47-8c6d-c0f69dd35043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:41.339195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d255b-6321-4b47-8c6d-c0f69dd35043 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:41.345436 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 626/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:28:41 2022] GET /identity/v3/role_assignments?user.id=a4ad954bbb7749ee8861e8da98619006&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=1896db68dc754d5293037ab100ce46d9 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:43.244945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebfc40-a0dc-471b-b6e8-fba84b0c64d6 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:43.245562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebfc40-a0dc-471b-b6e8-fba84b0c64d6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:43.245562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebfc40-a0dc-471b-b6e8-fba84b0c64d6 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:43.246815 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 635/1261] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:28:43.252502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a3221-2fc6-44db-ace9-7c3798c59d2d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:43.252965 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a3221-2fc6-44db-ace9-7c3798c59d2d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:43.253072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a3221-2fc6-44db-ace9-7c3798c59d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:43.271656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a66a3221-2fc6-44db-ace9-7c3798c59d2d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:28:43.272837 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a66a3221-2fc6-44db-ace9-7c3798c59d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:28:43.343481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 627/1262] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:28:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:28:43.618279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebfc40-a0dc-471b-b6e8-fba84b0c64d6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:43.636326 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:43.729310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebfc40-a0dc-471b-b6e8-fba84b0c64d6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:43.763987 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1ce92-3d3c-4818-bc2f-eac7ebaee096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:43.764600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1ce92-3d3c-4818-bc2f-eac7ebaee096 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:43.764932 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1ce92-3d3c-4818-bc2f-eac7ebaee096 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:43.765288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1ce92-3d3c-4818-bc2f-eac7ebaee096 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:43.775846 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1ce92-3d3c-4818-bc2f-eac7ebaee096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-61e1ce92-3d3c-4818-bc2f-eac7ebaee096 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:28:43.780793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:43.782937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:43.784055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:43.784055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:43.784055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:43.784055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:43.784055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:28:43.784055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:28:43.784055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:28:43.784055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:28:43.784055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:28:43.784055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:28:43.784055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:28:43.784055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:43.784055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 636/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:43.788595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a3221-2fc6-44db-ace9-7c3798c59d2d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:43.807276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:43.885152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a3221-2fc6-44db-ace9-7c3798c59d2d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:43.918815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10567ac-ee04-4478-b194-37d000bd5037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:43.919426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10567ac-ee04-4478-b194-37d000bd5037 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:43.919713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10567ac-ee04-4478-b194-37d000bd5037 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:43.920241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10567ac-ee04-4478-b194-37d000bd5037 None admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:43.921079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10567ac-ee04-4478-b194-37d000bd5037 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:43.922749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10567ac-ee04-4478-b194-37d000bd5037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:43.924131 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10567ac-ee04-4478-b194-37d000bd5037 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:43.932213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 628/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:28:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:43.938008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1ce92-3d3c-4818-bc2f-eac7ebaee096 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:44.004960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:44.038684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1ce92-3d3c-4818-bc2f-eac7ebaee096 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:44.071348 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57369b79-105f-47bc-a292-fd45198deb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:44.071972 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369b79-105f-47bc-a292-fd45198deb4a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:44.072246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369b79-105f-47bc-a292-fd45198deb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:44.072513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369b79-105f-47bc-a292-fd45198deb4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:44.084540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57369b79-105f-47bc-a292-fd45198deb4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:44.086011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57369b79-105f-47bc-a292-fd45198deb4a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-57369b79-105f-47bc-a292-fd45198deb4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:28:44.101982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:44.103174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:28:44.104159 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:28:44.104159 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:44.104159 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:44.104159 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 637/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:44.108874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10567ac-ee04-4478-b194-37d000bd5037 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:44.188875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:44.207461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10567ac-ee04-4478-b194-37d000bd5037 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:44.240722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90242697-0a1b-403e-8ed0-62f7b92fb3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:44.241414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242697-0a1b-403e-8ed0-62f7b92fb3fa None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:44.241687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242697-0a1b-403e-8ed0-62f7b92fb3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:44.241955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242697-0a1b-403e-8ed0-62f7b92fb3fa None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:44.242587 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90242697-0a1b-403e-8ed0-62f7b92fb3fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:44.242885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90242697-0a1b-403e-8ed0-62f7b92fb3fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:44.244232 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90242697-0a1b-403e-8ed0-62f7b92fb3fa None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:44.255651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 629/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:44.261448 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57369b79-105f-47bc-a292-fd45198deb4a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:44.364049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57369b79-105f-47bc-a292-fd45198deb4a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:44.383904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:44.398233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219692b0-9d17-4616-93ee-36f393cb97bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:44.398851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219692b0-9d17-4616-93ee-36f393cb97bf None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:44.399130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219692b0-9d17-4616-93ee-36f393cb97bf None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:44.399403 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219692b0-9d17-4616-93ee-36f393cb97bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:44.407070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219692b0-9d17-4616-93ee-36f393cb97bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:44.408545 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219692b0-9d17-4616-93ee-36f393cb97bf None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-219692b0-9d17-4616-93ee-36f393cb97bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:28:44.419703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:44.425644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:44.426851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:44.426851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:44.426851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:28:44.426851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:28:44.426851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:28:44.426851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:28:44.426851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:28:44.426851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:28:44.426851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 04:28:44.426851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:44.426851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 638/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 04:28:44.427608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90242697-0a1b-403e-8ed0-62f7b92fb3fa None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:44.529021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90242697-0a1b-403e-8ed0-62f7b92fb3fa None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:44.562226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c5bd1-619e-43c6-89f5-38cdc548b125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:44.563372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c5bd1-619e-43c6-89f5-38cdc548b125 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:44.563718 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c5bd1-619e-43c6-89f5-38cdc548b125 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:44.563909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c5bd1-619e-43c6-89f5-38cdc548b125 None admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:44.564613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c5bd1-619e-43c6-89f5-38cdc548b125 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:44.564911 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c5bd1-619e-43c6-89f5-38cdc548b125 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:44.566342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c5bd1-619e-43c6-89f5-38cdc548b125 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:44.575156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:44.584012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 630/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 31 04:28:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:28:44.589833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219692b0-9d17-4616-93ee-36f393cb97bf None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:44.690363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219692b0-9d17-4616-93ee-36f393cb97bf None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:44.724018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d83c8-0b99-4343-a057-ca3be00b20a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:44.724629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d83c8-0b99-4343-a057-ca3be00b20a7 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:44.724900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d83c8-0b99-4343-a057-ca3be00b20a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:44.725165 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d83c8-0b99-4343-a057-ca3be00b20a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:44.735870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d83c8-0b99-4343-a057-ca3be00b20a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:44.737324 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d83c8-0b99-4343-a057-ca3be00b20a7 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-d82d83c8-0b99-4343-a057-ca3be00b20a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:28:44.751273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:44.752383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:28:44.753536 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:28:44.753536 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:44.753536 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:44.753536 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 639/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:44.758382 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c5bd1-619e-43c6-89f5-38cdc548b125 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:44.856148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c5bd1-619e-43c6-89f5-38cdc548b125 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:44.891192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534aa1-5df7-4e75-8c7d-54de9cac929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:44.891785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534aa1-5df7-4e75-8c7d-54de9cac929c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:44.892061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534aa1-5df7-4e75-8c7d-54de9cac929c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:44.892327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534aa1-5df7-4e75-8c7d-54de9cac929c None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:44.892956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da534aa1-5df7-4e75-8c7d-54de9cac929c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:44.893281 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da534aa1-5df7-4e75-8c7d-54de9cac929c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:44.894620 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da534aa1-5df7-4e75-8c7d-54de9cac929c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:44.905782 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 631/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:28:44.911571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d83c8-0b99-4343-a057-ca3be00b20a7 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:44.944515 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:45.012589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d83c8-0b99-4343-a057-ca3be00b20a7 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:45.045834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56fbe-c5c4-42b7-8978-c69f84e3ffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:45.046445 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56fbe-c5c4-42b7-8978-c69f84e3ffd6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:45.047245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56fbe-c5c4-42b7-8978-c69f84e3ffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:45.047594 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56fbe-c5c4-42b7-8978-c69f84e3ffd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:45.058926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec56fbe-c5c4-42b7-8978-c69f84e3ffd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:45.058926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec56fbe-c5c4-42b7-8978-c69f84e3ffd6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-eec56fbe-c5c4-42b7-8978-c69f84e3ffd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:28:45.067858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:45.068819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:45.070184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:28:45.070184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:28:45.070184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:28:45.070184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:28:45.070184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:28:45.070184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:28:45.070184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:28:45.070184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:45.070184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 640/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:28:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:45.074805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534aa1-5df7-4e75-8c7d-54de9cac929c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:45.134181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:45.176587 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534aa1-5df7-4e75-8c7d-54de9cac929c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:45.208584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2a52e-0c61-4ca9-b268-0ad083815a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:45.209176 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2a52e-0c61-4ca9-b268-0ad083815a81 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:45.209476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2a52e-0c61-4ca9-b268-0ad083815a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:45.209783 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2a52e-0c61-4ca9-b268-0ad083815a81 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:45.210427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2a52e-0c61-4ca9-b268-0ad083815a81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:45.210729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2a52e-0c61-4ca9-b268-0ad083815a81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:45.212123 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2a52e-0c61-4ca9-b268-0ad083815a81 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:45.224372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 632/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:45.230418 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56fbe-c5c4-42b7-8978-c69f84e3ffd6 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:45.321626 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:45.330536 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56fbe-c5c4-42b7-8978-c69f84e3ffd6 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:45.365467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa0d3d-cc9d-4fa6-ae1d-b01c016eacb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:45.366112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa0d3d-cc9d-4fa6-ae1d-b01c016eacb6 None admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:45.366389 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa0d3d-cc9d-4fa6-ae1d-b01c016eacb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:45.366660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa0d3d-cc9d-4fa6-ae1d-b01c016eacb6 None admin] PATH_INFO: `/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/a4ad954bbb7749ee8861e8da98619006/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:45.368557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa0d3d-cc9d-4fa6-ae1d-b01c016eacb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff768fb064ce4d53b2e46ea611d3d103, user_id=a4ad954bbb7749ee8861e8da98619006, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:45.370008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa0d3d-cc9d-4fa6-ae1d-b01c016eacb6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:45.423739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 641/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 31 04:28:45 2022] PUT /identity/v3/projects/ff768fb064ce4d53b2e46ea611d3d103/users/a4ad954bbb7749ee8861e8da98619006/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:28:47.305782 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d96ed2-d789-4e5b-8696-4815cd79df82 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:47.306295 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d96ed2-d789-4e5b-8696-4815cd79df82 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:47.306295 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d96ed2-d789-4e5b-8696-4815cd79df82 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:47.307735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 633/1274] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:28:47.313629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182dfd5-3bdf-401e-9076-a2cc390d95c0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:47.314172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182dfd5-3bdf-401e-9076-a2cc390d95c0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:47.314172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182dfd5-3bdf-401e-9076-a2cc390d95c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:47.334274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f182dfd5-3bdf-401e-9076-a2cc390d95c0 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:28:47.335495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f182dfd5-3bdf-401e-9076-a2cc390d95c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:28:47.408170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 642/1275] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:28:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:28:47.675990 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d96ed2-d789-4e5b-8696-4815cd79df82 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:47.777217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d96ed2-d789-4e5b-8696-4815cd79df82 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:47.794707 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:47.810935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad69fae-4f25-4a2c-ba54-f3b982411d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:47.811558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad69fae-4f25-4a2c-ba54-f3b982411d23 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:47.811837 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad69fae-4f25-4a2c-ba54-f3b982411d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:47.812109 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad69fae-4f25-4a2c-ba54-f3b982411d23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:47.822152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad69fae-4f25-4a2c-ba54-f3b982411d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-fad69fae-4f25-4a2c-ba54-f3b982411d23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 04:28:47.827259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:47.833618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:47.834706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:47.834706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:47.834706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:47.834706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:47.834706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 04:28:47.834706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 04:28:47.834706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 04:28:47.834706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 04:28:47.834706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 04:28:47.834706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 04:28:47.834706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 04:28:47.834706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:47.834706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 634/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 31 04:28:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:47.835595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182dfd5-3bdf-401e-9076-a2cc390d95c0 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:47.917116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:47.935002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182dfd5-3bdf-401e-9076-a2cc390d95c0 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:47.970629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa1e07-98b8-40fe-bd51-44d58bc79b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:47.971224 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1e07-98b8-40fe-bd51-44d58bc79b7f None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:47.971504 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1e07-98b8-40fe-bd51-44d58bc79b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:47.971794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1e07-98b8-40fe-bd51-44d58bc79b7f None admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:47.972440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa1e07-98b8-40fe-bd51-44d58bc79b7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:47.972727 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa1e07-98b8-40fe-bd51-44d58bc79b7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:47.974114 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa1e07-98b8-40fe-bd51-44d58bc79b7f None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:47.982938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 643/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 31 04:28:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:47.988785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad69fae-4f25-4a2c-ba54-f3b982411d23 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:48.088923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad69fae-4f25-4a2c-ba54-f3b982411d23 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:48.122462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed9511-7eca-45f3-b7b7-e57c6e7666f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:48.123084 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed9511-7eca-45f3-b7b7-e57c6e7666f6 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:48.123363 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed9511-7eca-45f3-b7b7-e57c6e7666f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:48.123638 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed9511-7eca-45f3-b7b7-e57c6e7666f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:48.133927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed9511-7eca-45f3-b7b7-e57c6e7666f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:48.135372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed9511-7eca-45f3-b7b7-e57c6e7666f6 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-aeed9511-7eca-45f3-b7b7-e57c6e7666f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:28:48.150935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:48.151859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:28:48.152824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:28:48.152824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:48.152824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:48.152824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 635/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:48.158642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa1e07-98b8-40fe-bd51-44d58bc79b7f None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:48.257861 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa1e07-98b8-40fe-bd51-44d58bc79b7f None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:48.291258 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c2262-94e8-420a-bd9e-705ce13dc7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:48.291851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c2262-94e8-420a-bd9e-705ce13dc7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:48.292130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c2262-94e8-420a-bd9e-705ce13dc7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:48.292404 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c2262-94e8-420a-bd9e-705ce13dc7d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:48.293052 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c2262-94e8-420a-bd9e-705ce13dc7d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:48.293379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c2262-94e8-420a-bd9e-705ce13dc7d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:48.294738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c2262-94e8-420a-bd9e-705ce13dc7d2 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:48.307150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 644/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:48.312928 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed9511-7eca-45f3-b7b7-e57c6e7666f6 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:48.342974 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:48.411164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed9511-7eca-45f3-b7b7-e57c6e7666f6 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:48.444903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11156176-b4f7-4847-85c3-f6b70af9cb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:48.445562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11156176-b4f7-4847-85c3-f6b70af9cb60 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:48.445839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11156176-b4f7-4847-85c3-f6b70af9cb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:48.446115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11156176-b4f7-4847-85c3-f6b70af9cb60 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:48.452918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11156176-b4f7-4847-85c3-f6b70af9cb60 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:48.454405 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11156176-b4f7-4847-85c3-f6b70af9cb60 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-11156176-b4f7-4847-85c3-f6b70af9cb60 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 04:28:48.465643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:48.466849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:48.468166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:48.468166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:48.468166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 04:28:48.468166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 04:28:48.468166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 04:28:48.468166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 04:28:48.468166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 04:28:48.468166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 04:28:48.468166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 04:28:48.468166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:48.468166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 636/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:48.473125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c2262-94e8-420a-bd9e-705ce13dc7d2 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:48.476951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:48.572909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c2262-94e8-420a-bd9e-705ce13dc7d2 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:48.607360 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d4ab6-000d-496f-bbba-c5a3c1be634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:48.607931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d4ab6-000d-496f-bbba-c5a3c1be634a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:48.608206 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d4ab6-000d-496f-bbba-c5a3c1be634a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:48.608474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d4ab6-000d-496f-bbba-c5a3c1be634a None admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:48.609232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d4ab6-000d-496f-bbba-c5a3c1be634a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:48.609724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d4ab6-000d-496f-bbba-c5a3c1be634a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:48.611371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d4ab6-000d-496f-bbba-c5a3c1be634a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:48.628294 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 645/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 31 04:28:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:48.634089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11156176-b4f7-4847-85c3-f6b70af9cb60 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:48.728478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:48.738373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11156176-b4f7-4847-85c3-f6b70af9cb60 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:48.770826 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8578de-4c15-4373-a840-1ead68e6a385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:48.771418 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8578de-4c15-4373-a840-1ead68e6a385 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:48.771688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8578de-4c15-4373-a840-1ead68e6a385 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:48.771955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8578de-4c15-4373-a840-1ead68e6a385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:48.838935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8578de-4c15-4373-a840-1ead68e6a385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:48.840300 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8578de-4c15-4373-a840-1ead68e6a385 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:48.929437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:48.940395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 637/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 31 04:28:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 04:28:48.946215 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d4ab6-000d-496f-bbba-c5a3c1be634a None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:49.007502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:49.044666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d4ab6-000d-496f-bbba-c5a3c1be634a None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:49.080419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429111a-28e1-4be2-850b-8af32c4b6695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:49.081039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429111a-28e1-4be2-850b-8af32c4b6695 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:49.081357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429111a-28e1-4be2-850b-8af32c4b6695 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:49.081627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429111a-28e1-4be2-850b-8af32c4b6695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:49.091666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429111a-28e1-4be2-850b-8af32c4b6695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:49.093038 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429111a-28e1-4be2-850b-8af32c4b6695 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-3429111a-28e1-4be2-850b-8af32c4b6695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 04:28:49.108205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:49.109369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 04:28:49.110431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 04:28:49.110431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 04:28:49.110431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:49.110431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 646/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:49.115229 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8578de-4c15-4373-a840-1ead68e6a385 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:49.212657 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8578de-4c15-4373-a840-1ead68e6a385 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:49.246358 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4ac45-85b8-4ee0-a915-ca0e3621485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:49.246951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4ac45-85b8-4ee0-a915-ca0e3621485d None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:49.247228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4ac45-85b8-4ee0-a915-ca0e3621485d None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:49.247500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4ac45-85b8-4ee0-a915-ca0e3621485d None admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:49.248131 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4ac45-85b8-4ee0-a915-ca0e3621485d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:49.248433 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4ac45-85b8-4ee0-a915-ca0e3621485d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:49.250348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4ac45-85b8-4ee0-a915-ca0e3621485d None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:49.261391 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 638/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 31 04:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:49.267732 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429111a-28e1-4be2-850b-8af32c4b6695 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:49.369000 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429111a-28e1-4be2-850b-8af32c4b6695 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:49.382934 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:49.402819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559599a-98c9-43f7-8f8f-acad8c5f0e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:49.403433 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559599a-98c9-43f7-8f8f-acad8c5f0e8b None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:49.403714 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559599a-98c9-43f7-8f8f-acad8c5f0e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:49.403986 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559599a-98c9-43f7-8f8f-acad8c5f0e8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:49.410872 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559599a-98c9-43f7-8f8f-acad8c5f0e8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:49.412306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559599a-98c9-43f7-8f8f-acad8c5f0e8b None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application [None req-c559599a-98c9-43f7-8f8f-acad8c5f0e8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 04:28:49.425008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:49.426167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:49.427302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 04:28:49.427302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 04:28:49.427302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 04:28:49.427302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 04:28:49.427302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 04:28:49.427302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 04:28:49.427302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 04:28:49.427302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: ERROR keystone.server.flask.application Aug 31 04:28:49.427302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 647/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 31 04:28:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:49.432102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4ac45-85b8-4ee0-a915-ca0e3621485d None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:49.480139 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:49.528312 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4ac45-85b8-4ee0-a915-ca0e3621485d None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:49.561171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8618ee0-7cf5-4f5b-95b3-3cdeaaf91e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:49.561795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8618ee0-7cf5-4f5b-95b3-3cdeaaf91e73 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:49.562073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8618ee0-7cf5-4f5b-95b3-3cdeaaf91e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:49.562362 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8618ee0-7cf5-4f5b-95b3-3cdeaaf91e73 None admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:49.563042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8618ee0-7cf5-4f5b-95b3-3cdeaaf91e73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:49.563349 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8618ee0-7cf5-4f5b-95b3-3cdeaaf91e73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:49.564749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8618ee0-7cf5-4f5b-95b3-3cdeaaf91e73 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:49.576425 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 639/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 31 04:28:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:49.583072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559599a-98c9-43f7-8f8f-acad8c5f0e8b None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:49.692358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559599a-98c9-43f7-8f8f-acad8c5f0e8b None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:49.726439 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b061b-b1a5-4cfd-9cc5-a774cc23cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:49.727031 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b061b-b1a5-4cfd-9cc5-a774cc23cba6 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:49.731406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b061b-b1a5-4cfd-9cc5-a774cc23cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:49.731406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b061b-b1a5-4cfd-9cc5-a774cc23cba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:49.731406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b061b-b1a5-4cfd-9cc5-a774cc23cba6 None admin] RBAC: Adding query filter params (role.id=1896db68dc754d5293037ab100ce46d9, scope.project.id=ff768fb064ce4d53b2e46ea611d3d103, user.id=a4ad954bbb7749ee8861e8da98619006) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:49.731406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b061b-b1a5-4cfd-9cc5-a774cc23cba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:49.731406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b061b-b1a5-4cfd-9cc5-a774cc23cba6 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:49.736650 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 648/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 31 04:28:49 2022] GET /identity/v3/role_assignments?user.id=a4ad954bbb7749ee8861e8da98619006&scope.project.id=ff768fb064ce4d53b2e46ea611d3d103&role.id=1896db68dc754d5293037ab100ce46d9 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:51.647204 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3abf-8427-4f85-95f2-27cd8889c287 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:51.647742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3abf-8427-4f85-95f2-27cd8889c287 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:51.647742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3abf-8427-4f85-95f2-27cd8889c287 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:51.649109 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 640/1288] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:28:51.654544 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca34c74-1161-4ee4-8393-111c935a8011 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:51.654960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca34c74-1161-4ee4-8393-111c935a8011 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:51.655082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca34c74-1161-4ee4-8393-111c935a8011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:51.673907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6ca34c74-1161-4ee4-8393-111c935a8011 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:28:51.683629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6ca34c74-1161-4ee4-8393-111c935a8011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:28:51.704816 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:51.741284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 649/1289] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:28:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:28:52.020980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f3abf-8427-4f85-95f2-27cd8889c287 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:52.124308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f3abf-8427-4f85-95f2-27cd8889c287 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:52.135195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:52.158398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be112fc9-8dea-4fa0-9862-c373e6289b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:52.159019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be112fc9-8dea-4fa0-9862-c373e6289b42 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:52.159292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be112fc9-8dea-4fa0-9862-c373e6289b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:52.159561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be112fc9-8dea-4fa0-9862-c373e6289b42 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:52.160133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be112fc9-8dea-4fa0-9862-c373e6289b42 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:52.161504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be112fc9-8dea-4fa0-9862-c373e6289b42 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-be112fc9-8dea-4fa0-9862-c373e6289b42 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:52.170033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:52.171287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:52.173402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 641/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 31 04:28:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:52.177812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca34c74-1161-4ee4-8393-111c935a8011 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:52.276133 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca34c74-1161-4ee4-8393-111c935a8011 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:52.309034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c89c00-ad2d-4fcb-8712-c1a8634937f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:52.309658 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c89c00-ad2d-4fcb-8712-c1a8634937f3 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:52.309935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c89c00-ad2d-4fcb-8712-c1a8634937f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:52.310203 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c89c00-ad2d-4fcb-8712-c1a8634937f3 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:52.310824 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c89c00-ad2d-4fcb-8712-c1a8634937f3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:52.311123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c89c00-ad2d-4fcb-8712-c1a8634937f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:52.312499 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c89c00-ad2d-4fcb-8712-c1a8634937f3 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:52.317271 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 650/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Aug 31 04:28:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:52.323124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be112fc9-8dea-4fa0-9862-c373e6289b42 None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:52.421894 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be112fc9-8dea-4fa0-9862-c373e6289b42 None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:52.454285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db334376-731e-4fb3-ba7e-a7692205bff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:52.454870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db334376-731e-4fb3-ba7e-a7692205bff7 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:52.455144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db334376-731e-4fb3-ba7e-a7692205bff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:52.455512 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db334376-731e-4fb3-ba7e-a7692205bff7 None admin] PATH_INFO: `/v3/services` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:52.456122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db334376-731e-4fb3-ba7e-a7692205bff7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:52.456420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db334376-731e-4fb3-ba7e-a7692205bff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:52.457789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db334376-731e-4fb3-ba7e-a7692205bff7 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:52.462100 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 642/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Aug 31 04:28:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:54.386606 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc4ef-cbfd-4cd5-8d6a-768dd5456ce5 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:54.387142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc4ef-cbfd-4cd5-8d6a-768dd5456ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:54.387142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc4ef-cbfd-4cd5-8d6a-768dd5456ce5 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:54.388460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 651/1293] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:28:54.394653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3fdcf-72f9-459c-9e58-189cf5cfee95 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:54.395118 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3fdcf-72f9-459c-9e58-189cf5cfee95 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:54.395208 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3fdcf-72f9-459c-9e58-189cf5cfee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:54.413833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f5a3fdcf-72f9-459c-9e58-189cf5cfee95 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:28:54.415018 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f5a3fdcf-72f9-459c-9e58-189cf5cfee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:28:54.443893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:54.480381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 643/1294] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:28:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:28:54.764967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebc4ef-cbfd-4cd5-8d6a-768dd5456ce5 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:54.798212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:54.869589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebc4ef-cbfd-4cd5-8d6a-768dd5456ce5 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:54.903343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c54f3-0bb9-4004-83a8-2b64cdd40641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:54.903946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c54f3-0bb9-4004-83a8-2b64cdd40641 None admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:54.904224 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c54f3-0bb9-4004-83a8-2b64cdd40641 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:54.904493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c54f3-0bb9-4004-83a8-2b64cdd40641 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:54.905149 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c54f3-0bb9-4004-83a8-2b64cdd40641 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:54.907227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c54f3-0bb9-4004-83a8-2b64cdd40641 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:55.000236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 652/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 31 04:28:54 2022] POST /identity/v3/services => generated 246 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:28:56.894051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcc2f8-e6d2-44c4-a63a-327dcbdd2898 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:56.894643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcc2f8-e6d2-44c4-a63a-327dcbdd2898 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:56.894643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcc2f8-e6d2-44c4-a63a-327dcbdd2898 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:56.895921 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 644/1296] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:28:56.901514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a78c-5b72-4ccc-955f-19291912d06e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:56.901933 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a78c-5b72-4ccc-955f-19291912d06e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:56.902046 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a78c-5b72-4ccc-955f-19291912d06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:56.920756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9868a78c-5b72-4ccc-955f-19291912d06e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:28:56.921964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9868a78c-5b72-4ccc-955f-19291912d06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:28:56.993302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 653/1297] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:28:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 04:28:57.269800 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcc2f8-e6d2-44c4-a63a-327dcbdd2898 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:57.368155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcc2f8-e6d2-44c4-a63a-327dcbdd2898 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:57.402514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe4161-b518-49cb-b7a4-485ce3e8fd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:57.403126 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe4161-b518-49cb-b7a4-485ce3e8fd0c None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:57.403407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe4161-b518-49cb-b7a4-485ce3e8fd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:57.403677 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe4161-b518-49cb-b7a4-485ce3e8fd0c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:57.404253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe4161-b518-49cb-b7a4-485ce3e8fd0c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:57.405661 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe4161-b518-49cb-b7a4-485ce3e8fd0c None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-9ffe4161-b518-49cb-b7a4-485ce3e8fd0c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:28:57.414459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:28:57.415641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:28:57.416802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 645/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 31 04:28:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:28:57.421709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868a78c-5b72-4ccc-955f-19291912d06e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:57.441393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:57.537650 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868a78c-5b72-4ccc-955f-19291912d06e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:57.573540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6309f-3754-44db-bae2-9bda404aa4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:57.574170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6309f-3754-44db-bae2-9bda404aa4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:57.574473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6309f-3754-44db-bae2-9bda404aa4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:57.574745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6309f-3754-44db-bae2-9bda404aa4d8 None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:57.575372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6309f-3754-44db-bae2-9bda404aa4d8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:57.575672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6309f-3754-44db-bae2-9bda404aa4d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:57.577029 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6309f-3754-44db-bae2-9bda404aa4d8 None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:57.582560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 654/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Aug 31 04:28:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:57.588641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe4161-b518-49cb-b7a4-485ce3e8fd0c None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:57.621106 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:57.690142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe4161-b518-49cb-b7a4-485ce3e8fd0c None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:57.727056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b72ef-cd6b-4cd0-81cd-634dc4ca5b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:57.727659 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b72ef-cd6b-4cd0-81cd-634dc4ca5b23 None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:57.727936 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b72ef-cd6b-4cd0-81cd-634dc4ca5b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:57.728208 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b72ef-cd6b-4cd0-81cd-634dc4ca5b23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:57.728915 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b72ef-cd6b-4cd0-81cd-634dc4ca5b23 None admin] RBAC: Adding query filter params (interface=public, service_id=e2464e0a0cbe495285b558435bf681d5, region_id=RegionOne) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:28:57.729240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b72ef-cd6b-4cd0-81cd-634dc4ca5b23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:57.730716 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b72ef-cd6b-4cd0-81cd-634dc4ca5b23 None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:57.736511 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 646/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 31 04:28:57 2022] GET /identity/v3/endpoints?service_id=e2464e0a0cbe495285b558435bf681d5&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:28:57.742358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6309f-3754-44db-bae2-9bda404aa4d8 None admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:28:57.824601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:28:57.843469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6309f-3754-44db-bae2-9bda404aa4d8 None admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:28:57.879824 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7e808-c6c9-4702-bcd8-f382676ff30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:28:57.880418 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7e808-c6c9-4702-bcd8-f382676ff30d None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:57.880692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7e808-c6c9-4702-bcd8-f382676ff30d None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:57.880956 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7e808-c6c9-4702-bcd8-f382676ff30d None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:57.881572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7e808-c6c9-4702-bcd8-f382676ff30d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:28:57.882930 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7e808-c6c9-4702-bcd8-f382676ff30d None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:28:57.889562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 655/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 31 04:28:57 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:28:59.838738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df33226-a28b-48ad-9da8-f871acdfb09c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:59.839279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df33226-a28b-48ad-9da8-f871acdfb09c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:59.839279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df33226-a28b-48ad-9da8-f871acdfb09c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:59.840598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 647/1302] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:28:59.846449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ce23c-d290-4510-bdee-7e922796783c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:28:59.846902 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ce23c-d290-4510-bdee-7e922796783c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:28:59.847010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ce23c-d290-4510-bdee-7e922796783c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:28:59.864977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-903ce23c-d290-4510-bdee-7e922796783c None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:28:59.866190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-903ce23c-d290-4510-bdee-7e922796783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:28:59.931157 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 656/1303] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:28:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 04:29:00.210233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df33226-a28b-48ad-9da8-f871acdfb09c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:29:00.301662 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:29:00.308036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df33226-a28b-48ad-9da8-f871acdfb09c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:29:00.340475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3894a-0f41-492b-a990-25310fe43d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:29:00.341081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3894a-0f41-492b-a990-25310fe43d0e None admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:29:00.341388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3894a-0f41-492b-a990-25310fe43d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:29:00.341656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3894a-0f41-492b-a990-25310fe43d0e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:29:00.342222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3894a-0f41-492b-a990-25310fe43d0e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:29:00.343559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3894a-0f41-492b-a990-25310fe43d0e None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application [None req-50f3894a-0f41-492b-a990-25310fe43d0e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 04:29:00.352079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 04:29:00.353302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application with Lock( Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self._enter() Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application return self.creator() Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application created_value = creator( Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: ERROR keystone.server.flask.application Aug 31 04:29:00.354337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 648/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 31 04:29:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 04:29:00.359199 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ce23c-d290-4510-bdee-7e922796783c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:29:00.435099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:29:00.457773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ce23c-d290-4510-bdee-7e922796783c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:29:00.490622 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab81f0-16a0-4a6b-9f8a-c1c3f7a4778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:29:00.491333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab81f0-16a0-4a6b-9f8a-c1c3f7a4778a None admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:29:00.491670 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab81f0-16a0-4a6b-9f8a-c1c3f7a4778a None admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:29:00.492137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab81f0-16a0-4a6b-9f8a-c1c3f7a4778a None admin] PATH_INFO: `/v3/services` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:29:00.493240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab81f0-16a0-4a6b-9f8a-c1c3f7a4778a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:29:00.493558 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab81f0-16a0-4a6b-9f8a-c1c3f7a4778a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:29:00.494936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab81f0-16a0-4a6b-9f8a-c1c3f7a4778a None admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:29:00.500711 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 657/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Aug 31 04:29:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:29:00.506647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3894a-0f41-492b-a990-25310fe43d0e None admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:29:00.604648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3894a-0f41-492b-a990-25310fe43d0e None admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:29:00.636757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302718c-c5ae-4344-883c-989b5d4f7f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:29:00.637375 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302718c-c5ae-4344-883c-989b5d4f7f7a None admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:29:00.637656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302718c-c5ae-4344-883c-989b5d4f7f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:29:00.637928 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302718c-c5ae-4344-883c-989b5d4f7f7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:29:00.638584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302718c-c5ae-4344-883c-989b5d4f7f7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:29:00.639926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302718c-c5ae-4344-883c-989b5d4f7f7a None admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:29:00.823353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 649/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:29:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:29:10.497091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=30 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:29:10.818736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:45.608416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7300a7-66be-4b99-9136-282ccf798dbe None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:45.608898 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7300a7-66be-4b99-9136-282ccf798dbe None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:45.608989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7300a7-66be-4b99-9136-282ccf798dbe None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:45.615687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440dae3-7bf3-4f5a-92db-b30d3db75219 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:45.616100 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440dae3-7bf3-4f5a-92db-b30d3db75219 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:45.616244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440dae3-7bf3-4f5a-92db-b30d3db75219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:45.618906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 658/1307] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:34:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:34:45.717003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2440dae3-7bf3-4f5a-92db-b30d3db75219 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:34:45.718277 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2440dae3-7bf3-4f5a-92db-b30d3db75219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:45.845606 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 650/1308] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:34:46.137532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ff62-9adc-46a8-b7d4-7d4baaf50773 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:46.137849 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ff62-9adc-46a8-b7d4-7d4baaf50773 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:46.138335 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ff62-9adc-46a8-b7d4-7d4baaf50773 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:46.139984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 659/1309] 10.222.0.39 () {54 vars in 965 bytes} [Wed Aug 31 04:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:34:46.145788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8076f2a-af64-4800-bcc0-d3f0ce1f9be9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:46.146148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8076f2a-af64-4800-bcc0-d3f0ce1f9be9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:46.146661 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8076f2a-af64-4800-bcc0-d3f0ce1f9be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:46.231500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f8076f2a-af64-4800-bcc0-d3f0ce1f9be9 None None] MFA Rules not processed for user `2c63e7e4105b41d1abfe58bf13c6125d`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:34:46.232881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f8076f2a-af64-4800-bcc0-d3f0ce1f9be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:46.256530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:46.324023 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 651/1310] 10.222.0.39 () {58 vars in 1062 bytes} [Wed Aug 31 04:34:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:34:46.333387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ff62-9adc-46a8-b7d4-7d4baaf50773 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:34:46.335148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e263ff62-9adc-46a8-b7d4-7d4baaf50773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:46.456114 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ff62-9adc-46a8-b7d4-7d4baaf50773 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:34:46.532616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b5bf7-f58a-4a33-a3e9-939344d54223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:34:46.533224 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b5bf7-f58a-4a33-a3e9-939344d54223 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:46.533514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b5bf7-f58a-4a33-a3e9-939344d54223 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:46.533781 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b5bf7-f58a-4a33-a3e9-939344d54223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:46.535362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-706b5bf7-f58a-4a33-a3e9-939344d54223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:46.593152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:46.650054 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b5bf7-f58a-4a33-a3e9-939344d54223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:34:46.652561 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b5bf7-f58a-4a33-a3e9-939344d54223 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:34:46.673962 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 660/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:34:48.899047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef519f-5490-4aa9-8ec5-f8a37436629e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:48.899580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef519f-5490-4aa9-8ec5-f8a37436629e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:48.899580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef519f-5490-4aa9-8ec5-f8a37436629e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:48.901111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 652/1312] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:34:48.906720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3bfd7-7f34-49c9-ba9e-ec986473175b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:48.907128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3bfd7-7f34-49c9-ba9e-ec986473175b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:48.907296 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3bfd7-7f34-49c9-ba9e-ec986473175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:48.980740 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bdb3bfd7-7f34-49c9-ba9e-ec986473175b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:34:48.981997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bdb3bfd7-7f34-49c9-ba9e-ec986473175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:49.087377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 661/1313] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:34:49.370849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef519f-5490-4aa9-8ec5-f8a37436629e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:34:49.372414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-99ef519f-5490-4aa9-8ec5-f8a37436629e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:49.472919 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef519f-5490-4aa9-8ec5-f8a37436629e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:34:49.544410 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:49.546981 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2501c5-4b94-448a-b601-5890c4c4a729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:34:49.547581 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2501c5-4b94-448a-b601-5890c4c4a729 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:49.547861 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2501c5-4b94-448a-b601-5890c4c4a729 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:49.548131 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2501c5-4b94-448a-b601-5890c4c4a729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:49.549762 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-aa2501c5-4b94-448a-b601-5890c4c4a729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:49.657913 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2501c5-4b94-448a-b601-5890c4c4a729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:34:49.659245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2501c5-4b94-448a-b601-5890c4c4a729 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:34:49.677846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 653/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:34:52.058602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5d54a-60b8-4499-9dc1-12ac56912d91 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:52.059025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5d54a-60b8-4499-9dc1-12ac56912d91 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:52.059140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5d54a-60b8-4499-9dc1-12ac56912d91 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:52.060471 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 662/1315] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:34:52.065611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe979ca-090c-4c44-8228-ea67b86e0f8c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:52.066036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe979ca-090c-4c44-8228-ea67b86e0f8c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:52.066161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe979ca-090c-4c44-8228-ea67b86e0f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:52.131817 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bbe979ca-090c-4c44-8228-ea67b86e0f8c None None] MFA Rules not processed for user `d2e3112275334ef6a07084887adb4bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:34:52.132967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bbe979ca-090c-4c44-8228-ea67b86e0f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:52.185404 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:52.229261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 654/1316] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:34:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:34:52.512256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5d54a-60b8-4499-9dc1-12ac56912d91 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:34:52.513860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-94e5d54a-60b8-4499-9dc1-12ac56912d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:52.523713 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:52.617666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5d54a-60b8-4499-9dc1-12ac56912d91 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:34:52.695191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada34789-6336-48d7-b3f8-51ce97368e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:34:52.695791 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada34789-6336-48d7-b3f8-51ce97368e7f service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:52.696070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada34789-6336-48d7-b3f8-51ce97368e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:52.696341 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada34789-6336-48d7-b3f8-51ce97368e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:52.698595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ada34789-6336-48d7-b3f8-51ce97368e7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:52.764619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:52.812255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada34789-6336-48d7-b3f8-51ce97368e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:34:52.813726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada34789-6336-48d7-b3f8-51ce97368e7f service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:34:52.833766 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 663/1317] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:34:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:34:55.483847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad6c98-fd82-4042-97a5-56f7fa37f262 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:55.484445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad6c98-fd82-4042-97a5-56f7fa37f262 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:55.484445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad6c98-fd82-4042-97a5-56f7fa37f262 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:55.485757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 655/1318] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:34:55.490898 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a617261-97f7-47be-87fb-e23c30ae5f53 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:55.491315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a617261-97f7-47be-87fb-e23c30ae5f53 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:55.491428 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a617261-97f7-47be-87fb-e23c30ae5f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:55.558314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2a617261-97f7-47be-87fb-e23c30ae5f53 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:34:55.559513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2a617261-97f7-47be-87fb-e23c30ae5f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:55.654696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 664/1319] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:34:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:34:55.939161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad6c98-fd82-4042-97a5-56f7fa37f262 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:34:55.940710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-44ad6c98-fd82-4042-97a5-56f7fa37f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:56.047850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad6c98-fd82-4042-97a5-56f7fa37f262 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:34:56.122673 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bf4aa-6cca-4116-9ed7-2682712083e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:34:56.123276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bf4aa-6cca-4116-9ed7-2682712083e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:56.123557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bf4aa-6cca-4116-9ed7-2682712083e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:56.123852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bf4aa-6cca-4116-9ed7-2682712083e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:56.125513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6a4bf4aa-6cca-4116-9ed7-2682712083e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:56.132780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:56.233575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bf4aa-6cca-4116-9ed7-2682712083e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:34:56.234934 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bf4aa-6cca-4116-9ed7-2682712083e7 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:34:56.252569 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 656/1320] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:34:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:34:59.132334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e92e89-c71c-48fb-9421-29b47fe61b43 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:59.132872 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e92e89-c71c-48fb-9421-29b47fe61b43 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:59.132872 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e92e89-c71c-48fb-9421-29b47fe61b43 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:59.134262 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 665/1321] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:34:59.139496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cf99a-2828-4596-8d8c-ba16b426a388 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:59.139905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cf99a-2828-4596-8d8c-ba16b426a388 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:59.140042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cf99a-2828-4596-8d8c-ba16b426a388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:59.210720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5b2cf99a-2828-4596-8d8c-ba16b426a388 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:34:59.211918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5b2cf99a-2828-4596-8d8c-ba16b426a388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:59.269625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:59.311195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 657/1322] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:34:59.613018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a95f9-4be7-4df8-bda1-ea7995642a68 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:59.613018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a95f9-4be7-4df8-bda1-ea7995642a68 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:59.613273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a95f9-4be7-4df8-bda1-ea7995642a68 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:59.614496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 666/1323] 10.222.0.39 () {54 vars in 965 bytes} [Wed Aug 31 04:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:34:59.620577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cd74f-3c34-4f3c-a88a-8981d46655b0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:59.620863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cd74f-3c34-4f3c-a88a-8981d46655b0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:59.621141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cd74f-3c34-4f3c-a88a-8981d46655b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:59.700123 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-186cd74f-3c34-4f3c-a88a-8981d46655b0 None None] MFA Rules not processed for user `2c63e7e4105b41d1abfe58bf13c6125d`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:34:59.708357 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-186cd74f-3c34-4f3c-a88a-8981d46655b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:59.778682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 658/1324] 10.222.0.39 () {58 vars in 1062 bytes} [Wed Aug 31 04:34:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:34:59.788109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a95f9-4be7-4df8-bda1-ea7995642a68 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:34:59.789667 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c26a95f9-4be7-4df8-bda1-ea7995642a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:34:59.809225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:34:59.895301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a95f9-4be7-4df8-bda1-ea7995642a68 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:34:59.968719 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3090aef-2e44-4bdf-a7d9-74672f7efd5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:34:59.969349 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3090aef-2e44-4bdf-a7d9-74672f7efd5d service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:34:59.969625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3090aef-2e44-4bdf-a7d9-74672f7efd5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:34:59.969891 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3090aef-2e44-4bdf-a7d9-74672f7efd5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:34:59.971470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b3090aef-2e44-4bdf-a7d9-74672f7efd5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:00.043942 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:00.081700 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3090aef-2e44-4bdf-a7d9-74672f7efd5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:00.083135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3090aef-2e44-4bdf-a7d9-74672f7efd5d service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:00.101390 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 667/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:02.306239 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b21b4-db33-4f2c-98da-b458dd6c9a53 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:02.306759 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b21b4-db33-4f2c-98da-b458dd6c9a53 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:02.306759 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b21b4-db33-4f2c-98da-b458dd6c9a53 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:02.308893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 659/1326] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:02.314138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871180c-9321-4bce-b662-11c0ead3ee2c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:02.314627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871180c-9321-4bce-b662-11c0ead3ee2c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:02.314841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871180c-9321-4bce-b662-11c0ead3ee2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:02.388305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b871180c-9321-4bce-b662-11c0ead3ee2c None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:02.389571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b871180c-9321-4bce-b662-11c0ead3ee2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:02.491736 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 668/1327] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:02.777740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b21b4-db33-4f2c-98da-b458dd6c9a53 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:35:02.779306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ef1b21b4-db33-4f2c-98da-b458dd6c9a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:02.840353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:02.883596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b21b4-db33-4f2c-98da-b458dd6c9a53 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:35:02.959778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de9f46-d016-4d49-8faa-28ac95f378f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:35:02.960398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de9f46-d016-4d49-8faa-28ac95f378f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:02.960668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de9f46-d016-4d49-8faa-28ac95f378f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:02.960944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de9f46-d016-4d49-8faa-28ac95f378f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:02.962561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a2de9f46-d016-4d49-8faa-28ac95f378f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:03.189296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:03.191562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de9f46-d016-4d49-8faa-28ac95f378f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:03.192980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de9f46-d016-4d49-8faa-28ac95f378f8 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:03.211654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 660/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:05.188084 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c25e6-efb2-4cc0-9a33-c5b17724a4ca None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:05.188598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c25e6-efb2-4cc0-9a33-c5b17724a4ca None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:05.188693 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c25e6-efb2-4cc0-9a33-c5b17724a4ca None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:05.189997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 669/1329] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:05.195047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e241a-c1ad-4b4f-ad7e-c3f0c256ec34 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:05.195461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e241a-c1ad-4b4f-ad7e-c3f0c256ec34 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:05.195653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e241a-c1ad-4b4f-ad7e-c3f0c256ec34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:05.285288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a47e241a-c1ad-4b4f-ad7e-c3f0c256ec34 None None] MFA Rules not processed for user `d2e3112275334ef6a07084887adb4bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:05.286546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a47e241a-c1ad-4b4f-ad7e-c3f0c256ec34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:05.383076 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 661/1330] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:05 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:05.671397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c25e6-efb2-4cc0-9a33-c5b17724a4ca None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:35:05.672947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8c2c25e6-efb2-4cc0-9a33-c5b17724a4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:05.703869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:05.790020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c25e6-efb2-4cc0-9a33-c5b17724a4ca None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:35:05.873540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5832ee-6334-4d46-8114-d8e0fb0d3b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:35:05.874148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5832ee-6334-4d46-8114-d8e0fb0d3b0b service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:05.874426 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5832ee-6334-4d46-8114-d8e0fb0d3b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:05.874697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5832ee-6334-4d46-8114-d8e0fb0d3b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:05.876325 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3c5832ee-6334-4d46-8114-d8e0fb0d3b0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:05.958318 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:05.991138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5832ee-6334-4d46-8114-d8e0fb0d3b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:05.992578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5832ee-6334-4d46-8114-d8e0fb0d3b0b service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:06.012216 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 670/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:35:05 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:08.505777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b978bd-7d2d-465a-9455-770063fa4042 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:08.506292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b978bd-7d2d-465a-9455-770063fa4042 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:08.506292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b978bd-7d2d-465a-9455-770063fa4042 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:08.507583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 662/1332] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:08.513385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ef929-783b-4c63-9349-bfe08c4ff7dd None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:08.513794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ef929-783b-4c63-9349-bfe08c4ff7dd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:08.513932 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ef929-783b-4c63-9349-bfe08c4ff7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:08.579248 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c21ef929-783b-4c63-9349-bfe08c4ff7dd None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:08.580437 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c21ef929-783b-4c63-9349-bfe08c4ff7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:08.676571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 671/1333] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:08.960802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b978bd-7d2d-465a-9455-770063fa4042 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:35:08.962424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c7b978bd-7d2d-465a-9455-770063fa4042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:09.031394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:09.066054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b978bd-7d2d-465a-9455-770063fa4042 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:35:09.140030 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62cbd3-35dc-44ac-a422-1f94c3207074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:35:09.140636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62cbd3-35dc-44ac-a422-1f94c3207074 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:09.140910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62cbd3-35dc-44ac-a422-1f94c3207074 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:09.141219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62cbd3-35dc-44ac-a422-1f94c3207074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:09.142853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2f62cbd3-35dc-44ac-a422-1f94c3207074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:09.250147 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62cbd3-35dc-44ac-a422-1f94c3207074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:09.251470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62cbd3-35dc-44ac-a422-1f94c3207074 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:09.261385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:09.269799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 663/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:35:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:11.233481 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a79dd9-38d1-4177-a82c-9c207a67c216 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:11.234020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a79dd9-38d1-4177-a82c-9c207a67c216 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:11.234020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a79dd9-38d1-4177-a82c-9c207a67c216 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:11.235354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 672/1335] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:11.240338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a7574-f2d2-4e73-877c-cf4ff750ce19 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:11.240741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a7574-f2d2-4e73-877c-cf4ff750ce19 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:11.240870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a7574-f2d2-4e73-877c-cf4ff750ce19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:11.305896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d03a7574-f2d2-4e73-877c-cf4ff750ce19 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:11.307034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d03a7574-f2d2-4e73-877c-cf4ff750ce19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:11.399663 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 664/1336] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:11.689525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a79dd9-38d1-4177-a82c-9c207a67c216 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:35:11.691123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f8a79dd9-38d1-4177-a82c-9c207a67c216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:11.736562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:11.804090 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a79dd9-38d1-4177-a82c-9c207a67c216 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:35:11.876889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3979aeb-e9e5-474c-9466-410da1930c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:35:11.877515 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979aeb-e9e5-474c-9466-410da1930c1c service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:11.877794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979aeb-e9e5-474c-9466-410da1930c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:11.878064 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979aeb-e9e5-474c-9466-410da1930c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:11.879657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b3979aeb-e9e5-474c-9466-410da1930c1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:11.961575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:11.986691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3979aeb-e9e5-474c-9466-410da1930c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:12.004971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3979aeb-e9e5-474c-9466-410da1930c1c service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:12.006043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 673/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:14.459834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b921e21-561a-4c64-9698-c2329554e593 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:14.460366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b921e21-561a-4c64-9698-c2329554e593 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:14.460366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b921e21-561a-4c64-9698-c2329554e593 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:14.461680 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 665/1338] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:14.467484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174d526-e683-42a5-af14-33e0e60f8f01 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:14.467906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174d526-e683-42a5-af14-33e0e60f8f01 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:14.468036 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174d526-e683-42a5-af14-33e0e60f8f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:14.538333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-0174d526-e683-42a5-af14-33e0e60f8f01 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:14.539793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0174d526-e683-42a5-af14-33e0e60f8f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:14.644241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 674/1339] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:14.936430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b921e21-561a-4c64-9698-c2329554e593 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:35:14.938000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0b921e21-561a-4c64-9698-c2329554e593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:15.013180 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:15.040614 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b921e21-561a-4c64-9698-c2329554e593 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:35:15.118578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e8c5d-124d-4087-ba86-03d5443c2852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:35:15.119177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e8c5d-124d-4087-ba86-03d5443c2852 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:15.120037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e8c5d-124d-4087-ba86-03d5443c2852 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:15.120530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e8c5d-124d-4087-ba86-03d5443c2852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:15.122180 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3b8e8c5d-124d-4087-ba86-03d5443c2852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:15.232173 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e8c5d-124d-4087-ba86-03d5443c2852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:15.233634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e8c5d-124d-4087-ba86-03d5443c2852 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:15.251852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 666/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:35:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:19.417395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d052d48-ca4e-4cf7-b634-0acef44c56f4 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:19.417970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d052d48-ca4e-4cf7-b634-0acef44c56f4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:19.417970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d052d48-ca4e-4cf7-b634-0acef44c56f4 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:19.419285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 675/1341] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:35:19.424584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af91300-b9b8-4ecb-b56f-3816774f027d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:19.425009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af91300-b9b8-4ecb-b56f-3816774f027d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:19.425154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af91300-b9b8-4ecb-b56f-3816774f027d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:19.430583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:19.495019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1af91300-b9b8-4ecb-b56f-3816774f027d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:19.496717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1af91300-b9b8-4ecb-b56f-3816774f027d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:19.594181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 667/1342] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:19.878614 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d052d48-ca4e-4cf7-b634-0acef44c56f4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:35:19.880186 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6d052d48-ca4e-4cf7-b634-0acef44c56f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:19.929134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:19.986659 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d052d48-ca4e-4cf7-b634-0acef44c56f4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:35:20.063663 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d999662-32db-4873-9cf0-513e915a41de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:35:20.064270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d999662-32db-4873-9cf0-513e915a41de service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:20.064549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d999662-32db-4873-9cf0-513e915a41de service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:20.064820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d999662-32db-4873-9cf0-513e915a41de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:20.066450 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0d999662-32db-4873-9cf0-513e915a41de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:20.161657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:20.178053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d999662-32db-4873-9cf0-513e915a41de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:20.179495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d999662-32db-4873-9cf0-513e915a41de service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:20.198113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 676/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:23.144647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ecd54-17cb-40d5-9bed-a16532893405 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:23.145164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ecd54-17cb-40d5-9bed-a16532893405 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:23.145164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ecd54-17cb-40d5-9bed-a16532893405 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:23.146462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 668/1344] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:23.152146 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c558d7d-d8c2-4416-b9f2-3c4da07d0568 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:23.152621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c558d7d-d8c2-4416-b9f2-3c4da07d0568 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:23.152776 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c558d7d-d8c2-4416-b9f2-3c4da07d0568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:23.221331 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7c558d7d-d8c2-4416-b9f2-3c4da07d0568 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:23.222538 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7c558d7d-d8c2-4416-b9f2-3c4da07d0568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:23.320876 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 677/1345] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:23.598406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ecd54-17cb-40d5-9bed-a16532893405 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:35:23.600017 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0b3ecd54-17cb-40d5-9bed-a16532893405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:23.686551 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:23.702977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ecd54-17cb-40d5-9bed-a16532893405 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:35:23.782021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81576c6a-8582-4a9a-a084-206b5a7b68ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:35:23.782623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81576c6a-8582-4a9a-a084-206b5a7b68ce service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:23.782900 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81576c6a-8582-4a9a-a084-206b5a7b68ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:23.783172 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81576c6a-8582-4a9a-a084-206b5a7b68ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:23.784783 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-81576c6a-8582-4a9a-a084-206b5a7b68ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:23.902304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81576c6a-8582-4a9a-a084-206b5a7b68ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:23.903719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81576c6a-8582-4a9a-a084-206b5a7b68ce service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:23.924170 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 669/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:35:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:28.424202 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea553a7-8667-4ea6-a004-9020b742c411 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:28.424713 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea553a7-8667-4ea6-a004-9020b742c411 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:28.424812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea553a7-8667-4ea6-a004-9020b742c411 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:28.426133 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 678/1347] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:28.431899 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e1bf-abba-4ea2-94da-b3bef7d77f69 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:28.432396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e1bf-abba-4ea2-94da-b3bef7d77f69 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:28.432758 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e1bf-abba-4ea2-94da-b3bef7d77f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:28.449320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:28.508649 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ae22e1bf-abba-4ea2-94da-b3bef7d77f69 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:28.509803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ae22e1bf-abba-4ea2-94da-b3bef7d77f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:28.610987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 670/1348] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:28.903945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea553a7-8667-4ea6-a004-9020b742c411 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:35:28.905427 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bea553a7-8667-4ea6-a004-9020b742c411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:28.965181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:29.011732 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea553a7-8667-4ea6-a004-9020b742c411 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:35:29.088491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625c154-8b7f-4861-9e30-1626402c4728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:35:29.089105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625c154-8b7f-4861-9e30-1626402c4728 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:29.089426 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625c154-8b7f-4861-9e30-1626402c4728 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:29.089703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625c154-8b7f-4861-9e30-1626402c4728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:29.091399 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3625c154-8b7f-4861-9e30-1626402c4728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:29.204196 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:29.207488 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625c154-8b7f-4861-9e30-1626402c4728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:29.208936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625c154-8b7f-4861-9e30-1626402c4728 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:29.226860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 679/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:34.207777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23e2be-682d-4422-9ecd-1d3b76985e86 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:34.207777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23e2be-682d-4422-9ecd-1d3b76985e86 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:34.208286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23e2be-682d-4422-9ecd-1d3b76985e86 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:34.211428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 671/1350] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 31 04:35:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:34.215676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd105204-8af5-40ed-aaaa-9dbbc3232189 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:34.216132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd105204-8af5-40ed-aaaa-9dbbc3232189 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:34.216215 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd105204-8af5-40ed-aaaa-9dbbc3232189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:34.317382 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-dd105204-8af5-40ed-aaaa-9dbbc3232189 None None] MFA Rules not processed for user `a4ad954bbb7749ee8861e8da98619006`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:34.319655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-dd105204-8af5-40ed-aaaa-9dbbc3232189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:34.460829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 680/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 31 04:35:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:38.608938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=59 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:38.931011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3d0d6-b4c4-4d7d-b1c7-62fc90ba5c5b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:38.931641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3d0d6-b4c4-4d7d-b1c7-62fc90ba5c5b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:38.933656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3d0d6-b4c4-4d7d-b1c7-62fc90ba5c5b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:38.936475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 672/1352] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 31 04:35:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:38.942119 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11178cbd-10fe-422a-89ca-6dc8e0ae4219 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:38.942601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11178cbd-10fe-422a-89ca-6dc8e0ae4219 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:38.942897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11178cbd-10fe-422a-89ca-6dc8e0ae4219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:39.002612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:39.027627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-11178cbd-10fe-422a-89ca-6dc8e0ae4219 None None] MFA Rules not processed for user `a4ad954bbb7749ee8861e8da98619006`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:39.028981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-11178cbd-10fe-422a-89ca-6dc8e0ae4219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:39.151628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 681/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 31 04:35:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:40.405229 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeeb984-d65d-407d-9459-967760e934e8 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:40.405742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeeb984-d65d-407d-9459-967760e934e8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:40.405742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeeb984-d65d-407d-9459-967760e934e8 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:40.407506 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 673/1354] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 31 04:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:40.412381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfb9c2-23bb-4588-8b58-3426b77876fb None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:40.412814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfb9c2-23bb-4588-8b58-3426b77876fb None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:40.412937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfb9c2-23bb-4588-8b58-3426b77876fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:40.489763 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-56cfb9c2-23bb-4588-8b58-3426b77876fb None None] MFA Rules not processed for user `a4ad954bbb7749ee8861e8da98619006`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:40.490972 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-56cfb9c2-23bb-4588-8b58-3426b77876fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:40.533763 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:40.599486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 682/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 31 04:35:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:43.885573 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c17200-69f0-42be-ada8-42999488a94b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:43.886137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c17200-69f0-42be-ada8-42999488a94b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:43.886137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c17200-69f0-42be-ada8-42999488a94b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:43.887457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 674/1356] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:43.893560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405793b4-6b3d-439d-aedc-06b5ec1babe6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:43.893998 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405793b4-6b3d-439d-aedc-06b5ec1babe6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:43.894225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405793b4-6b3d-439d-aedc-06b5ec1babe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:43.969375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-405793b4-6b3d-439d-aedc-06b5ec1babe6 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:43.971401 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-405793b4-6b3d-439d-aedc-06b5ec1babe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:44.113843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 683/1357] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:44.430210 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b645526-aa4f-45af-8f84-1fc58ab097fd None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:44.430820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b645526-aa4f-45af-8f84-1fc58ab097fd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:44.431898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b645526-aa4f-45af-8f84-1fc58ab097fd None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:44.433751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 675/1358] 10.222.0.39 () {54 vars in 962 bytes} [Wed Aug 31 04:35:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:44.442209 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e49eb-8d6d-47b1-b2c5-95512c5f80bf None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:44.442772 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e49eb-8d6d-47b1-b2c5-95512c5f80bf None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:44.447835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e49eb-8d6d-47b1-b2c5-95512c5f80bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:44.461442 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:44.529780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7b1e49eb-8d6d-47b1-b2c5-95512c5f80bf None None] MFA Rules not processed for user `4877b72a6cea410dbb31a35c7acbd5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:44.531143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7b1e49eb-8d6d-47b1-b2c5-95512c5f80bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:44.654118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 684/1359] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Aug 31 04:35:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:44.662613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b645526-aa4f-45af-8f84-1fc58ab097fd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:35:44.664296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6b645526-aa4f-45af-8f84-1fc58ab097fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:44.842266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b645526-aa4f-45af-8f84-1fc58ab097fd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:35:44.920609 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:44.962020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc99e78-7d11-4c47-9e49-ef23106fbf1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:35:44.963126 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc99e78-7d11-4c47-9e49-ef23106fbf1e service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:44.963350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc99e78-7d11-4c47-9e49-ef23106fbf1e service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:44.963992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc99e78-7d11-4c47-9e49-ef23106fbf1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:44.966297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fcc99e78-7d11-4c47-9e49-ef23106fbf1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:45.069277 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc99e78-7d11-4c47-9e49-ef23106fbf1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:45.070882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc99e78-7d11-4c47-9e49-ef23106fbf1e service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:45.092969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 676/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:47.248386 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10d326-983b-4deb-9095-2a98d7b50e75 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:47.248982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10d326-983b-4deb-9095-2a98d7b50e75 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:47.248982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10d326-983b-4deb-9095-2a98d7b50e75 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:47.250618 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 685/1361] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:47.255978 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed6e69-0a52-4c00-9b3e-9bf7318d8a31 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:47.256500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed6e69-0a52-4c00-9b3e-9bf7318d8a31 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:47.256597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed6e69-0a52-4c00-9b3e-9bf7318d8a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:47.328669 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-59ed6e69-0a52-4c00-9b3e-9bf7318d8a31 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:47.329891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-59ed6e69-0a52-4c00-9b3e-9bf7318d8a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:47.375909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:47.448733 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 677/1362] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:47.743408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10d326-983b-4deb-9095-2a98d7b50e75 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:35:47.745569 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ca10d326-983b-4deb-9095-2a98d7b50e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:47.844259 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:47.933961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10d326-983b-4deb-9095-2a98d7b50e75 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:35:48.055666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91900e4-b5e5-403f-8284-7e1dfdc19b42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:35:48.057870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91900e4-b5e5-403f-8284-7e1dfdc19b42 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:48.058214 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91900e4-b5e5-403f-8284-7e1dfdc19b42 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:48.058558 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91900e4-b5e5-403f-8284-7e1dfdc19b42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:48.060282 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d91900e4-b5e5-403f-8284-7e1dfdc19b42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:48.098966 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:48.188676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91900e4-b5e5-403f-8284-7e1dfdc19b42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:48.190327 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91900e4-b5e5-403f-8284-7e1dfdc19b42 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:48.209134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 686/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:50.633762 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67bb0-cdcb-4fad-adc3-b12233cd0cdd None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:50.634382 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67bb0-cdcb-4fad-adc3-b12233cd0cdd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:50.634475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67bb0-cdcb-4fad-adc3-b12233cd0cdd None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:50.635844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 678/1364] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:50.641185 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c8b44-9d00-4431-b5bb-38a784a7644a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:50.641741 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c8b44-9d00-4431-b5bb-38a784a7644a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:50.641836 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c8b44-9d00-4431-b5bb-38a784a7644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:50.715232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-725c8b44-9d00-4431-b5bb-38a784a7644a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:50.716496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-725c8b44-9d00-4431-b5bb-38a784a7644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:50.830385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:50.833346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 687/1365] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:51.126078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d6b83-8ca4-498e-9e9d-3ece92273a26 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:51.126393 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d6b83-8ca4-498e-9e9d-3ece92273a26 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:51.126633 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d6b83-8ca4-498e-9e9d-3ece92273a26 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:51.128128 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 679/1366] 10.222.0.39 () {54 vars in 962 bytes} [Wed Aug 31 04:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:51.134077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259fcb-61de-418f-905d-751cc420d229 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:51.135245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259fcb-61de-418f-905d-751cc420d229 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:51.142564 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259fcb-61de-418f-905d-751cc420d229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:51.219105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7a259fcb-61de-418f-905d-751cc420d229 None None] MFA Rules not processed for user `4877b72a6cea410dbb31a35c7acbd5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:51.220345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7a259fcb-61de-418f-905d-751cc420d229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:51.347974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 688/1367] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Aug 31 04:35:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:51.356793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d6b83-8ca4-498e-9e9d-3ece92273a26 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:35:51.358882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ac6d6b83-8ca4-498e-9e9d-3ece92273a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:51.517286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d6b83-8ca4-498e-9e9d-3ece92273a26 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:35:51.538774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:51.638170 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ba09f-24d2-46dc-99a5-7b962fad1fa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:35:51.638834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ba09f-24d2-46dc-99a5-7b962fad1fa8 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:51.639077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ba09f-24d2-46dc-99a5-7b962fad1fa8 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:51.639265 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ba09f-24d2-46dc-99a5-7b962fad1fa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:51.640956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-048ba09f-24d2-46dc-99a5-7b962fad1fa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:51.739155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ba09f-24d2-46dc-99a5-7b962fad1fa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:51.740892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ba09f-24d2-46dc-99a5-7b962fad1fa8 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:51.760746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 680/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:52.260377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624bca5-4827-4b52-8907-6763053fb3c3 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:52.260886 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624bca5-4827-4b52-8907-6763053fb3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:52.260886 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624bca5-4827-4b52-8907-6763053fb3c3 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:52.262358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 689/1369] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:52.267336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71d130-7f0f-4bf5-8c9e-29b7b335ae10 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:52.267625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71d130-7f0f-4bf5-8c9e-29b7b335ae10 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:52.267900 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71d130-7f0f-4bf5-8c9e-29b7b335ae10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:52.302316 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:52.345416 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-fe71d130-7f0f-4bf5-8c9e-29b7b335ae10 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:52.346639 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fe71d130-7f0f-4bf5-8c9e-29b7b335ae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:52.450158 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 681/1370] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:53.057805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c3a5-c894-40f3-b192-98fe79cfcfae None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:53.057805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c3a5-c894-40f3-b192-98fe79cfcfae None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:53.057805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c3a5-c894-40f3-b192-98fe79cfcfae None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:53.057805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 690/1371] 10.222.0.39 () {54 vars in 964 bytes} [Wed Aug 31 04:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:53.060682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd4017-81f3-4f29-ab90-87c18202d593 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:53.060682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd4017-81f3-4f29-ab90-87c18202d593 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:53.060682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd4017-81f3-4f29-ab90-87c18202d593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:53.153375 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-02cd4017-81f3-4f29-ab90-87c18202d593 None None] MFA Rules not processed for user `4455f4e327184c69aead4a7ae9737961`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:53.154774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-02cd4017-81f3-4f29-ab90-87c18202d593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:53.203819 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:53.234814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 682/1372] 10.222.0.39 () {58 vars in 1061 bytes} [Wed Aug 31 04:35:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:53.242526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146c3a5-c894-40f3-b192-98fe79cfcfae None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:35:53.244913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b146c3a5-c894-40f3-b192-98fe79cfcfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:53.298987 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:53.368010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146c3a5-c894-40f3-b192-98fe79cfcfae None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:35:53.445263 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38b866-ca47-4bb4-931a-c70076f30dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:35:53.445874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38b866-ca47-4bb4-931a-c70076f30dbf service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:53.446149 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38b866-ca47-4bb4-931a-c70076f30dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:53.446491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38b866-ca47-4bb4-931a-c70076f30dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:53.448089 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6f38b866-ca47-4bb4-931a-c70076f30dbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:53.573487 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:53.588465 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38b866-ca47-4bb4-931a-c70076f30dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:53.588465 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38b866-ca47-4bb4-931a-c70076f30dbf service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:53.605606 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 691/1373] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:53.921343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1949df-edd1-468e-8e71-f6a27a1ab421 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:53.921537 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1949df-edd1-468e-8e71-f6a27a1ab421 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:53.921816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1949df-edd1-468e-8e71-f6a27a1ab421 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:53.923179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 683/1374] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:53.928288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed932-6660-4abf-890d-cd53f7ae022a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:53.928581 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed932-6660-4abf-890d-cd53f7ae022a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:53.928883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed932-6660-4abf-890d-cd53f7ae022a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:53.995819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-44bed932-6660-4abf-890d-cd53f7ae022a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:53.997032 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-44bed932-6660-4abf-890d-cd53f7ae022a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:54.096815 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 692/1375] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:54.387999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1949df-edd1-468e-8e71-f6a27a1ab421 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:35:54.389544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6c1949df-edd1-468e-8e71-f6a27a1ab421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:54.537060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1949df-edd1-468e-8e71-f6a27a1ab421 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:35:54.589303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:54.653517 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccc0c2-b01b-478b-88e1-5eb3fb5408ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:35:54.654134 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccc0c2-b01b-478b-88e1-5eb3fb5408ed service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:54.654415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccc0c2-b01b-478b-88e1-5eb3fb5408ed service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:54.654710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccc0c2-b01b-478b-88e1-5eb3fb5408ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:54.656449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d2ccc0c2-b01b-478b-88e1-5eb3fb5408ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:54.750262 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccc0c2-b01b-478b-88e1-5eb3fb5408ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:54.751939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccc0c2-b01b-478b-88e1-5eb3fb5408ed service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:54.770378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 684/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:56.831329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683205a-049e-4933-b09a-a7f2f3ad0d84 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:56.831898 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683205a-049e-4933-b09a-a7f2f3ad0d84 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:56.831898 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683205a-049e-4933-b09a-a7f2f3ad0d84 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:56.833224 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 693/1377] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:35:56.838483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f2c26-ceda-4a28-b9ab-6f1e192ad619 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:56.839204 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f2c26-ceda-4a28-b9ab-6f1e192ad619 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:56.839627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f2c26-ceda-4a28-b9ab-6f1e192ad619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:56.926424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2f7f2c26-ceda-4a28-b9ab-6f1e192ad619 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:56.927573 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2f7f2c26-ceda-4a28-b9ab-6f1e192ad619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:56.935160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:57.026094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 685/1378] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:35:57.330460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683205a-049e-4933-b09a-a7f2f3ad0d84 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:35:57.332337 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2683205a-049e-4933-b09a-a7f2f3ad0d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:57.419911 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:57.536698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683205a-049e-4933-b09a-a7f2f3ad0d84 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:35:57.664735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d268c-f37d-4154-bd72-a72853728f09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:35:57.665942 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d268c-f37d-4154-bd72-a72853728f09 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:57.666357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d268c-f37d-4154-bd72-a72853728f09 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:57.666743 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d268c-f37d-4154-bd72-a72853728f09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:57.668439 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cc0d268c-f37d-4154-bd72-a72853728f09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:35:57.688458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:35:57.765126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d268c-f37d-4154-bd72-a72853728f09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:35:57.766802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d268c-f37d-4154-bd72-a72853728f09 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:35:57.787125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 694/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:35:59.853304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a8ddd-4dce-42d2-9970-b8b3d0e3b51c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:59.853841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a8ddd-4dce-42d2-9970-b8b3d0e3b51c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:59.854085 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a8ddd-4dce-42d2-9970-b8b3d0e3b51c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:59.855557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 686/1380] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:35:59.860857 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd5810-522e-4736-9ff6-16d5e89cb325 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:35:59.861945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd5810-522e-4736-9ff6-16d5e89cb325 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:35:59.862455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd5810-522e-4736-9ff6-16d5e89cb325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:35:59.934265 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-11bd5810-522e-4736-9ff6-16d5e89cb325 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:35:59.935524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-11bd5810-522e-4736-9ff6-16d5e89cb325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:00.034458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:00.041148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 695/1381] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:00.343837 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a8ddd-4dce-42d2-9970-b8b3d0e3b51c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:00.345406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-838a8ddd-4dce-42d2-9970-b8b3d0e3b51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:00.496962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:00.512151 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a8ddd-4dce-42d2-9970-b8b3d0e3b51c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:00.637376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfd560-6e70-469c-a88c-924aa2bc246c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:00.637897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfd560-6e70-469c-a88c-924aa2bc246c service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:00.638171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfd560-6e70-469c-a88c-924aa2bc246c service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:00.638439 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfd560-6e70-469c-a88c-924aa2bc246c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:00.640226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9adfd560-6e70-469c-a88c-924aa2bc246c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:00.741133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfd560-6e70-469c-a88c-924aa2bc246c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:00.742890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfd560-6e70-469c-a88c-924aa2bc246c service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:00.754146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:00.762682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 687/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:03.156522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b83e6-a309-40ab-886f-01fb7cb204cf None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:03.157368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b83e6-a309-40ab-886f-01fb7cb204cf None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:03.157508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b83e6-a309-40ab-886f-01fb7cb204cf None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:03.159224 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 696/1383] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:03.165494 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03802e47-a676-405e-8c64-a7009dbde97e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:03.166977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03802e47-a676-405e-8c64-a7009dbde97e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:03.167270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03802e47-a676-405e-8c64-a7009dbde97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:03.251594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-03802e47-a676-405e-8c64-a7009dbde97e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:03.252828 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-03802e47-a676-405e-8c64-a7009dbde97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:03.360656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 688/1384] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:03.826624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b83e6-a309-40ab-886f-01fb7cb204cf None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:03.830048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0b7b83e6-a309-40ab-886f-01fb7cb204cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:04.015546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b83e6-a309-40ab-886f-01fb7cb204cf None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:04.088902 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:04.137547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5b393-2b50-40af-a04e-13ec0ec862ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:04.138205 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5b393-2b50-40af-a04e-13ec0ec862ca service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:04.138430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5b393-2b50-40af-a04e-13ec0ec862ca service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:04.138706 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5b393-2b50-40af-a04e-13ec0ec862ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:04.140309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-26c5b393-2b50-40af-a04e-13ec0ec862ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:04.231914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5b393-2b50-40af-a04e-13ec0ec862ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:04.233671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5b393-2b50-40af-a04e-13ec0ec862ca service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:04.252474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 697/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:06.262371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c358ba0-93c1-468b-b070-df230f8c5dad None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:06.262958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c358ba0-93c1-468b-b070-df230f8c5dad None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:06.263411 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c358ba0-93c1-468b-b070-df230f8c5dad None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:06.266003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 689/1386] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:36:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:06.271741 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbd7ba-c778-4b56-a7f4-8df53bc4768e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:06.272212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbd7ba-c778-4b56-a7f4-8df53bc4768e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:06.272349 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbd7ba-c778-4b56-a7f4-8df53bc4768e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:06.343233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-47cbd7ba-c778-4b56-a7f4-8df53bc4768e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:06.344446 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-47cbd7ba-c778-4b56-a7f4-8df53bc4768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:06.379510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:06.470899 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 698/1387] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:06.786317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c358ba0-93c1-468b-b070-df230f8c5dad None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:06.787844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6c358ba0-93c1-468b-b070-df230f8c5dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:06.888863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:06.964187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c358ba0-93c1-468b-b070-df230f8c5dad None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:07.097858 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358a5d6-d030-48f9-b999-c7dd9167354a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:07.098306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358a5d6-d030-48f9-b999-c7dd9167354a service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:07.098588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358a5d6-d030-48f9-b999-c7dd9167354a service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:07.098859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358a5d6-d030-48f9-b999-c7dd9167354a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:07.100474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5358a5d6-d030-48f9-b999-c7dd9167354a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:07.147915 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:07.219702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358a5d6-d030-48f9-b999-c7dd9167354a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:07.221365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358a5d6-d030-48f9-b999-c7dd9167354a service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:07.240926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 690/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:09.078545 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48df8-0eed-4d40-8913-8a91697346bc None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:09.079076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48df8-0eed-4d40-8913-8a91697346bc None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:09.079076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48df8-0eed-4d40-8913-8a91697346bc None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:09.080477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 699/1389] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:09.085935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df420bb5-38ff-42e5-8226-feb0323a1cc6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:09.086358 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df420bb5-38ff-42e5-8226-feb0323a1cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:09.086483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df420bb5-38ff-42e5-8226-feb0323a1cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:09.154464 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-df420bb5-38ff-42e5-8226-feb0323a1cc6 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:09.155678 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-df420bb5-38ff-42e5-8226-feb0323a1cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:09.261668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 691/1390] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:36:09.271099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded223-e7fe-4af3-b633-578320178489 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:09.271379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded223-e7fe-4af3-b633-578320178489 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:09.271647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded223-e7fe-4af3-b633-578320178489 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:09.272974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 700/1391] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:09.278659 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bddf7c-c913-40dd-9671-15a5f0a2e751 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:09.278940 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bddf7c-c913-40dd-9671-15a5f0a2e751 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:09.279209 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bddf7c-c913-40dd-9671-15a5f0a2e751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:09.295470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:09.346505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-56bddf7c-c913-40dd-9671-15a5f0a2e751 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:09.347626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-56bddf7c-c913-40dd-9671-15a5f0a2e751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:09.445685 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 692/1392] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:09.566635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421dfe-64cc-492a-845f-803fc9b027eb None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:09.566920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421dfe-64cc-492a-845f-803fc9b027eb None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:09.567193 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421dfe-64cc-492a-845f-803fc9b027eb None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:09.568503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 701/1393] 10.222.0.39 () {54 vars in 967 bytes} [Wed Aug 31 04:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:09.573868 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e588-6e26-406b-825f-4e50c59b0943 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:09.574221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e588-6e26-406b-825f-4e50c59b0943 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:09.574557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e588-6e26-406b-825f-4e50c59b0943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:09.650901 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0140e588-6e26-406b-825f-4e50c59b0943 None None] MFA Rules not processed for user `c526760ad8a04bf486d1e7e74e9ffbe3`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:09.652034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0140e588-6e26-406b-825f-4e50c59b0943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:09.688907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:09.732403 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 693/1394] 10.222.0.39 () {58 vars in 1064 bytes} [Wed Aug 31 04:36:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:09.733958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa421dfe-64cc-492a-845f-803fc9b027eb None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:09.736575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fa421dfe-64cc-492a-845f-803fc9b027eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:09.739804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140e588-6e26-406b-825f-4e50c59b0943 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:09.748852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140e588-6e26-406b-825f-4e50c59b0943 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:09.824668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f0892-d6c5-4823-9cda-ba2024f1521f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526760ad8a04bf486d1e7e74e9ffbe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:09.825302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f0892-d6c5-4823-9cda-ba2024f1521f service glance] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:09.825577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f0892-d6c5-4823-9cda-ba2024f1521f service glance] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:09.825844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f0892-d6c5-4823-9cda-ba2024f1521f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:09.827568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a02f0892-d6c5-4823-9cda-ba2024f1521f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:09.887496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa421dfe-64cc-492a-845f-803fc9b027eb None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:09.905164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:09.934712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:09.938240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f0892-d6c5-4823-9cda-ba2024f1521f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:09.939703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f0892-d6c5-4823-9cda-ba2024f1521f service glance] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:09.958479 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 694/1395] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:36:10.005119 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b9b23-f025-466b-bfc8-4f34fb7fddbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:10.005746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9b23-f025-466b-bfc8-4f34fb7fddbf service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:10.006027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9b23-f025-466b-bfc8-4f34fb7fddbf service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:10.006294 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9b23-f025-466b-bfc8-4f34fb7fddbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:10.007982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-574b9b23-f025-466b-bfc8-4f34fb7fddbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:10.106560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b9b23-f025-466b-bfc8-4f34fb7fddbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:10.108188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b9b23-f025-466b-bfc8-4f34fb7fddbf service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:10.129629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 702/1396] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:10.898940 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea3623-32ad-4051-8e3d-5e6df97a7d44 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:10.899429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea3623-32ad-4051-8e3d-5e6df97a7d44 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:10.900382 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea3623-32ad-4051-8e3d-5e6df97a7d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:10.967163 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-81ea3623-32ad-4051-8e3d-5e6df97a7d44 None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:10.968357 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-81ea3623-32ad-4051-8e3d-5e6df97a7d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:11.055312 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 695/1397] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:36:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:11.104925 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d50c0-ff04-4b03-86ee-db870e46ccd5 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:11.105327 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d50c0-ff04-4b03-86ee-db870e46ccd5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:11.105676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d50c0-ff04-4b03-86ee-db870e46ccd5 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:11.107099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 703/1398] 10.222.0.39 () {54 vars in 943 bytes} [Wed Aug 31 04:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:11.113332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1a538-773f-4e89-8444-0b23c46e486e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:11.113629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1a538-773f-4e89-8444-0b23c46e486e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:11.113905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1a538-773f-4e89-8444-0b23c46e486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:11.192724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1fb1a538-773f-4e89-8444-0b23c46e486e None None] MFA Rules not processed for user `98c52ca121d34ce6bbeb414c31f5d2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:11.193885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1fb1a538-773f-4e89-8444-0b23c46e486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:11.211485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:11.307886 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 696/1399] 10.222.0.39 () {58 vars in 1040 bytes} [Wed Aug 31 04:36:11 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:11.317484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d50c0-ff04-4b03-86ee-db870e46ccd5 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:11.318998 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-713d50c0-ff04-4b03-86ee-db870e46ccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:11.342892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:11.461127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d50c0-ff04-4b03-86ee-db870e46ccd5 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:11.565223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26794d4b-c594-44cb-8486-66cc4546ca3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:11.565829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26794d4b-c594-44cb-8486-66cc4546ca3d service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:11.566103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26794d4b-c594-44cb-8486-66cc4546ca3d service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:11.566370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26794d4b-c594-44cb-8486-66cc4546ca3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:11.567996 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-26794d4b-c594-44cb-8486-66cc4546ca3d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:11.571212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:11.660220 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26794d4b-c594-44cb-8486-66cc4546ca3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:11.661849 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26794d4b-c594-44cb-8486-66cc4546ca3d service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:11.670448 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 704/1400] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:36:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:36:12.273135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ecc8e-30af-49d2-aee0-e3d573c211d3 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:12.273714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ecc8e-30af-49d2-aee0-e3d573c211d3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:12.273714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ecc8e-30af-49d2-aee0-e3d573c211d3 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:12.279808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 697/1401] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:12.283629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d54da0-5e12-4c73-8587-6491d2bfb9b6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:12.284973 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d54da0-5e12-4c73-8587-6491d2bfb9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:12.285371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d54da0-5e12-4c73-8587-6491d2bfb9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:12.359210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-10d54da0-5e12-4c73-8587-6491d2bfb9b6 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:12.360426 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-10d54da0-5e12-4c73-8587-6491d2bfb9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:12.472580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:12.488579 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 705/1402] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:12.778611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ecc8e-30af-49d2-aee0-e3d573c211d3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:12.780145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b18ecc8e-30af-49d2-aee0-e3d573c211d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:12.940275 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:12.955305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ecc8e-30af-49d2-aee0-e3d573c211d3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:13.085995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a69c9-7c11-46d6-91f1-fcaf734e04b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:13.086981 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a69c9-7c11-46d6-91f1-fcaf734e04b1 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:13.087897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a69c9-7c11-46d6-91f1-fcaf734e04b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:13.088347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a69c9-7c11-46d6-91f1-fcaf734e04b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:13.091564 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d88a69c9-7c11-46d6-91f1-fcaf734e04b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:13.195320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a69c9-7c11-46d6-91f1-fcaf734e04b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:13.197918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a69c9-7c11-46d6-91f1-fcaf734e04b1 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:13.208961 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:13.237283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 698/1403] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:15.392381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b13bf-5e23-46f6-976d-3c137df7372f None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:15.392955 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b13bf-5e23-46f6-976d-3c137df7372f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:15.392955 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b13bf-5e23-46f6-976d-3c137df7372f None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:15.394223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 706/1404] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:15.399666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a51f8-9218-4b93-9a1b-b3bfd84adba6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:15.400295 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a51f8-9218-4b93-9a1b-b3bfd84adba6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:15.400445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a51f8-9218-4b93-9a1b-b3bfd84adba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:15.482345 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0a6a51f8-9218-4b93-9a1b-b3bfd84adba6 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:15.483990 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0a6a51f8-9218-4b93-9a1b-b3bfd84adba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:15.593523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 699/1405] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:36:15.897808 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b13bf-5e23-46f6-976d-3c137df7372f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:15.899783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6a6b13bf-5e23-46f6-976d-3c137df7372f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:16.088967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b13bf-5e23-46f6-976d-3c137df7372f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:16.200576 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:16.267025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa538fcd-65a1-4d37-bb9e-f0a3bade3105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:16.267635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa538fcd-65a1-4d37-bb9e-f0a3bade3105 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:16.267948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa538fcd-65a1-4d37-bb9e-f0a3bade3105 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:16.268208 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa538fcd-65a1-4d37-bb9e-f0a3bade3105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:16.270194 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-aa538fcd-65a1-4d37-bb9e-f0a3bade3105 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:16.379292 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa538fcd-65a1-4d37-bb9e-f0a3bade3105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:16.380951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa538fcd-65a1-4d37-bb9e-f0a3bade3105 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:16.401917 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 707/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:18.476552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b056d-0ce8-4247-b9c8-b878804e25aa None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:18.477087 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b056d-0ce8-4247-b9c8-b878804e25aa None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:18.477476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b056d-0ce8-4247-b9c8-b878804e25aa None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:18.480079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 700/1407] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:36:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:18.484854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a23be-0125-4b40-9122-9389a3a492c6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:18.485320 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a23be-0125-4b40-9122-9389a3a492c6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:18.485429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a23be-0125-4b40-9122-9389a3a492c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:18.554497 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-063a23be-0125-4b40-9122-9389a3a492c6 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:18.555850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-063a23be-0125-4b40-9122-9389a3a492c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:18.592484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:18.669180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 708/1408] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:18.983931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b056d-0ce8-4247-b9c8-b878804e25aa None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:18.985491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-297b056d-0ce8-4247-b9c8-b878804e25aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:19.114560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:19.198465 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b056d-0ce8-4247-b9c8-b878804e25aa None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:19.326610 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f8f61-7f27-4fce-8cb0-6712ae531bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:19.327226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f8f61-7f27-4fce-8cb0-6712ae531bb3 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:19.327505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f8f61-7f27-4fce-8cb0-6712ae531bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:19.327775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f8f61-7f27-4fce-8cb0-6712ae531bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:19.329440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a68f8f61-7f27-4fce-8cb0-6712ae531bb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:19.370853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:19.440305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f8f61-7f27-4fce-8cb0-6712ae531bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:19.441942 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f8f61-7f27-4fce-8cb0-6712ae531bb3 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:19.462238 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 701/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:28.667304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=28 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:29.459814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=30 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:35.772365 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c331141-7cfc-46a5-93ce-e6dfecca20ff None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:35.772960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c331141-7cfc-46a5-93ce-e6dfecca20ff None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:35.772960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c331141-7cfc-46a5-93ce-e6dfecca20ff None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:35.774321 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 709/1410] 10.222.0.39 () {54 vars in 918 bytes} [Wed Aug 31 04:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:35.779864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07702d-c1e2-421c-9003-430a88473942 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:35.780359 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07702d-c1e2-421c-9003-430a88473942 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:35.780489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07702d-c1e2-421c-9003-430a88473942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:35.856619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8b07702d-c1e2-421c-9003-430a88473942 None None] MFA Rules not processed for user `a4ad954bbb7749ee8861e8da98619006`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:35.857862 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8b07702d-c1e2-421c-9003-430a88473942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:35.960844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 702/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Aug 31 04:36:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:35.975855 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbccec-be99-4b06-9e6a-ca1cd7f16000 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:35.976160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbccec-be99-4b06-9e6a-ca1cd7f16000 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:35.976426 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbccec-be99-4b06-9e6a-ca1cd7f16000 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:35.977777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 710/1412] 10.222.0.39 () {54 vars in 918 bytes} [Wed Aug 31 04:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:35.982357 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d48ff-2df6-4635-9439-0f676395fb54 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:35.982637 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d48ff-2df6-4635-9439-0f676395fb54 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:35.982906 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d48ff-2df6-4635-9439-0f676395fb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:36.055836 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:36.059411 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e12d48ff-2df6-4635-9439-0f676395fb54 None None] MFA Rules not processed for user `4877b72a6cea410dbb31a35c7acbd5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:36.060607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e12d48ff-2df6-4635-9439-0f676395fb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:36.180330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 703/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Aug 31 04:36:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:36:38.582173 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2f931-686f-49a5-9ec8-3a07fe719d00 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:38.582736 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2f931-686f-49a5-9ec8-3a07fe719d00 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:38.582736 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2f931-686f-49a5-9ec8-3a07fe719d00 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:38.584111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:38.590106 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305d6b9-edb5-45d7-a0fe-629030e2bbfc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:38.590550 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305d6b9-edb5-45d7-a0fe-629030e2bbfc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:38.590665 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305d6b9-edb5-45d7-a0fe-629030e2bbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:38.657635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1305d6b9-edb5-45d7-a0fe-629030e2bbfc None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:38.658876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1305d6b9-edb5-45d7-a0fe-629030e2bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:38.715817 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:38.757464 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:36:39.053473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2f931-686f-49a5-9ec8-3a07fe719d00 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:39.055460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-19c2f931-686f-49a5-9ec8-3a07fe719d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:39.203099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2f931-686f-49a5-9ec8-3a07fe719d00 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:39.275804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:39.315466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ff33f-643a-451d-aa26-a314f8d53c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:39.316060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff33f-643a-451d-aa26-a314f8d53c05 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:39.316330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff33f-643a-451d-aa26-a314f8d53c05 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:39.316591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff33f-643a-451d-aa26-a314f8d53c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:39.318225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-985ff33f-643a-451d-aa26-a314f8d53c05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:39.414672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ff33f-643a-451d-aa26-a314f8d53c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:39.416770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ff33f-643a-451d-aa26-a314f8d53c05 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:39.435009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 712/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:40.327381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30503079-130e-47b1-b9f9-96d7a1f24cf6 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:40.327952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30503079-130e-47b1-b9f9-96d7a1f24cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:40.327952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30503079-130e-47b1-b9f9-96d7a1f24cf6 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:40.329225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:40.334134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41a6da-8f64-42c6-a642-faeab9582509 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:40.334575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41a6da-8f64-42c6-a642-faeab9582509 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:40.334672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41a6da-8f64-42c6-a642-faeab9582509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:40.411340 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ec41a6da-8f64-42c6-a642-faeab9582509 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:40.412531 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ec41a6da-8f64-42c6-a642-faeab9582509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:40.438628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:40.510869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:36:40.663426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30503079-130e-47b1-b9f9-96d7a1f24cf6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:40.664939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-30503079-130e-47b1-b9f9-96d7a1f24cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:40.809941 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30503079-130e-47b1-b9f9-96d7a1f24cf6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:40.851500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:40.927544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddb612-5e07-43b3-bd81-12f220b89b0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:40.928071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb612-5e07-43b3-bd81-12f220b89b0e service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:40.928348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb612-5e07-43b3-bd81-12f220b89b0e service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:40.928616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb612-5e07-43b3-bd81-12f220b89b0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:40.930285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0dddb612-5e07-43b3-bd81-12f220b89b0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:41.023694 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddb612-5e07-43b3-bd81-12f220b89b0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:41.025817 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddb612-5e07-43b3-bd81-12f220b89b0e service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:41.045046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 706/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:41.923194 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7b525-711e-49f5-b822-47f25cb91ed8 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:41.923748 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7b525-711e-49f5-b822-47f25cb91ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:41.923748 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7b525-711e-49f5-b822-47f25cb91ed8 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:41.925059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:41.929899 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d00f3-3a62-4b82-bcb7-53313c4f3b9d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:41.930300 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d00f3-3a62-4b82-bcb7-53313c4f3b9d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:41.930446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d00f3-3a62-4b82-bcb7-53313c4f3b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:41.983846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:42.006120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5b5d00f3-3a62-4b82-bcb7-53313c4f3b9d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:42.007334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5b5d00f3-3a62-4b82-bcb7-53313c4f3b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:42.104777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:42.258543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7b525-711e-49f5-b822-47f25cb91ed8 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:42.260524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bdc7b525-711e-49f5-b822-47f25cb91ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:42.410803 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7b525-711e-49f5-b822-47f25cb91ed8 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:42.423563 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:42.526884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da12385-114f-4ee3-8514-4bfd736a8a17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:42.527400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da12385-114f-4ee3-8514-4bfd736a8a17 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:42.527666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da12385-114f-4ee3-8514-4bfd736a8a17 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:42.527936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da12385-114f-4ee3-8514-4bfd736a8a17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:42.529576 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6da12385-114f-4ee3-8514-4bfd736a8a17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:42.621244 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da12385-114f-4ee3-8514-4bfd736a8a17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:42.622843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da12385-114f-4ee3-8514-4bfd736a8a17 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:42.640888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 715/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:43.513457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb7d6-19a8-48db-bccd-5d8b711b7ef3 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:43.513995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb7d6-19a8-48db-bccd-5d8b711b7ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:43.513995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb7d6-19a8-48db-bccd-5d8b711b7ef3 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:43.515293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:43.522762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4938820-bf08-4f65-b01d-70f6fb39612b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:43.523228 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4938820-bf08-4f65-b01d-70f6fb39612b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:43.523363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4938820-bf08-4f65-b01d-70f6fb39612b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:43.544019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:43.600997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d4938820-bf08-4f65-b01d-70f6fb39612b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:43.602242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d4938820-bf08-4f65-b01d-70f6fb39612b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:43.698629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:43.858422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bb7d6-19a8-48db-bccd-5d8b711b7ef3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:43.859974 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-464bb7d6-19a8-48db-bccd-5d8b711b7ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:43.969073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:44.004414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bb7d6-19a8-48db-bccd-5d8b711b7ef3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:44.118113 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e625c-0003-4c68-894a-aa8c6c53563e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:44.118631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e625c-0003-4c68-894a-aa8c6c53563e service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:44.119095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e625c-0003-4c68-894a-aa8c6c53563e service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:44.119472 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e625c-0003-4c68-894a-aa8c6c53563e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:44.121096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e43e625c-0003-4c68-894a-aa8c6c53563e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:44.197371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:44.210480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e625c-0003-4c68-894a-aa8c6c53563e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:44.217490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e625c-0003-4c68-894a-aa8c6c53563e service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:44.230992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 709/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:45.105269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3a1e8-a3ed-442c-8de3-b251ec18908f None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:45.105762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3a1e8-a3ed-442c-8de3-b251ec18908f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:45.105879 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3a1e8-a3ed-442c-8de3-b251ec18908f None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:45.107174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:36:45.112120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52332f94-5722-4a9f-9b44-1e067924a1fe None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:45.112526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52332f94-5722-4a9f-9b44-1e067924a1fe None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:45.112728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52332f94-5722-4a9f-9b44-1e067924a1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:45.188864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-52332f94-5722-4a9f-9b44-1e067924a1fe None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:45.190100 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-52332f94-5722-4a9f-9b44-1e067924a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:45.285921 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:45.440910 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3a1e8-a3ed-442c-8de3-b251ec18908f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:45.442358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-36f3a1e8-a3ed-442c-8de3-b251ec18908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:45.528484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:45.590198 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3a1e8-a3ed-442c-8de3-b251ec18908f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:45.746945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf7731-d1f5-44ad-8417-692fe5057444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:45.746945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf7731-d1f5-44ad-8417-692fe5057444 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:45.746945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf7731-d1f5-44ad-8417-692fe5057444 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:45.746945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf7731-d1f5-44ad-8417-692fe5057444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:45.747932 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-dfbf7731-d1f5-44ad-8417-692fe5057444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:45.766611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:45.808647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf7731-d1f5-44ad-8417-692fe5057444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:45.810260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf7731-d1f5-44ad-8417-692fe5057444 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:45.829403 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 718/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:46.682887 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c5e7-2ed8-485b-9f9c-99d2a5c22232 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:46.691015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c5e7-2ed8-485b-9f9c-99d2a5c22232 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:46.691015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c5e7-2ed8-485b-9f9c-99d2a5c22232 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:46.691015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:46.691337 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afcedc-6f63-4caa-af8d-1da8af90f507 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:46.691337 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afcedc-6f63-4caa-af8d-1da8af90f507 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:46.691337 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afcedc-6f63-4caa-af8d-1da8af90f507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:46.768279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e7afcedc-6f63-4caa-af8d-1da8af90f507 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:46.769525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e7afcedc-6f63-4caa-af8d-1da8af90f507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:46.867463 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:47.021338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305c5e7-2ed8-485b-9f9c-99d2a5c22232 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:47.022793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7305c5e7-2ed8-485b-9f9c-99d2a5c22232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:47.070364 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:47.168984 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305c5e7-2ed8-485b-9f9c-99d2a5c22232 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:47.279718 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cd357-14c5-4a9a-b910-c87e667a4de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:47.280245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cd357-14c5-4a9a-b910-c87e667a4de4 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:47.280528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cd357-14c5-4a9a-b910-c87e667a4de4 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:47.280799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cd357-14c5-4a9a-b910-c87e667a4de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:47.282430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9f8cd357-14c5-4a9a-b910-c87e667a4de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:47.289926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:47.373602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cd357-14c5-4a9a-b910-c87e667a4de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:47.375181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cd357-14c5-4a9a-b910-c87e667a4de4 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:47.396097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 712/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:48.279095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21172ec-208e-4885-b35c-e2adf923b918 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:48.279753 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21172ec-208e-4885-b35c-e2adf923b918 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:48.279753 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21172ec-208e-4885-b35c-e2adf923b918 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:48.280977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:36:48.286230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968258-3dc0-4dfd-b615-d9660a1beeeb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:48.286644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968258-3dc0-4dfd-b615-d9660a1beeeb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:48.286785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968258-3dc0-4dfd-b615-d9660a1beeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:48.366607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b7968258-3dc0-4dfd-b615-d9660a1beeeb None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:48.367738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b7968258-3dc0-4dfd-b615-d9660a1beeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:48.437861 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:48.466654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:48.620787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21172ec-208e-4885-b35c-e2adf923b918 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:48.622266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a21172ec-208e-4885-b35c-e2adf923b918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:48.640328 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:48.769813 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21172ec-208e-4885-b35c-e2adf923b918 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:48.861125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:48.887892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d8271-a99c-4aeb-b2cd-3c746ea1b66f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:48.888589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8271-a99c-4aeb-b2cd-3c746ea1b66f service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:48.889079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8271-a99c-4aeb-b2cd-3c746ea1b66f service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:48.889648 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8271-a99c-4aeb-b2cd-3c746ea1b66f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:48.891292 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5b1d8271-a99c-4aeb-b2cd-3c746ea1b66f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:48.981647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d8271-a99c-4aeb-b2cd-3c746ea1b66f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:48.983251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d8271-a99c-4aeb-b2cd-3c746ea1b66f service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:49.000761 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 721/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:49.918121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42accee-dfb7-45e7-9048-7d8a1fa9616b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:49.918702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42accee-dfb7-45e7-9048-7d8a1fa9616b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:49.918702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42accee-dfb7-45e7-9048-7d8a1fa9616b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:49.920012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:49.924806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa382a0-8f48-47b9-b9da-c62c9a946ed2 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:49.925237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa382a0-8f48-47b9-b9da-c62c9a946ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:49.925390 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa382a0-8f48-47b9-b9da-c62c9a946ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:50.001394 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4fa382a0-8f48-47b9-b9da-c62c9a946ed2 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:50.002524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4fa382a0-8f48-47b9-b9da-c62c9a946ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:50.049863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:50.106449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:50.255063 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42accee-dfb7-45e7-9048-7d8a1fa9616b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:50.256504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b42accee-dfb7-45e7-9048-7d8a1fa9616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:50.404195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42accee-dfb7-45e7-9048-7d8a1fa9616b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:50.457748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:50.516781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612f0c5-1ad8-4eea-b9ac-f5e60d94f17e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:50.517342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612f0c5-1ad8-4eea-b9ac-f5e60d94f17e service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:50.517623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612f0c5-1ad8-4eea-b9ac-f5e60d94f17e service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:50.517897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612f0c5-1ad8-4eea-b9ac-f5e60d94f17e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:50.519510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c612f0c5-1ad8-4eea-b9ac-f5e60d94f17e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:50.608354 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612f0c5-1ad8-4eea-b9ac-f5e60d94f17e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:50.609972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612f0c5-1ad8-4eea-b9ac-f5e60d94f17e service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:50.627786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 715/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:51.523052 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e344dca-5478-40cc-b6ab-eca650216737 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:51.523596 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e344dca-5478-40cc-b6ab-eca650216737 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:51.523596 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e344dca-5478-40cc-b6ab-eca650216737 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:51.524872 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:51.529967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0799f-a913-4dad-b08f-93393928f930 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:51.530384 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0799f-a913-4dad-b08f-93393928f930 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:51.530490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0799f-a913-4dad-b08f-93393928f930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:51.607909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-aca0799f-a913-4dad-b08f-93393928f930 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:51.609117 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-aca0799f-a913-4dad-b08f-93393928f930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:51.611155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:51.706100 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:51.863242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e344dca-5478-40cc-b6ab-eca650216737 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:51.864754 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4e344dca-5478-40cc-b6ab-eca650216737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:52.009617 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e344dca-5478-40cc-b6ab-eca650216737 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:52.037308 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:52.123034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae00580-a8d9-4b69-9916-1bc296e278f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:52.123558 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae00580-a8d9-4b69-9916-1bc296e278f1 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:52.123833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae00580-a8d9-4b69-9916-1bc296e278f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:52.124099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae00580-a8d9-4b69-9916-1bc296e278f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:52.125739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4ae00580-a8d9-4b69-9916-1bc296e278f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:52.213939 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae00580-a8d9-4b69-9916-1bc296e278f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:52.215506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae00580-a8d9-4b69-9916-1bc296e278f1 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:52.233025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 724/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:54.064401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c950b3-6656-4185-a3d0-c771512fd42c None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:54.064872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c950b3-6656-4185-a3d0-c771512fd42c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:54.064984 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c950b3-6656-4185-a3d0-c771512fd42c None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:54.066340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:36:54.072189 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abf261-157f-4fdb-8f58-e06e22e8f969 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:54.072644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abf261-157f-4fdb-8f58-e06e22e8f969 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:54.072759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abf261-157f-4fdb-8f58-e06e22e8f969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:54.113240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:54.139500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-70abf261-157f-4fdb-8f58-e06e22e8f969 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:54.141410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-70abf261-157f-4fdb-8f58-e06e22e8f969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:54.235498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:54.520715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c950b3-6656-4185-a3d0-c771512fd42c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:54.522301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b6c950b3-6656-4185-a3d0-c771512fd42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:54.626978 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c950b3-6656-4185-a3d0-c771512fd42c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:54.659309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:54.702854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451e768-b2e4-42ca-b56a-12ffae7e6183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:54.703460 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451e768-b2e4-42ca-b56a-12ffae7e6183 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:54.703734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451e768-b2e4-42ca-b56a-12ffae7e6183 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:54.704004 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451e768-b2e4-42ca-b56a-12ffae7e6183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:54.705635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e451e768-b2e4-42ca-b56a-12ffae7e6183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:54.816750 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451e768-b2e4-42ca-b56a-12ffae7e6183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:54.818483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451e768-b2e4-42ca-b56a-12ffae7e6183 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:54.837823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 718/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:56.926512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1a4d-fc5f-4589-b952-66778e3d2b6b None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:56.927066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1a4d-fc5f-4589-b952-66778e3d2b6b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:56.927066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1a4d-fc5f-4589-b952-66778e3d2b6b None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:56.928381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:56.934574 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6a534-d747-41cf-976e-3b5edd5522ef None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:56.935013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6a534-d747-41cf-976e-3b5edd5522ef None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:56.935125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6a534-d747-41cf-976e-3b5edd5522ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:57.002358 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1ca6a534-d747-41cf-976e-3b5edd5522ef None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:36:57.003559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1ca6a534-d747-41cf-976e-3b5edd5522ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:57.016170 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:57.102457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:36:57.387825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c1a4d-fc5f-4589-b952-66778e3d2b6b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:36:57.389373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-154c1a4d-fc5f-4589-b952-66778e3d2b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:57.498190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c1a4d-fc5f-4589-b952-66778e3d2b6b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:36:57.512965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:36:57.576549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934381c-cd01-405c-ab01-6996059ce21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:36:57.577224 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934381c-cd01-405c-ab01-6996059ce21d service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:57.577595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934381c-cd01-405c-ab01-6996059ce21d service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:57.577867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934381c-cd01-405c-ab01-6996059ce21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:57.579510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4934381c-cd01-405c-ab01-6996059ce21d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:36:57.689367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934381c-cd01-405c-ab01-6996059ce21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:36:57.690717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934381c-cd01-405c-ab01-6996059ce21d service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:36:57.708968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 727/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:36:59.989824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7583699-1685-43f3-8a71-d6507987cf89 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:59.990437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7583699-1685-43f3-8a71-d6507987cf89 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:59.990437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7583699-1685-43f3-8a71-d6507987cf89 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:36:59.991707 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:36:59.997217 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795ccc-0fa7-44ab-8ade-e81154a37b69 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:36:59.997621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795ccc-0fa7-44ab-8ade-e81154a37b69 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:36:59.997781 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795ccc-0fa7-44ab-8ade-e81154a37b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:00.046870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:00.064694 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4a795ccc-0fa7-44ab-8ade-e81154a37b69 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:00.065929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4a795ccc-0fa7-44ab-8ade-e81154a37b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:00.179057 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:00.464147 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7583699-1685-43f3-8a71-d6507987cf89 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:00.465739 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c7583699-1685-43f3-8a71-d6507987cf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:00.566099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7583699-1685-43f3-8a71-d6507987cf89 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:00.605718 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:00.638121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa2d51-dbd1-4257-9066-9f043e6f4b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:00.638717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2d51-dbd1-4257-9066-9f043e6f4b83 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:00.638993 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2d51-dbd1-4257-9066-9f043e6f4b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:00.639255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2d51-dbd1-4257-9066-9f043e6f4b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:00.640842 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-59fa2d51-dbd1-4257-9066-9f043e6f4b83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:00.750341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa2d51-dbd1-4257-9066-9f043e6f4b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:00.751753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa2d51-dbd1-4257-9066-9f043e6f4b83 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:00.771114 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 721/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:37:02.806907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11445c11-3c49-46c6-842b-733b1f74089d None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:02.807517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11445c11-3c49-46c6-842b-733b1f74089d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:02.807517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11445c11-3c49-46c6-842b-733b1f74089d None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:02.808772 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:37:02.813925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f29ceb-0e9a-4b50-9fdc-01e2fa4a488e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:02.814336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f29ceb-0e9a-4b50-9fdc-01e2fa4a488e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:02.814466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f29ceb-0e9a-4b50-9fdc-01e2fa4a488e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:02.879852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-34f29ceb-0e9a-4b50-9fdc-01e2fa4a488e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:02.881055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-34f29ceb-0e9a-4b50-9fdc-01e2fa4a488e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:02.900724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:02.975213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:03.262526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11445c11-3c49-46c6-842b-733b1f74089d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:03.264082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-11445c11-3c49-46c6-842b-733b1f74089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:03.369140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11445c11-3c49-46c6-842b-733b1f74089d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:03.389597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:03.443909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94de8b-4e6a-4eb5-8948-f8e1c0cd2952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:03.444503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94de8b-4e6a-4eb5-8948-f8e1c0cd2952 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:03.444777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94de8b-4e6a-4eb5-8948-f8e1c0cd2952 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:03.445047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94de8b-4e6a-4eb5-8948-f8e1c0cd2952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:03.447147 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9e94de8b-4e6a-4eb5-8948-f8e1c0cd2952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:03.569457 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94de8b-4e6a-4eb5-8948-f8e1c0cd2952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:03.570894 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94de8b-4e6a-4eb5-8948-f8e1c0cd2952 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:03.589852 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 730/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:37:05.552259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54577fd-7c26-4265-bab7-9762d8bea7f6 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:05.552837 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54577fd-7c26-4265-bab7-9762d8bea7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:05.552837 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54577fd-7c26-4265-bab7-9762d8bea7f6 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:05.554165 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:37:05.559331 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736a1a1-2b8a-4ee4-8e16-8c143c35624f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:05.559745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736a1a1-2b8a-4ee4-8e16-8c143c35624f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:05.559888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736a1a1-2b8a-4ee4-8e16-8c143c35624f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:05.624594 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:05.627216 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a736a1a1-2b8a-4ee4-8e16-8c143c35624f None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:05.628432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a736a1a1-2b8a-4ee4-8e16-8c143c35624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:05.725348 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:06.005893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54577fd-7c26-4265-bab7-9762d8bea7f6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:06.007421 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d54577fd-7c26-4265-bab7-9762d8bea7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:06.113340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54577fd-7c26-4265-bab7-9762d8bea7f6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:06.162831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:06.188155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92beb5-fcb9-460f-9dfd-c0036df9723c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:06.188757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92beb5-fcb9-460f-9dfd-c0036df9723c service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:06.189059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92beb5-fcb9-460f-9dfd-c0036df9723c service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:06.189359 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92beb5-fcb9-460f-9dfd-c0036df9723c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:06.190966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1c92beb5-fcb9-460f-9dfd-c0036df9723c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:06.297093 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92beb5-fcb9-460f-9dfd-c0036df9723c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:06.298538 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92beb5-fcb9-460f-9dfd-c0036df9723c service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:06.316641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 724/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:37:08.282669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab2b7f-ef1c-46d6-9b7e-eb2e8268d7d6 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:08.283494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab2b7f-ef1c-46d6-9b7e-eb2e8268d7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:08.283494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab2b7f-ef1c-46d6-9b7e-eb2e8268d7d6 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:08.284824 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:37:08.290058 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24893a-ccf5-489b-916d-6216d8c8315c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:08.290473 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24893a-ccf5-489b-916d-6216d8c8315c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:08.291207 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24893a-ccf5-489b-916d-6216d8c8315c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:08.355611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0c24893a-ccf5-489b-916d-6216d8c8315c None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:08.356730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0c24893a-ccf5-489b-916d-6216d8c8315c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:08.386412 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:08.453806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:08.741684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab2b7f-ef1c-46d6-9b7e-eb2e8268d7d6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:08.743323 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-dbab2b7f-ef1c-46d6-9b7e-eb2e8268d7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:08.850231 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab2b7f-ef1c-46d6-9b7e-eb2e8268d7d6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:08.878784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:08.926531 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b029489-8250-4150-8f21-77654b0f8eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:08.927126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b029489-8250-4150-8f21-77654b0f8eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:08.927405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b029489-8250-4150-8f21-77654b0f8eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:08.927677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b029489-8250-4150-8f21-77654b0f8eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:08.929301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4b029489-8250-4150-8f21-77654b0f8eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:09.038227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b029489-8250-4150-8f21-77654b0f8eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:09.039661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b029489-8250-4150-8f21-77654b0f8eb9 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:09.059217 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 733/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:37:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:37:11.031310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c02de7-836b-420e-aab8-3b4682404542 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:11.031863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c02de7-836b-420e-aab8-3b4682404542 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:11.031863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c02de7-836b-420e-aab8-3b4682404542 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:11.033488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:37:11.038684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc708f-540b-42f2-a955-af533406d237 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:11.039102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc708f-540b-42f2-a955-af533406d237 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:11.039239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc708f-540b-42f2-a955-af533406d237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:11.108343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1dcc708f-540b-42f2-a955-af533406d237 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:11.109559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1dcc708f-540b-42f2-a955-af533406d237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:11.117718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:11.323640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:11.610757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c02de7-836b-420e-aab8-3b4682404542 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:11.612332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-46c02de7-836b-420e-aab8-3b4682404542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:11.716219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c02de7-836b-420e-aab8-3b4682404542 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:11.770780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:11.789824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ae87d-9f41-4b0d-91d5-424f547f08f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:11.790459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ae87d-9f41-4b0d-91d5-424f547f08f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:11.790820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ae87d-9f41-4b0d-91d5-424f547f08f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:11.791087 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ae87d-9f41-4b0d-91d5-424f547f08f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:11.792677 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d50ae87d-9f41-4b0d-91d5-424f547f08f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:11.899214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ae87d-9f41-4b0d-91d5-424f547f08f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:11.901145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ae87d-9f41-4b0d-91d5-424f547f08f3 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:11.919473 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 727/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:37:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:37:13.903268 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d8088-656c-4aec-ad32-4c11959eac7c None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:13.903854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d8088-656c-4aec-ad32-4c11959eac7c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:13.903854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d8088-656c-4aec-ad32-4c11959eac7c None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:13.905238 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:37:13.910923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc5639-fee8-45fe-baf1-10ebd92ba59c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:13.911362 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc5639-fee8-45fe-baf1-10ebd92ba59c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:13.911467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc5639-fee8-45fe-baf1-10ebd92ba59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:13.977338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-27dc5639-fee8-45fe-baf1-10ebd92ba59c None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:13.978788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-27dc5639-fee8-45fe-baf1-10ebd92ba59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:14.018549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:14.077839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:14.361641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d8088-656c-4aec-ad32-4c11959eac7c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:14.363167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8b9d8088-656c-4aec-ad32-4c11959eac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:14.466062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d8088-656c-4aec-ad32-4c11959eac7c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:14.503605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:14.540619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b86326-0623-4e66-85af-442fb791add9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:14.541897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86326-0623-4e66-85af-442fb791add9 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:14.542213 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86326-0623-4e66-85af-442fb791add9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:14.542465 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86326-0623-4e66-85af-442fb791add9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:14.544101 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d3b86326-0623-4e66-85af-442fb791add9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:14.653941 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b86326-0623-4e66-85af-442fb791add9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:14.655300 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b86326-0623-4e66-85af-442fb791add9 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:14.673147 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 736/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:37:16.636545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db2d0a-f78a-4d0a-8e16-f64c5f3a5b61 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:16.637293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db2d0a-f78a-4d0a-8e16-f64c5f3a5b61 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:16.637419 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db2d0a-f78a-4d0a-8e16-f64c5f3a5b61 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:16.639527 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:37:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:37:16.645159 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc39335-7ed5-4536-a398-3e9ec91a565b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:16.645657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc39335-7ed5-4536-a398-3e9ec91a565b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:16.645881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc39335-7ed5-4536-a398-3e9ec91a565b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:16.714486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5fc39335-7ed5-4536-a398-3e9ec91a565b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:16.719912 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5fc39335-7ed5-4536-a398-3e9ec91a565b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:16.733842 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:16.815641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:17.096177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db2d0a-f78a-4d0a-8e16-f64c5f3a5b61 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:17.097789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-92db2d0a-f78a-4d0a-8e16-f64c5f3a5b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:17.204801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db2d0a-f78a-4d0a-8e16-f64c5f3a5b61 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:17.270235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:17.277169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c22c8-4a73-4199-bd37-0cfae6860979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:17.277827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c22c8-4a73-4199-bd37-0cfae6860979 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:17.278104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c22c8-4a73-4199-bd37-0cfae6860979 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:17.278372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c22c8-4a73-4199-bd37-0cfae6860979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:17.279972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6b2c22c8-4a73-4199-bd37-0cfae6860979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:17.388782 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c22c8-4a73-4199-bd37-0cfae6860979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:17.390225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c22c8-4a73-4199-bd37-0cfae6860979 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:17.409316 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 730/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:37:19.343720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5b351-0e47-4226-af46-d6507ff3d01b None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:19.344283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5b351-0e47-4226-af46-d6507ff3d01b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:19.344283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5b351-0e47-4226-af46-d6507ff3d01b None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:19.345526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:37:19.350624 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac2417-3a5d-4678-a9bb-06a9273bdd14 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:19.351025 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac2417-3a5d-4678-a9bb-06a9273bdd14 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:19.351175 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac2417-3a5d-4678-a9bb-06a9273bdd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:19.417682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-05ac2417-3a5d-4678-a9bb-06a9273bdd14 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:19.418882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-05ac2417-3a5d-4678-a9bb-06a9273bdd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:19.466772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:19.514445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:19.799459 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5b351-0e47-4226-af46-d6507ff3d01b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:19.801125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6fb5b351-0e47-4226-af46-d6507ff3d01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:19.907571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5b351-0e47-4226-af46-d6507ff3d01b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:19.956117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:19.982645 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37140ad7-59e6-4abf-9851-bfd1808216e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:19.983235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140ad7-59e6-4abf-9851-bfd1808216e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:19.983509 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140ad7-59e6-4abf-9851-bfd1808216e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:19.983775 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140ad7-59e6-4abf-9851-bfd1808216e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:19.985400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-37140ad7-59e6-4abf-9851-bfd1808216e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:20.101581 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37140ad7-59e6-4abf-9851-bfd1808216e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:20.103100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37140ad7-59e6-4abf-9851-bfd1808216e4 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:20.122411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 739/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:37:29.512834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=22 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:30.120060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=66 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:39.810746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac70ef9-e0b6-4f02-baa5-6b8617fc17d4 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:39.811323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac70ef9-e0b6-4f02-baa5-6b8617fc17d4 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:39.811323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac70ef9-e0b6-4f02-baa5-6b8617fc17d4 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:39.812663 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 732/1471] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:37:39.817803 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564a837-82c0-4191-9a2e-d6c45ff7f7a5 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:39.818259 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564a837-82c0-4191-9a2e-d6c45ff7f7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:39.818355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564a837-82c0-4191-9a2e-d6c45ff7f7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:39.884695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3564a837-82c0-4191-9a2e-d6c45ff7f7a5 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:39.885963 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3564a837-82c0-4191-9a2e-d6c45ff7f7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:39.982210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 740/1472] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:40.288529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88858b2e-949d-490c-9d60-773418059096 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:40.288824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88858b2e-949d-490c-9d60-773418059096 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:40.289090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88858b2e-949d-490c-9d60-773418059096 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:40.290521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 733/1473] 10.222.0.39 () {54 vars in 967 bytes} [Wed Aug 31 04:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:37:40.295583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eda71-b8a0-40fc-966a-0f0baf89cc72 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:40.295873 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eda71-b8a0-40fc-966a-0f0baf89cc72 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:40.296172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eda71-b8a0-40fc-966a-0f0baf89cc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:40.371690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a38eda71-b8a0-40fc-966a-0f0baf89cc72 None None] MFA Rules not processed for user `c526760ad8a04bf486d1e7e74e9ffbe3`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:40.372884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a38eda71-b8a0-40fc-966a-0f0baf89cc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:40.393369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:40.448769 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 741/1474] 10.222.0.39 () {58 vars in 1064 bytes} [Wed Aug 31 04:37:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:40.456409 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88858b2e-949d-490c-9d60-773418059096 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:40.457990 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-88858b2e-949d-490c-9d60-773418059096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:40.559726 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88858b2e-949d-490c-9d60-773418059096 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:40.631917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896724e0-7044-47fa-a14d-0abd3b1e01cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526760ad8a04bf486d1e7e74e9ffbe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:40.632511 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896724e0-7044-47fa-a14d-0abd3b1e01cd service glance] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:40.632784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896724e0-7044-47fa-a14d-0abd3b1e01cd service glance] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:40.633050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896724e0-7044-47fa-a14d-0abd3b1e01cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:40.635224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-896724e0-7044-47fa-a14d-0abd3b1e01cd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:40.689510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:40.745315 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896724e0-7044-47fa-a14d-0abd3b1e01cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:40.746747 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896724e0-7044-47fa-a14d-0abd3b1e01cd service glance] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:40.765732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 734/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:37:42.807314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60a161-3b4e-4a5e-9bf5-defe28758b22 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:42.807876 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60a161-3b4e-4a5e-9bf5-defe28758b22 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:42.807876 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60a161-3b4e-4a5e-9bf5-defe28758b22 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:42.809219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 742/1476] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:37:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:37:42.814353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bba69d-78f8-4c20-987a-284804936846 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:42.814774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bba69d-78f8-4c20-987a-284804936846 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:42.814905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bba69d-78f8-4c20-987a-284804936846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:42.881430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-67bba69d-78f8-4c20-987a-284804936846 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:42.882646 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-67bba69d-78f8-4c20-987a-284804936846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:42.977967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 735/1477] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:43.248078 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60a161-3b4e-4a5e-9bf5-defe28758b22 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:43.249652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ef60a161-3b4e-4a5e-9bf5-defe28758b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:43.372618 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60a161-3b4e-4a5e-9bf5-defe28758b22 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:43.421100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:43.464716 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2c70a-dec3-4434-858c-5ae3276d4342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:43.465570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c70a-dec3-4434-858c-5ae3276d4342 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:43.466078 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c70a-dec3-4434-858c-5ae3276d4342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:43.466371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c70a-dec3-4434-858c-5ae3276d4342 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:43.467374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2c70a-dec3-4434-858c-5ae3276d4342 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:43.469136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-46f2c70a-dec3-4434-858c-5ae3276d4342 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:37:43.469136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: warnings.warn(msg) Aug 31 04:37:43.469136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: Aug 31 04:37:43.470298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2c70a-dec3-4434-858c-5ae3276d4342 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:43.489096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 743/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 31 04:37:43 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:37:45.398959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9864e-25b0-4a1f-91f2-08edefdf6946 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:45.399554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9864e-25b0-4a1f-91f2-08edefdf6946 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:45.399554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9864e-25b0-4a1f-91f2-08edefdf6946 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:45.401522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 736/1479] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:37:45.406794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba38b5b-fe46-4fca-8fb4-fd5a6b62960c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:45.407246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba38b5b-fe46-4fca-8fb4-fd5a6b62960c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:45.407357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba38b5b-fe46-4fca-8fb4-fd5a6b62960c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:45.483863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6ba38b5b-fe46-4fca-8fb4-fd5a6b62960c None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:45.485089 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6ba38b5b-fe46-4fca-8fb4-fd5a6b62960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:45.593376 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 744/1480] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:37:45.898085 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9864e-25b0-4a1f-91f2-08edefdf6946 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:45.899637 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3cd9864e-25b0-4a1f-91f2-08edefdf6946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:45.909892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:46.045973 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9864e-25b0-4a1f-91f2-08edefdf6946 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:46.142308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:46.176349 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79921d01-fdaf-4e37-b484-27db246625e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:46.176951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79921d01-fdaf-4e37-b484-27db246625e0 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:46.177256 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79921d01-fdaf-4e37-b484-27db246625e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:46.177530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79921d01-fdaf-4e37-b484-27db246625e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:46.179129 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-79921d01-fdaf-4e37-b484-27db246625e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:46.268814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79921d01-fdaf-4e37-b484-27db246625e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:46.270431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79921d01-fdaf-4e37-b484-27db246625e0 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:46.288343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 737/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:37:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:37:48.421191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64e92c-fa2d-40c5-9b5f-2f6f0c652c59 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:48.421797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64e92c-fa2d-40c5-9b5f-2f6f0c652c59 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:48.421797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64e92c-fa2d-40c5-9b5f-2f6f0c652c59 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:48.423058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 745/1482] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:37:48.428444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29725ad0-25c0-47e5-ae87-a2f2925f943f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:48.428881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29725ad0-25c0-47e5-ae87-a2f2925f943f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:48.428995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29725ad0-25c0-47e5-ae87-a2f2925f943f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:48.496391 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-29725ad0-25c0-47e5-ae87-a2f2925f943f None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:48.497658 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-29725ad0-25c0-47e5-ae87-a2f2925f943f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:48.542985 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:48.593508 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 738/1483] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:48.880338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64e92c-fa2d-40c5-9b5f-2f6f0c652c59 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:48.881919 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5e64e92c-fa2d-40c5-9b5f-2f6f0c652c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:48.906023 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:48.985796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64e92c-fa2d-40c5-9b5f-2f6f0c652c59 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:49.059050 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953f971-f01b-40e1-aac7-85e17fee0581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:49.059654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953f971-f01b-40e1-aac7-85e17fee0581 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:49.059927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953f971-f01b-40e1-aac7-85e17fee0581 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:49.060193 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953f971-f01b-40e1-aac7-85e17fee0581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:49.061822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8953f971-f01b-40e1-aac7-85e17fee0581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:49.137448 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:49.172547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953f971-f01b-40e1-aac7-85e17fee0581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:49.174012 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953f971-f01b-40e1-aac7-85e17fee0581 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:49.192376 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 746/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:37:51.175760 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15631c62-949d-4f86-90e0-ddd15ec3f210 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:51.176263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15631c62-949d-4f86-90e0-ddd15ec3f210 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:51.176371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15631c62-949d-4f86-90e0-ddd15ec3f210 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:51.177704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 739/1485] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:37:51.183470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b071bb-03a2-485e-8677-8656b09c7600 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:51.183914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b071bb-03a2-485e-8677-8656b09c7600 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:51.184023 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b071bb-03a2-485e-8677-8656b09c7600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:51.249971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b4b071bb-03a2-485e-8677-8656b09c7600 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:51.251185 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b4b071bb-03a2-485e-8677-8656b09c7600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:51.346749 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 747/1486] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:51.638744 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15631c62-949d-4f86-90e0-ddd15ec3f210 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:51.640286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-15631c62-949d-4f86-90e0-ddd15ec3f210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:51.753082 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15631c62-949d-4f86-90e0-ddd15ec3f210 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:51.830224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:51.832004 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ea109-9d7c-41ed-833b-2a04a44eca21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:51.832608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ea109-9d7c-41ed-833b-2a04a44eca21 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:51.832883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ea109-9d7c-41ed-833b-2a04a44eca21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:51.833152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ea109-9d7c-41ed-833b-2a04a44eca21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:51.834783 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b32ea109-9d7c-41ed-833b-2a04a44eca21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:51.944423 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ea109-9d7c-41ed-833b-2a04a44eca21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:51.945804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ea109-9d7c-41ed-833b-2a04a44eca21 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:51.964773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 740/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:37:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:37:54.031274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135f09b-d7de-4fc8-a44d-a19340a7a9aa None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:54.031848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135f09b-d7de-4fc8-a44d-a19340a7a9aa None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:54.031848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135f09b-d7de-4fc8-a44d-a19340a7a9aa None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:54.033148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 748/1488] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:37:54.038902 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe00beb-64df-4f36-92f1-e113b3a6829b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:54.039337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe00beb-64df-4f36-92f1-e113b3a6829b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:54.039442 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe00beb-64df-4f36-92f1-e113b3a6829b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:54.109079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-cfe00beb-64df-4f36-92f1-e113b3a6829b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:54.110351 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cfe00beb-64df-4f36-92f1-e113b3a6829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:54.164199 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:54.208161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 741/1489] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:54.506654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135f09b-d7de-4fc8-a44d-a19340a7a9aa None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:54.508182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e135f09b-d7de-4fc8-a44d-a19340a7a9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:54.544914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:54.610724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135f09b-d7de-4fc8-a44d-a19340a7a9aa None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:54.683814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5d360-2908-4ccc-9053-233ce8b03284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:54.684411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5d360-2908-4ccc-9053-233ce8b03284 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:54.684688 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5d360-2908-4ccc-9053-233ce8b03284 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:54.684956 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5d360-2908-4ccc-9053-233ce8b03284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:54.686591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2ad5d360-2908-4ccc-9053-233ce8b03284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:54.768982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:54.798498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5d360-2908-4ccc-9053-233ce8b03284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:54.799981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5d360-2908-4ccc-9053-233ce8b03284 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:54.818749 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 749/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:37:57.051076 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a2490-03f9-422a-a3c4-d3cdc93b5a39 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:57.051617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a2490-03f9-422a-a3c4-d3cdc93b5a39 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:57.051617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a2490-03f9-422a-a3c4-d3cdc93b5a39 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:57.053015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 742/1491] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 31 04:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:37:57.059260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca4b52-6695-4a85-9763-175c387d5d6d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:57.059683 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca4b52-6695-4a85-9763-175c387d5d6d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:57.059790 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca4b52-6695-4a85-9763-175c387d5d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:57.125739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7cca4b52-6695-4a85-9763-175c387d5d6d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:37:57.126925 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7cca4b52-6695-4a85-9763-175c387d5d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:57.222340 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 750/1492] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 31 04:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:37:57.519551 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a2490-03f9-422a-a3c4-d3cdc93b5a39 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:37:57.521098 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b45a2490-03f9-422a-a3c4-d3cdc93b5a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:57.624363 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a2490-03f9-422a-a3c4-d3cdc93b5a39 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:37:57.696804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9e932-3686-485a-8916-39ea36f34dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:37:57.697427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e932-3686-485a-8916-39ea36f34dbd service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:37:57.697706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e932-3686-485a-8916-39ea36f34dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:37:57.697979 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9e932-3686-485a-8916-39ea36f34dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:37:57.699562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2ed9e932-3686-485a-8916-39ea36f34dbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:37:57.708584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:37:57.815207 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9e932-3686-485a-8916-39ea36f34dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:37:57.816632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9e932-3686-485a-8916-39ea36f34dbd service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:37:57.834935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 743/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:38:07.220524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=82 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:38:07.832838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=50 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:25.720411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aa030-74e2-4c04-a310-01b396f95181 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:25.721029 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aa030-74e2-4c04-a310-01b396f95181 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:25.721029 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aa030-74e2-4c04-a310-01b396f95181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:25.797825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-846aa030-74e2-4c04-a310-01b396f95181 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:39:25.799052 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-846aa030-74e2-4c04-a310-01b396f95181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:25.894628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 751/1494] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:39:25.903385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8cedc-5f45-4ba4-9334-b2f32c5fe262 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:25.903960 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8cedc-5f45-4ba4-9334-b2f32c5fe262 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:25.904264 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8cedc-5f45-4ba4-9334-b2f32c5fe262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:25.982401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-28d8cedc-5f45-4ba4-9334-b2f32c5fe262 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:39:25.983553 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-28d8cedc-5f45-4ba4-9334-b2f32c5fe262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:26.079644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 744/1495] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:39:26.085525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846aa030-74e2-4c04-a310-01b396f95181 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:39:26.086731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-846aa030-74e2-4c04-a310-01b396f95181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:26.098926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846aa030-74e2-4c04-a310-01b396f95181 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:39:26.161624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:26.195577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d324b-bd6d-47f9-8255-4f9482b4756e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:39:26.196180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d324b-bd6d-47f9-8255-4f9482b4756e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:26.196459 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d324b-bd6d-47f9-8255-4f9482b4756e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:26.196733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d324b-bd6d-47f9-8255-4f9482b4756e admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:26.197661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d324b-bd6d-47f9-8255-4f9482b4756e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:39:26.197969 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d324b-bd6d-47f9-8255-4f9482b4756e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:39:26.198985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-709d324b-bd6d-47f9-8255-4f9482b4756e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:39:26.198985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: warnings.warn(msg) Aug 31 04:39:26.198985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: Aug 31 04:39:26.199863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d324b-bd6d-47f9-8255-4f9482b4756e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:39:26.210913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 752/1496] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:39:26.221102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8cedc-5f45-4ba4-9334-b2f32c5fe262 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:39:26.231092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8cedc-5f45-4ba4-9334-b2f32c5fe262 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:39:26.293343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:26.327951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d4451-941c-44cc-8305-340f95816016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:39:26.328558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d4451-941c-44cc-8305-340f95816016 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:26.328836 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d4451-941c-44cc-8305-340f95816016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:26.329108 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d4451-941c-44cc-8305-340f95816016 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:26.329801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d4451-941c-44cc-8305-340f95816016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:39:26.331513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-b24d4451-941c-44cc-8305-340f95816016 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:39:26.331513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: warnings.warn(msg) Aug 31 04:39:26.331513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: Aug 31 04:39:26.332695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d4451-941c-44cc-8305-340f95816016 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:39:26.448736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 745/1497] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:39:26 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:39:26.452937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d324b-bd6d-47f9-8255-4f9482b4756e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:39:26.454521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-709d324b-bd6d-47f9-8255-4f9482b4756e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:26.488454 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d324b-bd6d-47f9-8255-4f9482b4756e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:39:26.581418 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e2452-8fc9-40dd-a5bb-192c2eb4c6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:39:26.581942 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e2452-8fc9-40dd-a5bb-192c2eb4c6aa admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:26.582218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e2452-8fc9-40dd-a5bb-192c2eb4c6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:26.582514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e2452-8fc9-40dd-a5bb-192c2eb4c6aa admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:26.583174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e2452-8fc9-40dd-a5bb-192c2eb4c6aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:39:26.584212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-9c6e2452-8fc9-40dd-a5bb-192c2eb4c6aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:39:26.584212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: warnings.warn(msg) Aug 31 04:39:26.584212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: Aug 31 04:39:26.585455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e2452-8fc9-40dd-a5bb-192c2eb4c6aa admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:39:26.715641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 753/1498] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:39:26 2022] POST /identity/v3/users => generated 290 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:39:26.719912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d4451-941c-44cc-8305-340f95816016 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:39:26.721449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b24d4451-941c-44cc-8305-340f95816016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:26.782200 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d4451-941c-44cc-8305-340f95816016 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:39:26.865024 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:26.875709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952d8f6-2406-4b9c-88b7-30273e681019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:39:26.876367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952d8f6-2406-4b9c-88b7-30273e681019 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:26.876735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952d8f6-2406-4b9c-88b7-30273e681019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:26.877004 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952d8f6-2406-4b9c-88b7-30273e681019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:26.877676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952d8f6-2406-4b9c-88b7-30273e681019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:39:26.878670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-c952d8f6-2406-4b9c-88b7-30273e681019 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:39:26.878670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: warnings.warn(msg) Aug 31 04:39:26.878670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: Aug 31 04:39:26.879551 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952d8f6-2406-4b9c-88b7-30273e681019 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:39:26.893235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 746/1499] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:39:26.896099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e2452-8fc9-40dd-a5bb-192c2eb4c6aa admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:39:26.897655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9c6e2452-8fc9-40dd-a5bb-192c2eb4c6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:26.909791 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e2452-8fc9-40dd-a5bb-192c2eb4c6aa admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:39:26.935708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:27.006833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979025c6-eeea-408f-bd31-588c584d4f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:39:27.007430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979025c6-eeea-408f-bd31-588c584d4f73 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:27.007708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979025c6-eeea-408f-bd31-588c584d4f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:27.007981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979025c6-eeea-408f-bd31-588c584d4f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:27.008617 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979025c6-eeea-408f-bd31-588c584d4f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:39:27.009762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-979025c6-eeea-408f-bd31-588c584d4f73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:39:27.009762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: warnings.warn(msg) Aug 31 04:39:27.009762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: Aug 31 04:39:27.010835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979025c6-eeea-408f-bd31-588c584d4f73 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:39:27.023046 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 754/1500] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:39:27.027859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952d8f6-2406-4b9c-88b7-30273e681019 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:39:27.029411 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c952d8f6-2406-4b9c-88b7-30273e681019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:27.065499 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952d8f6-2406-4b9c-88b7-30273e681019 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:39:27.158525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026306a8-3134-4489-9afa-2717710c7552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:39:27.159101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026306a8-3134-4489-9afa-2717710c7552 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:27.159371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026306a8-3134-4489-9afa-2717710c7552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:27.159634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026306a8-3134-4489-9afa-2717710c7552 admin admin] PATH_INFO: `/v3/projects/b25e9439e6844e6ab30c12ccb6f58250/users/099dbcd4a9d748bfb7027a80ab33d968/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:27.181866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026306a8-3134-4489-9afa-2717710c7552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25e9439e6844e6ab30c12ccb6f58250, user_id=099dbcd4a9d748bfb7027a80ab33d968, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:39:27.182967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-026306a8-3134-4489-9afa-2717710c7552 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:39:27.182967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: warnings.warn(msg) Aug 31 04:39:27.182967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: Aug 31 04:39:27.184919 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026306a8-3134-4489-9afa-2717710c7552 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:39:27.247864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 747/1501] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:39:27 2022] PUT /identity/v3/projects/b25e9439e6844e6ab30c12ccb6f58250/users/099dbcd4a9d748bfb7027a80ab33d968/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:39:27.260678 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25d0ae-fa61-4e4e-84cd-0e77229a5e99 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:27.260954 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25d0ae-fa61-4e4e-84cd-0e77229a5e99 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:27.261250 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25d0ae-fa61-4e4e-84cd-0e77229a5e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:27.317251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2b25d0ae-fa61-4e4e-84cd-0e77229a5e99 None None] MFA Rules not processed for user `099dbcd4a9d748bfb7027a80ab33d968`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:39:27.318449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2b25d0ae-fa61-4e4e-84cd-0e77229a5e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:27.395511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 755/1502] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:39:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:39:27.408818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0151352-6cc9-464c-b40e-b524c140f54e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:27.409042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0151352-6cc9-464c-b40e-b524c140f54e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:27.409340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0151352-6cc9-464c-b40e-b524c140f54e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:27.410925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 748/1503] 10.222.0.39 () {54 vars in 964 bytes} [Wed Aug 31 04:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:39:27.415498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c65eca-002a-4f88-b141-6309d7a322d1 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:27.416275 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c65eca-002a-4f88-b141-6309d7a322d1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:27.416550 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c65eca-002a-4f88-b141-6309d7a322d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:27.448555 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:27.494082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e8c65eca-002a-4f88-b141-6309d7a322d1 None None] MFA Rules not processed for user `4455f4e327184c69aead4a7ae9737961`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:39:27.495287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e8c65eca-002a-4f88-b141-6309d7a322d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:27.570832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 756/1504] 10.222.0.39 () {58 vars in 1061 bytes} [Wed Aug 31 04:39:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:39:27.580811 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0151352-6cc9-464c-b40e-b524c140f54e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:39:27.582469 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b0151352-6cc9-464c-b40e-b524c140f54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:27.632645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:27.687669 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0151352-6cc9-464c-b40e-b524c140f54e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:39:27.761061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66650362-c2e2-4f51-a739-e1d59024d563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:39:27.761691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66650362-c2e2-4f51-a739-e1d59024d563 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:27.761969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66650362-c2e2-4f51-a739-e1d59024d563 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:27.762240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66650362-c2e2-4f51-a739-e1d59024d563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:27.763850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-66650362-c2e2-4f51-a739-e1d59024d563 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:27.861412 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66650362-c2e2-4f51-a739-e1d59024d563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:39:27.862829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66650362-c2e2-4f51-a739-e1d59024d563 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:39:27.866353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:27.881892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 749/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:39:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:39:27.927023 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256e81c-598b-41ed-914d-9df33c0dca84 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:27.927483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256e81c-598b-41ed-914d-9df33c0dca84 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:27.927594 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256e81c-598b-41ed-914d-9df33c0dca84 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:27.928801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 757/1506] 10.222.0.39 () {52 vars in 830 bytes} [Wed Aug 31 04:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:39:27.933214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66650362-c2e2-4f51-a739-e1d59024d563 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:39:27.934436 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-66650362-c2e2-4f51-a739-e1d59024d563 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:28.034094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66650362-c2e2-4f51-a739-e1d59024d563 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:39:28.126643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:39:28.127266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:28.127539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:28.127806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] PATH_INFO: `/v3/users/099dbcd4a9d748bfb7027a80ab33d968` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:28.140073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=099dbcd4a9d748bfb7027a80ab33d968)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:39:28.141072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:39:28.141072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: warnings.warn(msg) Aug 31 04:39:28.141072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: Aug 31 04:39:28.142394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:39:28.151895 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:28.359091 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099dbcd4a9d748bfb7027a80ab33d968'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:39:28.359525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099dbcd4a9d748bfb7027a80ab33d968'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:39:28.382993 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099dbcd4a9d748bfb7027a80ab33d968'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:39:28.396481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099dbcd4a9d748bfb7027a80ab33d968'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:39:28.397029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099dbcd4a9d748bfb7027a80ab33d968'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:39:28.503376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 750/1507] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:39:27 2022] DELETE /identity/v3/users/099dbcd4a9d748bfb7027a80ab33d968 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:39:28.507673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189f743-688e-4d07-bf8a-7cbfefcb9ff2 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:28.507952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189f743-688e-4d07-bf8a-7cbfefcb9ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:28.508250 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189f743-688e-4d07-bf8a-7cbfefcb9ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:28.564872 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1189f743-688e-4d07-bf8a-7cbfefcb9ff2 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:39:28.566102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1189f743-688e-4d07-bf8a-7cbfefcb9ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:28.642410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:28.654424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 758/1508] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:39:28.664201 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:39:28.665455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:28.764999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e64149-2071-4c51-a9f9-d2f1eeb3d5f1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:39:28.819176 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:28.838605 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63765d2-a3df-4d66-87bf-a77a29cba3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:39:28.839267 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63765d2-a3df-4d66-87bf-a77a29cba3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:28.839545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63765d2-a3df-4d66-87bf-a77a29cba3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:28.839812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63765d2-a3df-4d66-87bf-a77a29cba3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:28.841457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b63765d2-a3df-4d66-87bf-a77a29cba3f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:28.953579 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63765d2-a3df-4d66-87bf-a77a29cba3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:39:28.954920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63765d2-a3df-4d66-87bf-a77a29cba3f2 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:39:28.972884 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 751/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:39:29.449883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189f743-688e-4d07-bf8a-7cbfefcb9ff2 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:39:29.451193 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1189f743-688e-4d07-bf8a-7cbfefcb9ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:39:29.462502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189f743-688e-4d07-bf8a-7cbfefcb9ff2 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:39:29.561994 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99cd58-46ac-439c-9d74-d08839c841b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:39:29.562622 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99cd58-46ac-439c-9d74-d08839c841b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:39:29.562901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99cd58-46ac-439c-9d74-d08839c841b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:39:29.563172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99cd58-46ac-439c-9d74-d08839c841b5 admin admin] PATH_INFO: `/v3/projects/b25e9439e6844e6ab30c12ccb6f58250` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:39:29.573028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99cd58-46ac-439c-9d74-d08839c841b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25e9439e6844e6ab30c12ccb6f58250)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:39:29.574108 dv-cinder-855307-1-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-9a99cd58-46ac-439c-9d74-d08839c841b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:39:29.574108 dv-cinder-855307-1-smb devstack@keystone.service[81645]: warnings.warn(msg) Aug 31 04:39:29.574108 dv-cinder-855307-1-smb devstack@keystone.service[81645]: Aug 31 04:39:29.575278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99cd58-46ac-439c-9d74-d08839c841b5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:39:29.690890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9a99cd58-46ac-439c-9d74-d08839c841b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25e9439e6844e6ab30c12ccb6f58250', 'request_id': 'req-9a99cd58-46ac-439c-9d74-d08839c841b5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:39:29.760609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9a99cd58-46ac-439c-9d74-d08839c841b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25e9439e6844e6ab30c12ccb6f58250', 'request_id': 'req-9a99cd58-46ac-439c-9d74-d08839c841b5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:39:29.767045 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9a99cd58-46ac-439c-9d74-d08839c841b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25e9439e6844e6ab30c12ccb6f58250', 'request_id': 'req-9a99cd58-46ac-439c-9d74-d08839c841b5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:39:29.797841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9a99cd58-46ac-439c-9d74-d08839c841b5 admin admin] The token cache is being invalidate because project b25e9439e6844e6ab30c12ccb6f58250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:39:29.798128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9a99cd58-46ac-439c-9d74-d08839c841b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:39:29.798653 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9a99cd58-46ac-439c-9d74-d08839c841b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:39:29.799960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 759/1510] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:39:29 2022] DELETE /identity/v3/projects/b25e9439e6844e6ab30c12ccb6f58250 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:39:38.970672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=62 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:39:39.795776 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:04.042775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f167d0-8dc8-490b-b3f2-2f38d90af89b None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:04.043396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f167d0-8dc8-490b-b3f2-2f38d90af89b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:04.043396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f167d0-8dc8-490b-b3f2-2f38d90af89b None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:04.044707 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:41:04.049801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0570-0744-4747-bfa3-583744569757 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:04.050249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0570-0744-4747-bfa3-583744569757 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:04.050359 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0570-0744-4747-bfa3-583744569757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:04.131780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b2ba0570-0744-4747-bfa3-583744569757 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:41:04.132985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b2ba0570-0744-4747-bfa3-583744569757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:04.242076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:41:04.396622 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f167d0-8dc8-490b-b3f2-2f38d90af89b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:41:04.398808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a1f167d0-8dc8-490b-b3f2-2f38d90af89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:04.523078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f167d0-8dc8-490b-b3f2-2f38d90af89b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:41:04.529291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84370cf6-2bfc-4acf-8534-0bcf5e3eeaae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:41:04.529895 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370cf6-2bfc-4acf-8534-0bcf5e3eeaae service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:04.530174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370cf6-2bfc-4acf-8534-0bcf5e3eeaae service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:04.530445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370cf6-2bfc-4acf-8534-0bcf5e3eeaae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:04.538751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84370cf6-2bfc-4acf-8534-0bcf5e3eeaae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:41:04.541338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84370cf6-2bfc-4acf-8534-0bcf5e3eeaae service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:41:04.551007 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 753/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:41:05.405600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149f8b2-6829-4808-9ebc-cacfb95b8a02 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:05.406113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149f8b2-6829-4808-9ebc-cacfb95b8a02 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:05.406113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149f8b2-6829-4808-9ebc-cacfb95b8a02 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:05.407410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:41:05.412483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e61fc5-898b-4638-ab6e-95ba0c2ea3dc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:05.412874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e61fc5-898b-4638-ab6e-95ba0c2ea3dc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:05.413033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e61fc5-898b-4638-ab6e-95ba0c2ea3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:05.437142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-42e61fc5-898b-4638-ab6e-95ba0c2ea3dc None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:41:05.437823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-42e61fc5-898b-4638-ab6e-95ba0c2ea3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:05.446201 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:41:05.511681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a74f34-dfb0-4a08-b177-3915d106bbd2 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:05.512072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a74f34-dfb0-4a08-b177-3915d106bbd2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:05.512410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a74f34-dfb0-4a08-b177-3915d106bbd2 None None] PATH_INFO: `/v3` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:05.513847 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 762/1516] 10.222.0.33 () {54 vars in 925 bytes} [Wed Aug 31 04:41:05 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:41:05.519955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b9503-cc5a-4d4c-9bc8-bd921f724001 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:05.520237 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b9503-cc5a-4d4c-9bc8-bd921f724001 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:05.520525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b9503-cc5a-4d4c-9bc8-bd921f724001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:05.580805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-738b9503-cc5a-4d4c-9bc8-bd921f724001 None None] MFA Rules not processed for user `a4ad954bbb7749ee8861e8da98619006`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:41:05.582038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-738b9503-cc5a-4d4c-9bc8-bd921f724001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:05.600414 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a74f34-dfb0-4a08-b177-3915d106bbd2 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:41:05.615094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a74f34-dfb0-4a08-b177-3915d106bbd2 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:41:05.620555 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccd0cc-1bea-4503-be8a-9f3c613e9c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:41:05.621143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccd0cc-1bea-4503-be8a-9f3c613e9c35 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:05.621448 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccd0cc-1bea-4503-be8a-9f3c613e9c35 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:05.621727 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccd0cc-1bea-4503-be8a-9f3c613e9c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:05.629835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccd0cc-1bea-4503-be8a-9f3c613e9c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:41:05.631400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccd0cc-1bea-4503-be8a-9f3c613e9c35 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:41:05.638799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:05.641513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 763/1517] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:41:05.658715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 755/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Wed Aug 31 04:41:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:41:15.319241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981cdff-d65f-4da6-8c17-217e7aebdd32 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:15.319722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981cdff-d65f-4da6-8c17-217e7aebdd32 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:15.319722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981cdff-d65f-4da6-8c17-217e7aebdd32 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:15.321082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 764/1519] 10.222.0.39 () {54 vars in 961 bytes} [Wed Aug 31 04:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:41:15.326254 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeacc0-51cd-4abe-a20c-2fb46ef957c2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:15.326690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeacc0-51cd-4abe-a20c-2fb46ef957c2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:15.326794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeacc0-51cd-4abe-a20c-2fb46ef957c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:15.345880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-10aeacc0-51cd-4abe-a20c-2fb46ef957c2 None None] MFA Rules not processed for user `a4ad954bbb7749ee8861e8da98619006`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:41:15.347075 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-10aeacc0-51cd-4abe-a20c-2fb46ef957c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:15.356084 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 756/1520] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Aug 31 04:41:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:41:15.363356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981cdff-d65f-4da6-8c17-217e7aebdd32 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:41:15.377269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981cdff-d65f-4da6-8c17-217e7aebdd32 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:41:15.382194 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95934d1a-f161-4234-ae20-f4feb1a8574b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ad954bbb7749ee8861e8da98619006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:41:15.382774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95934d1a-f161-4234-ae20-f4feb1a8574b service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:15.383053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95934d1a-f161-4234-ae20-f4feb1a8574b service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:15.383328 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95934d1a-f161-4234-ae20-f4feb1a8574b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:15.391461 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95934d1a-f161-4234-ae20-f4feb1a8574b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:41:15.393010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95934d1a-f161-4234-ae20-f4feb1a8574b service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:41:15.402478 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 765/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:41:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:41:16.888535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d48ae9-9e77-41a2-8eb3-08aa913ac955 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:16.889124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d48ae9-9e77-41a2-8eb3-08aa913ac955 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:16.889124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d48ae9-9e77-41a2-8eb3-08aa913ac955 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:16.890453 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:41:16.895364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66b124-a774-4d33-8e7b-fab388d80cf9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:16.895765 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66b124-a774-4d33-8e7b-fab388d80cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:16.895912 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66b124-a774-4d33-8e7b-fab388d80cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:16.916553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6e66b124-a774-4d33-8e7b-fab388d80cf9 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:41:16.917780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6e66b124-a774-4d33-8e7b-fab388d80cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:16.925506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:41:17.079338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d48ae9-9e77-41a2-8eb3-08aa913ac955 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:41:17.094204 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d48ae9-9e77-41a2-8eb3-08aa913ac955 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:41:17.099562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80890b-ad56-4d9f-8826-b5c30b92989c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:41:17.100145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80890b-ad56-4d9f-8826-b5c30b92989c service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:17.100419 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80890b-ad56-4d9f-8826-b5c30b92989c service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:17.100688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80890b-ad56-4d9f-8826-b5c30b92989c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:17.109016 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80890b-ad56-4d9f-8826-b5c30b92989c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:41:17.110665 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80890b-ad56-4d9f-8826-b5c30b92989c service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:41:17.120846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 758/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:41:17.966600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9b3b-a9b4-4b22-82d0-7a3d489f1362 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:17.967178 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9b3b-a9b4-4b22-82d0-7a3d489f1362 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:17.967178 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9b3b-a9b4-4b22-82d0-7a3d489f1362 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:17.968491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:41:17.973251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28193eb5-0470-4956-88aa-7f566060676f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:17.973706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28193eb5-0470-4956-88aa-7f566060676f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:17.973828 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28193eb5-0470-4956-88aa-7f566060676f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:17.993486 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-28193eb5-0470-4956-88aa-7f566060676f None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:41:17.994824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-28193eb5-0470-4956-88aa-7f566060676f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:18.002580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:41:18.155330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb9b3b-a9b4-4b22-82d0-7a3d489f1362 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:41:18.169943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb9b3b-a9b4-4b22-82d0-7a3d489f1362 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:41:18.175314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5382e3-55d9-46bf-a133-b52ef07e45f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:41:18.175900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5382e3-55d9-46bf-a133-b52ef07e45f8 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:18.176182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5382e3-55d9-46bf-a133-b52ef07e45f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:18.176453 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5382e3-55d9-46bf-a133-b52ef07e45f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:18.185083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5382e3-55d9-46bf-a133-b52ef07e45f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:41:18.186694 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5382e3-55d9-46bf-a133-b52ef07e45f8 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:41:18.196704 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 768/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:41:22.027854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572ec4a-bc91-4963-b557-c00150fe5d92 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:22.028421 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572ec4a-bc91-4963-b557-c00150fe5d92 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:22.028524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572ec4a-bc91-4963-b557-c00150fe5d92 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:22.029838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:41:22.035254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582a3ef-bff7-40d0-99ec-25454d5ce2eb None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:22.035680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582a3ef-bff7-40d0-99ec-25454d5ce2eb None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:22.035805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582a3ef-bff7-40d0-99ec-25454d5ce2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:22.056513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3582a3ef-bff7-40d0-99ec-25454d5ce2eb None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:41:22.057783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3582a3ef-bff7-40d0-99ec-25454d5ce2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:22.065633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:41:22.353277 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572ec4a-bc91-4963-b557-c00150fe5d92 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:41:22.355012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a572ec4a-bc91-4963-b557-c00150fe5d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:22.435422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572ec4a-bc91-4963-b557-c00150fe5d92 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:41:22.439228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71920cd3-60be-4764-8c62-f9015816a0ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:41:22.439842 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71920cd3-60be-4764-8c62-f9015816a0ba service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:22.440146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71920cd3-60be-4764-8c62-f9015816a0ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:22.440410 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71920cd3-60be-4764-8c62-f9015816a0ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:22.449539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71920cd3-60be-4764-8c62-f9015816a0ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:41:22.450949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71920cd3-60be-4764-8c62-f9015816a0ba service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:41:22.460152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 761/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:41:24.358597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e45329-a65b-45c3-9fec-f1db64721eb0 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:24.359168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e45329-a65b-45c3-9fec-f1db64721eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:24.359168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e45329-a65b-45c3-9fec-f1db64721eb0 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:24.360422 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:41:24.365769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef995c61-8509-49d7-b22f-9560519522db None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:24.366193 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef995c61-8509-49d7-b22f-9560519522db None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:24.366319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef995c61-8509-49d7-b22f-9560519522db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:24.386328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ef995c61-8509-49d7-b22f-9560519522db None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:41:24.387535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ef995c61-8509-49d7-b22f-9560519522db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:24.395359 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:41:24.697756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e45329-a65b-45c3-9fec-f1db64721eb0 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:41:24.699440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d1e45329-a65b-45c3-9fec-f1db64721eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:24.712430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e45329-a65b-45c3-9fec-f1db64721eb0 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:41:24.715919 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bf0e4-5232-49e1-abd4-979a530e693e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:41:24.716503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bf0e4-5232-49e1-abd4-979a530e693e service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:24.716771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bf0e4-5232-49e1-abd4-979a530e693e service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:24.717036 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bf0e4-5232-49e1-abd4-979a530e693e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:24.726042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bf0e4-5232-49e1-abd4-979a530e693e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:41:24.727648 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601bf0e4-5232-49e1-abd4-979a530e693e service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:41:24.737517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 771/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:41:28.146346 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fd4e3-2ea6-4401-b762-3cddd38d8bb0 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:28.146931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fd4e3-2ea6-4401-b762-3cddd38d8bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:28.146931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fd4e3-2ea6-4401-b762-3cddd38d8bb0 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:28.148326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:41:28.154775 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea8f1-9a84-4e67-9831-7229c56cd488 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:28.155279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea8f1-9a84-4e67-9831-7229c56cd488 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:28.155386 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea8f1-9a84-4e67-9831-7229c56cd488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:28.163631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:28.176237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c5bea8f1-9a84-4e67-9831-7229c56cd488 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:41:28.177593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c5bea8f1-9a84-4e67-9831-7229c56cd488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:28.185526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:41:28.740558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fd4e3-2ea6-4401-b762-3cddd38d8bb0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:41:28.742341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d07fd4e3-2ea6-4401-b762-3cddd38d8bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:28.822842 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fd4e3-2ea6-4401-b762-3cddd38d8bb0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:41:28.826401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cf786-dca5-4ff3-8dfc-e8e8f795bc48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:41:28.827008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cf786-dca5-4ff3-8dfc-e8e8f795bc48 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:28.827287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cf786-dca5-4ff3-8dfc-e8e8f795bc48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:28.827557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cf786-dca5-4ff3-8dfc-e8e8f795bc48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:28.836434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cf786-dca5-4ff3-8dfc-e8e8f795bc48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:41:28.838435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cf786-dca5-4ff3-8dfc-e8e8f795bc48 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:41:28.847840 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 764/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:41:30.760662 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb45df-3dd5-4555-83a7-ff5c69a0ea47 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:30.761222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb45df-3dd5-4555-83a7-ff5c69a0ea47 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:30.761222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb45df-3dd5-4555-83a7-ff5c69a0ea47 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:30.762607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:41:30.767801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9384cb7-7898-46fe-b60d-57712991f8cf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:30.768444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9384cb7-7898-46fe-b60d-57712991f8cf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:30.768444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9384cb7-7898-46fe-b60d-57712991f8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:30.788322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c9384cb7-7898-46fe-b60d-57712991f8cf None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:41:30.789560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c9384cb7-7898-46fe-b60d-57712991f8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:30.797813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:41:31.344291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb45df-3dd5-4555-83a7-ff5c69a0ea47 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:41:31.346114 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d5eb45df-3dd5-4555-83a7-ff5c69a0ea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:41:31.359287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb45df-3dd5-4555-83a7-ff5c69a0ea47 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:41:31.362733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883645d-63de-42a1-94f8-4a61da597082 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:41:31.363311 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883645d-63de-42a1-94f8-4a61da597082 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:41:31.363583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883645d-63de-42a1-94f8-4a61da597082 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:41:31.363849 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883645d-63de-42a1-94f8-4a61da597082 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:41:31.373653 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883645d-63de-42a1-94f8-4a61da597082 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:41:31.375067 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883645d-63de-42a1-94f8-4a61da597082 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:41:31.384921 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 774/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:41:40.783251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:41:41.380222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=8 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:59.039754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863afbff-189f-4b30-afe7-14e7ea9a9132 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.040427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863afbff-189f-4b30-afe7-14e7ea9a9132 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.040427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863afbff-189f-4b30-afe7-14e7ea9a9132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.070405 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-863afbff-189f-4b30-afe7-14e7ea9a9132 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.071643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-863afbff-189f-4b30-afe7-14e7ea9a9132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.083691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 766/1540] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.093696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31d734-5b3a-40c6-9d38-e51b2f435264 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.094697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31d734-5b3a-40c6-9d38-e51b2f435264 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.095004 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9021c-e2b9-44ba-a908-c4a642783c85 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.095422 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31d734-5b3a-40c6-9d38-e51b2f435264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.095617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9021c-e2b9-44ba-a908-c4a642783c85 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.095895 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9021c-e2b9-44ba-a908-c4a642783c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.124837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bc31d734-5b3a-40c6-9d38-e51b2f435264 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.126492 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bc31d734-5b3a-40c6-9d38-e51b2f435264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.137118 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b0c9021c-e2b9-44ba-a908-c4a642783c85 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.138404 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 775/1541] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.139709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b0c9021c-e2b9-44ba-a908-c4a642783c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.141342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5c98a-4da2-44bd-9302-f43778eb1482 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.142044 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5c98a-4da2-44bd-9302-f43778eb1482 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.142540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5c98a-4da2-44bd-9302-f43778eb1482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.153340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 767/1542] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:42:59.154356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9021c-e2b9-44ba-a908-c4a642783c85 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:42:59.175531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9021c-e2b9-44ba-a908-c4a642783c85 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:42:59.177871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f2f5c98a-4da2-44bd-9302-f43778eb1482 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.179395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f2f5c98a-4da2-44bd-9302-f43778eb1482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.190466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4f950-20d9-4224-bc17-f5111279c91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:42:59.191093 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4f950-20d9-4224-bc17-f5111279c91c admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.191373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4f950-20d9-4224-bc17-f5111279c91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.191664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4f950-20d9-4224-bc17-f5111279c91c admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.192302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4f950-20d9-4224-bc17-f5111279c91c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:42:59.192606 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4f950-20d9-4224-bc17-f5111279c91c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:42:59.193645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-deb4f950-20d9-4224-bc17-f5111279c91c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:42:59.193645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: warnings.warn(msg) Aug 31 04:42:59.193645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: Aug 31 04:42:59.194544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4f950-20d9-4224-bc17-f5111279c91c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:42:59.195654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 776/1543] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.197102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad787e-9b57-455f-9c92-15451147a301 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.197626 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad787e-9b57-455f-9c92-15451147a301 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.198115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad787e-9b57-455f-9c92-15451147a301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.229220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 768/1544] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:42:59.229220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2efc15-fdeb-4dcf-8185-a01f89ff0f4a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.229220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2efc15-fdeb-4dcf-8185-a01f89ff0f4a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.229220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2efc15-fdeb-4dcf-8185-a01f89ff0f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.231712 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5bad787e-9b57-455f-9c92-15451147a301 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.237804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5bad787e-9b57-455f-9c92-15451147a301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.260793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 777/1545] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.265734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bdec2-17ac-42b8-8407-c0ab4cb0fa44 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.275337 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bdec2-17ac-42b8-8407-c0ab4cb0fa44 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.275337 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bdec2-17ac-42b8-8407-c0ab4cb0fa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.275560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-aa2efc15-fdeb-4dcf-8185-a01f89ff0f4a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.275560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-aa2efc15-fdeb-4dcf-8185-a01f89ff0f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.283507 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 769/1546] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.284318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2efc15-fdeb-4dcf-8185-a01f89ff0f4a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:42:59.294309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2efc15-fdeb-4dcf-8185-a01f89ff0f4a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:42:59.294800 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f69bdec2-17ac-42b8-8407-c0ab4cb0fa44 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.296007 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f69bdec2-17ac-42b8-8407-c0ab4cb0fa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.299293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae3d9b-cc84-4107-b514-90e327e960fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:42:59.299993 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae3d9b-cc84-4107-b514-90e327e960fd admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.300273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae3d9b-cc84-4107-b514-90e327e960fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.300542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae3d9b-cc84-4107-b514-90e327e960fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.301173 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae3d9b-cc84-4107-b514-90e327e960fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:42:59.303202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae3d9b-cc84-4107-b514-90e327e960fd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:42:59.307756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 778/1547] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.307756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856e11d-e387-4cbb-9d41-3321dc5c1ade None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.307756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856e11d-e387-4cbb-9d41-3321dc5c1ade None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.307756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856e11d-e387-4cbb-9d41-3321dc5c1ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.326719 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7856e11d-e387-4cbb-9d41-3321dc5c1ade None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.327945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7856e11d-e387-4cbb-9d41-3321dc5c1ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.335827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 779/1548] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.336738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856e11d-e387-4cbb-9d41-3321dc5c1ade None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:42:59.346501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856e11d-e387-4cbb-9d41-3321dc5c1ade None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:42:59.351104 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950d15f-a761-49aa-a8e2-9339d4b3a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:42:59.351697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950d15f-a761-49aa-a8e2-9339d4b3a6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.351972 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950d15f-a761-49aa-a8e2-9339d4b3a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.352241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950d15f-a761-49aa-a8e2-9339d4b3a6c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.352881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950d15f-a761-49aa-a8e2-9339d4b3a6c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:42:59.353178 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950d15f-a761-49aa-a8e2-9339d4b3a6c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:42:59.354828 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950d15f-a761-49aa-a8e2-9339d4b3a6c9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:42:59.366857 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 780/1549] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:42:59.368034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaea74-fc9c-43ac-b4f0-2a316b22f847 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.368315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaea74-fc9c-43ac-b4f0-2a316b22f847 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.368587 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaea74-fc9c-43ac-b4f0-2a316b22f847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.388384 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9deaea74-fc9c-43ac-b4f0-2a316b22f847 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.389594 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9deaea74-fc9c-43ac-b4f0-2a316b22f847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.397235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 781/1550] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.398361 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19642278-3a47-4188-b273-40b7d7b5e208 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.398643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19642278-3a47-4188-b273-40b7d7b5e208 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.398916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19642278-3a47-4188-b273-40b7d7b5e208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.418797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-19642278-3a47-4188-b273-40b7d7b5e208 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.419748 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-19642278-3a47-4188-b273-40b7d7b5e208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.427409 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 782/1551] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.428575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250adbb1-0605-4d18-95df-38f3a3924726 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.428851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250adbb1-0605-4d18-95df-38f3a3924726 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.429116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250adbb1-0605-4d18-95df-38f3a3924726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.441315 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 770/1552] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:42:59.442707 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4c5cf-9924-4eba-b9a4-debd3e873d1a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.447330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4c5cf-9924-4eba-b9a4-debd3e873d1a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.447330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4c5cf-9924-4eba-b9a4-debd3e873d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.448612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-250adbb1-0605-4d18-95df-38f3a3924726 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.449894 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-250adbb1-0605-4d18-95df-38f3a3924726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.463937 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-41c4c5cf-9924-4eba-b9a4-debd3e873d1a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.466038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-41c4c5cf-9924-4eba-b9a4-debd3e873d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.512516 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 783/1553] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.513425 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250adbb1-0605-4d18-95df-38f3a3924726 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:42:59.522743 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250adbb1-0605-4d18-95df-38f3a3924726 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:42:59.527482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e30603-40d3-49a3-9c04-976d79cf3345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:42:59.528072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e30603-40d3-49a3-9c04-976d79cf3345 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.528351 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e30603-40d3-49a3-9c04-976d79cf3345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.528458 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 771/1554] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.528625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e30603-40d3-49a3-9c04-976d79cf3345 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.529299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e30603-40d3-49a3-9c04-976d79cf3345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:42:59.529605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e30603-40d3-49a3-9c04-976d79cf3345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:42:59.529779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80aa4e-49d9-4728-9a12-050e00e362ba None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.530067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80aa4e-49d9-4728-9a12-050e00e362ba None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.530339 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80aa4e-49d9-4728-9a12-050e00e362ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.531191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e30603-40d3-49a3-9c04-976d79cf3345 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:42:59.551242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 784/1555] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:42:59.551242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e30603-40d3-49a3-9c04-976d79cf3345 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:42:59.554131 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e30603-40d3-49a3-9c04-976d79cf3345 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:42:59.557137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-fb80aa4e-49d9-4728-9a12-050e00e362ba None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.559020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fb80aa4e-49d9-4728-9a12-050e00e362ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.559773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd5a7b-0c02-430e-b9bc-c2e8d7342e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:42:59.560365 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd5a7b-0c02-430e-b9bc-c2e8d7342e27 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.560643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd5a7b-0c02-430e-b9bc-c2e8d7342e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.560923 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd5a7b-0c02-430e-b9bc-c2e8d7342e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.561582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd5a7b-0c02-430e-b9bc-c2e8d7342e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:42:59.562593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-6fdd5a7b-0c02-430e-b9bc-c2e8d7342e27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:42:59.562593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: warnings.warn(msg) Aug 31 04:42:59.562593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: Aug 31 04:42:59.563778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd5a7b-0c02-430e-b9bc-c2e8d7342e27 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:42:59.567463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 772/1556] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.570501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a2de-dbc3-4c91-b6c7-24a2485c0f85 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.570501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a2de-dbc3-4c91-b6c7-24a2485c0f85 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.570501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a2de-dbc3-4c91-b6c7-24a2485c0f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.590905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a447a2de-dbc3-4c91-b6c7-24a2485c0f85 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.592097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a447a2de-dbc3-4c91-b6c7-24a2485c0f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.599885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 773/1557] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.601065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea071dfc-b720-4592-9234-0dac0a3af1bd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.601377 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea071dfc-b720-4592-9234-0dac0a3af1bd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.601650 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea071dfc-b720-4592-9234-0dac0a3af1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.621484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ea071dfc-b720-4592-9234-0dac0a3af1bd None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.622680 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ea071dfc-b720-4592-9234-0dac0a3af1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.630291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 774/1558] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.631001 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea071dfc-b720-4592-9234-0dac0a3af1bd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:42:59.639947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea071dfc-b720-4592-9234-0dac0a3af1bd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:42:59.644543 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112888f-89b0-49ca-9fc5-e094464cbdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:42:59.645113 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112888f-89b0-49ca-9fc5-e094464cbdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.648871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112888f-89b0-49ca-9fc5-e094464cbdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.648871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112888f-89b0-49ca-9fc5-e094464cbdb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.648871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112888f-89b0-49ca-9fc5-e094464cbdb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:42:59.648871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-4112888f-89b0-49ca-9fc5-e094464cbdb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:42:59.648871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: warnings.warn(msg) Aug 31 04:42:59.648871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: Aug 31 04:42:59.648871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112888f-89b0-49ca-9fc5-e094464cbdb2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:42:59.715994 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 785/1559] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:42:59.715994 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd5a7b-0c02-430e-b9bc-c2e8d7342e27 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:42:59.734853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 775/1560] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:42:59.739691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4abc-5213-4b53-bd77-50e5bea0e658 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.739691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4abc-5213-4b53-bd77-50e5bea0e658 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.739691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4abc-5213-4b53-bd77-50e5bea0e658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.761429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f5dd4abc-5213-4b53-bd77-50e5bea0e658 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:42:59.763081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f5dd4abc-5213-4b53-bd77-50e5bea0e658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:42:59.783884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd5a7b-0c02-430e-b9bc-c2e8d7342e27 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:42:59.790397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf335f3-330b-4a80-9bf1-35c4f607f4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:42:59.790397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf335f3-330b-4a80-9bf1-35c4f607f4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.790397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf335f3-330b-4a80-9bf1-35c4f607f4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.790397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf335f3-330b-4a80-9bf1-35c4f607f4d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.790839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf335f3-330b-4a80-9bf1-35c4f607f4d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:42:59.790839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf335f3-330b-4a80-9bf1-35c4f607f4d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:42:59.792350 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf335f3-330b-4a80-9bf1-35c4f607f4d7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:42:59.802019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:59.804921 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 786/1561] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:42:59.805751 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf335f3-330b-4a80-9bf1-35c4f607f4d7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:42:59.819752 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf335f3-330b-4a80-9bf1-35c4f607f4d7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:42:59.826625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875b7fa-0194-4bd3-ae07-0f3f69514693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:42:59.827267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875b7fa-0194-4bd3-ae07-0f3f69514693 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.827541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875b7fa-0194-4bd3-ae07-0f3f69514693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.827814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875b7fa-0194-4bd3-ae07-0f3f69514693 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.828449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875b7fa-0194-4bd3-ae07-0f3f69514693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:42:59.830361 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875b7fa-0194-4bd3-ae07-0f3f69514693 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:42:59.834225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:42:59.843731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 776/1562] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:42:59.844697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd4abc-5213-4b53-bd77-50e5bea0e658 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:42:59.854305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd4abc-5213-4b53-bd77-50e5bea0e658 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:42:59.859146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49236558-1e8a-470a-8548-bd103f3e2b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:42:59.859742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49236558-1e8a-470a-8548-bd103f3e2b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.860025 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49236558-1e8a-470a-8548-bd103f3e2b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.860295 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49236558-1e8a-470a-8548-bd103f3e2b34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.860940 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49236558-1e8a-470a-8548-bd103f3e2b34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:42:59.861265 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49236558-1e8a-470a-8548-bd103f3e2b34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:42:59.862924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49236558-1e8a-470a-8548-bd103f3e2b34 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:42:59.874843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 777/1563] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:42:59.875689 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49236558-1e8a-470a-8548-bd103f3e2b34 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:42:59.884764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49236558-1e8a-470a-8548-bd103f3e2b34 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:42:59.890110 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957660ad-fb35-4bd6-9592-036ec14c01cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:42:59.890666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957660ad-fb35-4bd6-9592-036ec14c01cb admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.890943 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957660ad-fb35-4bd6-9592-036ec14c01cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.891214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957660ad-fb35-4bd6-9592-036ec14c01cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.891832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957660ad-fb35-4bd6-9592-036ec14c01cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:42:59.892133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957660ad-fb35-4bd6-9592-036ec14c01cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:42:59.893735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957660ad-fb35-4bd6-9592-036ec14c01cb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:42:59.905339 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 778/1564] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:42:59.910999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957660ad-fb35-4bd6-9592-036ec14c01cb admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:42:59.915804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957660ad-fb35-4bd6-9592-036ec14c01cb admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:42:59.920570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec8bb0-37e1-4777-921c-b82262b7e604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:42:59.921118 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec8bb0-37e1-4777-921c-b82262b7e604 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:42:59.921426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec8bb0-37e1-4777-921c-b82262b7e604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:42:59.921699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec8bb0-37e1-4777-921c-b82262b7e604 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:42:59.922319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec8bb0-37e1-4777-921c-b82262b7e604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:42:59.922638 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec8bb0-37e1-4777-921c-b82262b7e604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:42:59.924171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec8bb0-37e1-4777-921c-b82262b7e604 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:42:59.936220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 779/1565] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:42:59.937429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec8bb0-37e1-4777-921c-b82262b7e604 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:42:59.939808 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 787/1566] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:42:59.940631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875b7fa-0194-4bd3-ae07-0f3f69514693 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:42:59.951019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec8bb0-37e1-4777-921c-b82262b7e604 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.004120 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875b7fa-0194-4bd3-ae07-0f3f69514693 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.007473 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea9511-feee-4fba-847a-06327152331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.008077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea9511-feee-4fba-847a-06327152331c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.008353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea9511-feee-4fba-847a-06327152331c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.008624 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea9511-feee-4fba-847a-06327152331c admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.008808 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65202a6c-cfbc-422f-a7cf-0d2ffead3132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.009338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea9511-feee-4fba-847a-06327152331c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.009458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65202a6c-cfbc-422f-a7cf-0d2ffead3132 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.009695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65202a6c-cfbc-422f-a7cf-0d2ffead3132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.009969 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65202a6c-cfbc-422f-a7cf-0d2ffead3132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.010615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65202a6c-cfbc-422f-a7cf-0d2ffead3132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.011270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea9511-feee-4fba-847a-06327152331c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.012837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65202a6c-cfbc-422f-a7cf-0d2ffead3132 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.022873 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 788/1567] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:00.023670 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65202a6c-cfbc-422f-a7cf-0d2ffead3132 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.033728 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65202a6c-cfbc-422f-a7cf-0d2ffead3132 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.038274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4e0f0-f92e-4bfc-a0e3-df61ce6dbbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.039113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4e0f0-f92e-4bfc-a0e3-df61ce6dbbec admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.039433 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4e0f0-f92e-4bfc-a0e3-df61ce6dbbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.039699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4e0f0-f92e-4bfc-a0e3-df61ce6dbbec admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.040318 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4e0f0-f92e-4bfc-a0e3-df61ce6dbbec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.042216 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4e0f0-f92e-4bfc-a0e3-df61ce6dbbec admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.109435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 780/1568] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:42:59 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:00.110303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea9511-feee-4fba-847a-06327152331c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.122436 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea9511-feee-4fba-847a-06327152331c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.127122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7525f3-b15f-47b9-91e9-00932c1e3af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.127706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7525f3-b15f-47b9-91e9-00932c1e3af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.127983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7525f3-b15f-47b9-91e9-00932c1e3af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.128251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7525f3-b15f-47b9-91e9-00932c1e3af9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.128889 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7525f3-b15f-47b9-91e9-00932c1e3af9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:43:00.129184 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7525f3-b15f-47b9-91e9-00932c1e3af9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.131097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7525f3-b15f-47b9-91e9-00932c1e3af9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.141951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 789/1569] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:00 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:00.142566 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4e0f0-f92e-4bfc-a0e3-df61ce6dbbec admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.152219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 781/1570] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:43:00.152219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7525f3-b15f-47b9-91e9-00932c1e3af9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.162425 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7525f3-b15f-47b9-91e9-00932c1e3af9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.211881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4e0f0-f92e-4bfc-a0e3-df61ce6dbbec admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.216726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc062d46-9353-4abd-8204-dad2796b4bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.217370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc062d46-9353-4abd-8204-dad2796b4bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.217654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc062d46-9353-4abd-8204-dad2796b4bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.217935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc062d46-9353-4abd-8204-dad2796b4bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.218563 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc062d46-9353-4abd-8204-dad2796b4bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.220506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc062d46-9353-4abd-8204-dad2796b4bb0 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.223723 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db57eff-8bce-447b-894e-7f39b77f259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.224330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db57eff-8bce-447b-894e-7f39b77f259c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.224602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db57eff-8bce-447b-894e-7f39b77f259c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.224879 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db57eff-8bce-447b-894e-7f39b77f259c admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.225539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db57eff-8bce-447b-894e-7f39b77f259c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.227412 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db57eff-8bce-447b-894e-7f39b77f259c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.316859 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 790/1571] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:00 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:00.317784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc062d46-9353-4abd-8204-dad2796b4bb0 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.350549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 782/1572] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:00 2022] POST /identity/v3/projects => generated 407 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:00.353220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db57eff-8bce-447b-894e-7f39b77f259c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.359923 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:00.380141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:00.381429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc062d46-9353-4abd-8204-dad2796b4bb0 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.415750 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db57eff-8bce-447b-894e-7f39b77f259c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.421159 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca64cd4-d553-4597-82ef-ee22dd7a6d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.421816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca64cd4-d553-4597-82ef-ee22dd7a6d32 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.422100 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca64cd4-d553-4597-82ef-ee22dd7a6d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.422367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca64cd4-d553-4597-82ef-ee22dd7a6d32 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.423048 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca64cd4-d553-4597-82ef-ee22dd7a6d32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.424981 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca64cd4-d553-4597-82ef-ee22dd7a6d32 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.439731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a38c20-2f82-4b55-9250-326e910a3126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.440371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38c20-2f82-4b55-9250-326e910a3126 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.440643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38c20-2f82-4b55-9250-326e910a3126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.440916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38c20-2f82-4b55-9250-326e910a3126 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.441592 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a38c20-2f82-4b55-9250-326e910a3126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.443491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a38c20-2f82-4b55-9250-326e910a3126 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.537865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 783/1573] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:00 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:00.539034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca64cd4-d553-4597-82ef-ee22dd7a6d32 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.549657 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca64cd4-d553-4597-82ef-ee22dd7a6d32 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.553016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 791/1574] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:00 2022] POST /identity/v3/projects => generated 357 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:00.553973 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a38c20-2f82-4b55-9250-326e910a3126 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.554314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ccf20-d838-43c5-8427-82ec42eb13d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.554851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ccf20-d838-43c5-8427-82ec42eb13d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.555127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ccf20-d838-43c5-8427-82ec42eb13d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.555394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ccf20-d838-43c5-8427-82ec42eb13d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.556224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ccf20-d838-43c5-8427-82ec42eb13d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.557645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ccf20-d838-43c5-8427-82ec42eb13d2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.573104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 784/1575] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:00.573104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ccf20-d838-43c5-8427-82ec42eb13d2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.579155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ccf20-d838-43c5-8427-82ec42eb13d2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.620079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a38c20-2f82-4b55-9250-326e910a3126 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.625062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f386bc-6c7b-46f3-8bf3-3ad7ceefd9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.625714 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f386bc-6c7b-46f3-8bf3-3ad7ceefd9dc admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.625993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f386bc-6c7b-46f3-8bf3-3ad7ceefd9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.626266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f386bc-6c7b-46f3-8bf3-3ad7ceefd9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.626909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f386bc-6c7b-46f3-8bf3-3ad7ceefd9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.628506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f386bc-6c7b-46f3-8bf3-3ad7ceefd9dc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.637550 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6922df-8b93-4c75-9f56-72bda7bff425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.638157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6922df-8b93-4c75-9f56-72bda7bff425 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.638432 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6922df-8b93-4c75-9f56-72bda7bff425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.638698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6922df-8b93-4c75-9f56-72bda7bff425 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.641801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 792/1576] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:00.641801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f386bc-6c7b-46f3-8bf3-3ad7ceefd9dc admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.642046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6922df-8b93-4c75-9f56-72bda7bff425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.642046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6922df-8b93-4c75-9f56-72bda7bff425 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.649225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f386bc-6c7b-46f3-8bf3-3ad7ceefd9dc admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.654889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c2f6b-39b9-4d76-9ec5-c12b46add1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.655479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c2f6b-39b9-4d76-9ec5-c12b46add1c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.655757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c2f6b-39b9-4d76-9ec5-c12b46add1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.656026 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c2f6b-39b9-4d76-9ec5-c12b46add1c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.656653 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c2f6b-39b9-4d76-9ec5-c12b46add1c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.658576 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c2f6b-39b9-4d76-9ec5-c12b46add1c8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.750350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 785/1577] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:00 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:00.751174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6922df-8b93-4c75-9f56-72bda7bff425 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.761084 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6922df-8b93-4c75-9f56-72bda7bff425 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.766719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dc386-df1f-469a-8c83-a460d7ff4ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.767304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dc386-df1f-469a-8c83-a460d7ff4ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.767585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dc386-df1f-469a-8c83-a460d7ff4ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.767859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dc386-df1f-469a-8c83-a460d7ff4ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.768483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795dc386-df1f-469a-8c83-a460d7ff4ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.770484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795dc386-df1f-469a-8c83-a460d7ff4ba9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.779405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 793/1578] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:00 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:00.780848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c2f6b-39b9-4d76-9ec5-c12b46add1c8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.830479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:00.846416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c2f6b-39b9-4d76-9ec5-c12b46add1c8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.851136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ab18f-8a5c-461d-b8c7-39dd9595ab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.851733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ab18f-8a5c-461d-b8c7-39dd9595ab95 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.852013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ab18f-8a5c-461d-b8c7-39dd9595ab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.852288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ab18f-8a5c-461d-b8c7-39dd9595ab95 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.852381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 786/1579] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:00 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:00.852926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ab18f-8a5c-461d-b8c7-39dd9595ab95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.853135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dc386-df1f-469a-8c83-a460d7ff4ba9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.857374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ab18f-8a5c-461d-b8c7-39dd9595ab95 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.863000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dc386-df1f-469a-8c83-a460d7ff4ba9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.867866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638d4a7-9253-43ef-8494-1088e5918945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.868485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638d4a7-9253-43ef-8494-1088e5918945 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.868812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638d4a7-9253-43ef-8494-1088e5918945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.869125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638d4a7-9253-43ef-8494-1088e5918945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.869789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638d4a7-9253-43ef-8494-1088e5918945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.872512 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638d4a7-9253-43ef-8494-1088e5918945 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.885133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 787/1580] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:00.886113 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638d4a7-9253-43ef-8494-1088e5918945 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.896234 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638d4a7-9253-43ef-8494-1088e5918945 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.900775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b4fee-6f47-48a3-bd4b-260d1481dbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.901361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b4fee-6f47-48a3-bd4b-260d1481dbd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.901638 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b4fee-6f47-48a3-bd4b-260d1481dbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.901908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b4fee-6f47-48a3-bd4b-260d1481dbd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.902666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b4fee-6f47-48a3-bd4b-260d1481dbd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.904579 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b4fee-6f47-48a3-bd4b-260d1481dbd1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:00.945793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 794/1581] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:00 2022] POST /identity/v3/users => generated 304 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:00.946605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ab18f-8a5c-461d-b8c7-39dd9595ab95 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:00.955844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ab18f-8a5c-461d-b8c7-39dd9595ab95 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:00.960373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25f3eb-894a-42ff-8c31-d79681d8eb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:00.960995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25f3eb-894a-42ff-8c31-d79681d8eb62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:00.961305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25f3eb-894a-42ff-8c31-d79681d8eb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:00.961582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25f3eb-894a-42ff-8c31-d79681d8eb62 admin admin] PATH_INFO: `/v3/projects/c870fee6a7f0493e9c5270d8db3146ed/users/08d652c6d993483fa474bcd6cf59bc30/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:00.977272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25f3eb-894a-42ff-8c31-d79681d8eb62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c870fee6a7f0493e9c5270d8db3146ed, user_id=08d652c6d993483fa474bcd6cf59bc30, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:00.978344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-7e25f3eb-894a-42ff-8c31-d79681d8eb62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:43:00.978344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: warnings.warn(msg) Aug 31 04:43:00.978344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: Aug 31 04:43:00.980829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25f3eb-894a-42ff-8c31-d79681d8eb62 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.023850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 788/1582] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:00 2022] POST /identity/v3/users => generated 279 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:01.024709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b4fee-6f47-48a3-bd4b-260d1481dbd1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.034346 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b4fee-6f47-48a3-bd4b-260d1481dbd1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.039231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217a4f4-beaa-4912-ac7e-96c6394b6095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.039797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217a4f4-beaa-4912-ac7e-96c6394b6095 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.040084 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217a4f4-beaa-4912-ac7e-96c6394b6095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.040439 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217a4f4-beaa-4912-ac7e-96c6394b6095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.041068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217a4f4-beaa-4912-ac7e-96c6394b6095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.043204 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217a4f4-beaa-4912-ac7e-96c6394b6095 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.053165 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 789/1583] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:01.054006 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217a4f4-beaa-4912-ac7e-96c6394b6095 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.062116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 795/1584] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:00 2022] PUT /identity/v3/projects/c870fee6a7f0493e9c5270d8db3146ed/users/08d652c6d993483fa474bcd6cf59bc30/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:01.063095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25f3eb-894a-42ff-8c31-d79681d8eb62 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.064902 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217a4f4-beaa-4912-ac7e-96c6394b6095 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.095817 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:01.123387 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f103ecb-9474-4cdb-8ce3-7999d5ccd247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.124050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f103ecb-9474-4cdb-8ce3-7999d5ccd247 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.124254 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f103ecb-9474-4cdb-8ce3-7999d5ccd247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.124524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f103ecb-9474-4cdb-8ce3-7999d5ccd247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.125308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f103ecb-9474-4cdb-8ce3-7999d5ccd247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.126893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f103ecb-9474-4cdb-8ce3-7999d5ccd247 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.128909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25f3eb-894a-42ff-8c31-d79681d8eb62 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.135118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a7929-b02b-4361-bc4c-0ae3e479f71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.135715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a7929-b02b-4361-bc4c-0ae3e479f71e admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.135988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a7929-b02b-4361-bc4c-0ae3e479f71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.136257 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a7929-b02b-4361-bc4c-0ae3e479f71e admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.136909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a7929-b02b-4361-bc4c-0ae3e479f71e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.137623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 790/1585] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:01.138442 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f103ecb-9474-4cdb-8ce3-7999d5ccd247 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.139190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a7929-b02b-4361-bc4c-0ae3e479f71e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.148021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f103ecb-9474-4cdb-8ce3-7999d5ccd247 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.153364 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355c121-90f0-460a-b6fd-567367873327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.153958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355c121-90f0-460a-b6fd-567367873327 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.154236 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355c121-90f0-460a-b6fd-567367873327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.154506 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355c121-90f0-460a-b6fd-567367873327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.155134 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355c121-90f0-460a-b6fd-567367873327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.156731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355c121-90f0-460a-b6fd-567367873327 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.166750 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 791/1586] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:01.167517 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355c121-90f0-460a-b6fd-567367873327 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.184159 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355c121-90f0-460a-b6fd-567367873327 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.189660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a981c1-968f-4fe2-b9d9-20efacbc83a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.190256 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a981c1-968f-4fe2-b9d9-20efacbc83a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.190529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a981c1-968f-4fe2-b9d9-20efacbc83a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.190794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a981c1-968f-4fe2-b9d9-20efacbc83a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.191425 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a981c1-968f-4fe2-b9d9-20efacbc83a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.192986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a981c1-968f-4fe2-b9d9-20efacbc83a1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.204578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 792/1587] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:01.205392 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a981c1-968f-4fe2-b9d9-20efacbc83a1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.214408 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a981c1-968f-4fe2-b9d9-20efacbc83a1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.219503 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac555775-99b3-4603-b58e-e5313a886356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.220075 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac555775-99b3-4603-b58e-e5313a886356 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.220356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac555775-99b3-4603-b58e-e5313a886356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.220646 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac555775-99b3-4603-b58e-e5313a886356 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.221303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac555775-99b3-4603-b58e-e5313a886356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.222947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac555775-99b3-4603-b58e-e5313a886356 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.237215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 793/1588] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:01.238043 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac555775-99b3-4603-b58e-e5313a886356 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.248675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac555775-99b3-4603-b58e-e5313a886356 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.253362 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab8de2-37e6-4ad0-9ba9-027db7ee3244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.253941 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab8de2-37e6-4ad0-9ba9-027db7ee3244 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.254219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab8de2-37e6-4ad0-9ba9-027db7ee3244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.254486 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab8de2-37e6-4ad0-9ba9-027db7ee3244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.255108 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab8de2-37e6-4ad0-9ba9-027db7ee3244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.256672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab8de2-37e6-4ad0-9ba9-027db7ee3244 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.266429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 796/1589] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:01 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:01.270064 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 794/1590] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:01.270197 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a7929-b02b-4361-bc4c-0ae3e479f71e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.270314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb67b0-16e3-4317-b4f5-be6b4aa05147 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.270314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb67b0-16e3-4317-b4f5-be6b4aa05147 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.270314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb67b0-16e3-4317-b4f5-be6b4aa05147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.281252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a7929-b02b-4361-bc4c-0ae3e479f71e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.285968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fa8a1-9f28-46cd-9fb1-544e9238e845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.286644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa8a1-9f28-46cd-9fb1-544e9238e845 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.286933 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa8a1-9f28-46cd-9fb1-544e9238e845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.287183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa8a1-9f28-46cd-9fb1-544e9238e845 admin admin] PATH_INFO: `/v3/projects/cf840b4b1fac49a0b7dc9b09154125c9/users/24506faab5314c3c9dcf4638982bc483/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.290541 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-15cb67b0-16e3-4317-b4f5-be6b4aa05147 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:01.291753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-15cb67b0-16e3-4317-b4f5-be6b4aa05147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:01.300530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 795/1591] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:01.301134 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb67b0-16e3-4317-b4f5-be6b4aa05147 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.306747 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fa8a1-9f28-46cd-9fb1-544e9238e845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf840b4b1fac49a0b7dc9b09154125c9, user_id=24506faab5314c3c9dcf4638982bc483, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.309826 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fa8a1-9f28-46cd-9fb1-544e9238e845 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.310892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb67b0-16e3-4317-b4f5-be6b4aa05147 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.316490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d2c69-40de-4aec-9839-5ee7a8baf9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.322738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d2c69-40de-4aec-9839-5ee7a8baf9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.322738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d2c69-40de-4aec-9839-5ee7a8baf9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.322738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d2c69-40de-4aec-9839-5ee7a8baf9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.322738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d2c69-40de-4aec-9839-5ee7a8baf9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.322738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d2c69-40de-4aec-9839-5ee7a8baf9d0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.330385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 796/1592] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:01.331165 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d2c69-40de-4aec-9839-5ee7a8baf9d0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.341063 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d2c69-40de-4aec-9839-5ee7a8baf9d0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.345602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7746195-6b88-4bf6-b02c-14f04b449860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.356228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7746195-6b88-4bf6-b02c-14f04b449860 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.356228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7746195-6b88-4bf6-b02c-14f04b449860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.356228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7746195-6b88-4bf6-b02c-14f04b449860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.356228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7746195-6b88-4bf6-b02c-14f04b449860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.356228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7746195-6b88-4bf6-b02c-14f04b449860 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.358585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 797/1593] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:01.359318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7746195-6b88-4bf6-b02c-14f04b449860 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.368573 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7746195-6b88-4bf6-b02c-14f04b449860 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.375052 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 797/1594] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:01 2022] PUT /identity/v3/projects/cf840b4b1fac49a0b7dc9b09154125c9/users/24506faab5314c3c9dcf4638982bc483/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:01.375882 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fa8a1-9f28-46cd-9fb1-544e9238e845 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.426419 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d06db1-7ae1-40d4-95bc-3dbd3308fefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.427084 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06db1-7ae1-40d4-95bc-3dbd3308fefd admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.427365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06db1-7ae1-40d4-95bc-3dbd3308fefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.427643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06db1-7ae1-40d4-95bc-3dbd3308fefd admin admin] PATH_INFO: `/v3/projects/4156e149b763469f908895d09477c651/users/afc72a79e5bf4531affc4c0023e84025/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.442667 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d06db1-7ae1-40d4-95bc-3dbd3308fefd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4156e149b763469f908895d09477c651, user_id=afc72a79e5bf4531affc4c0023e84025, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.445351 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d06db1-7ae1-40d4-95bc-3dbd3308fefd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.449964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fa8a1-9f28-46cd-9fb1-544e9238e845 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.454735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4e41c-a394-42d6-aa43-d1e49a316275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.459362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4e41c-a394-42d6-aa43-d1e49a316275 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.459362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4e41c-a394-42d6-aa43-d1e49a316275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.459362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4e41c-a394-42d6-aa43-d1e49a316275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.459362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4e41c-a394-42d6-aa43-d1e49a316275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.459362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4e41c-a394-42d6-aa43-d1e49a316275 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.468729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 798/1595] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:01.469709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4e41c-a394-42d6-aa43-d1e49a316275 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.479139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4e41c-a394-42d6-aa43-d1e49a316275 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.484208 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bae42-a289-456c-aa09-fda86abaa7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.484770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bae42-a289-456c-aa09-fda86abaa7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.485049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bae42-a289-456c-aa09-fda86abaa7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.485363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bae42-a289-456c-aa09-fda86abaa7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.486011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227bae42-a289-456c-aa09-fda86abaa7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.487554 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227bae42-a289-456c-aa09-fda86abaa7e0 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.492696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:01.495119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 798/1596] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:01 2022] PUT /identity/v3/projects/4156e149b763469f908895d09477c651/users/afc72a79e5bf4531affc4c0023e84025/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:01.508788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d06db1-7ae1-40d4-95bc-3dbd3308fefd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.508905 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 799/1597] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:01.508905 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bae42-a289-456c-aa09-fda86abaa7e0 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.542860 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:01.555179 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bae42-a289-456c-aa09-fda86abaa7e0 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.561856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d06db1-7ae1-40d4-95bc-3dbd3308fefd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.566520 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c2c94-f9ef-4cc2-bb14-002f4bccdf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.569735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c2c94-f9ef-4cc2-bb14-002f4bccdf04 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.569735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c2c94-f9ef-4cc2-bb14-002f4bccdf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.569735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c2c94-f9ef-4cc2-bb14-002f4bccdf04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.569735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c2c94-f9ef-4cc2-bb14-002f4bccdf04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.570146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c2c94-f9ef-4cc2-bb14-002f4bccdf04 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.580197 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 799/1598] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:01.582079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c2c94-f9ef-4cc2-bb14-002f4bccdf04 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.592167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c2c94-f9ef-4cc2-bb14-002f4bccdf04 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.597185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a0079-ca75-41ab-99ce-a5dd2b6738de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.598295 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a0079-ca75-41ab-99ce-a5dd2b6738de admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.598577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a0079-ca75-41ab-99ce-a5dd2b6738de admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.598854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a0079-ca75-41ab-99ce-a5dd2b6738de admin admin] PATH_INFO: `/v3/projects/4420a16aa5054f6a86030a239c84b6e7/users/75d4111e41a743bfa5016241e48bc9ed/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.608430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59750c1e-5e44-468f-bff3-c71e470fc9cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.608960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59750c1e-5e44-468f-bff3-c71e470fc9cf service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.609267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59750c1e-5e44-468f-bff3-c71e470fc9cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.609541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59750c1e-5e44-468f-bff3-c71e470fc9cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.613973 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a0079-ca75-41ab-99ce-a5dd2b6738de admin admin] RBAC: Authorizing `identity:create_grant(project_id=4420a16aa5054f6a86030a239c84b6e7, user_id=75d4111e41a743bfa5016241e48bc9ed, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.616618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a0079-ca75-41ab-99ce-a5dd2b6738de admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.618883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59750c1e-5e44-468f-bff3-c71e470fc9cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.620333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59750c1e-5e44-468f-bff3-c71e470fc9cf service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.630187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 800/1599] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:01.630942 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59750c1e-5e44-468f-bff3-c71e470fc9cf service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.640532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59750c1e-5e44-468f-bff3-c71e470fc9cf service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.645412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a44d7-b43b-42ad-b738-bd0c01c86e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.646091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a44d7-b43b-42ad-b738-bd0c01c86e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.646371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a44d7-b43b-42ad-b738-bd0c01c86e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.646644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a44d7-b43b-42ad-b738-bd0c01c86e9d admin admin] PATH_INFO: `/v3/projects/562799ffee914ac9af9645b965a7471a/users/76484010fadc42c6bc59a917f160a897/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.662647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a44d7-b43b-42ad-b738-bd0c01c86e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=562799ffee914ac9af9645b965a7471a, user_id=76484010fadc42c6bc59a917f160a897, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.665986 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a44d7-b43b-42ad-b738-bd0c01c86e9d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.688301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 800/1600] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:01 2022] PUT /identity/v3/projects/4420a16aa5054f6a86030a239c84b6e7/users/75d4111e41a743bfa5016241e48bc9ed/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:01.689714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a4fcf-c374-45f3-90bb-4364c633cd9d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.689997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a4fcf-c374-45f3-90bb-4364c633cd9d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.690261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a4fcf-c374-45f3-90bb-4364c633cd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.716683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f58a4fcf-c374-45f3-90bb-4364c633cd9d None None] MFA Rules not processed for user `24506faab5314c3c9dcf4638982bc483`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:01.717910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f58a4fcf-c374-45f3-90bb-4364c633cd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:01.771287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 801/1601] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:01 2022] PUT /identity/v3/projects/562799ffee914ac9af9645b965a7471a/users/76484010fadc42c6bc59a917f160a897/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:01.773056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a44d7-b43b-42ad-b738-bd0c01c86e9d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.795276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 801/1602] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:01.797824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a4fcf-c374-45f3-90bb-4364c633cd9d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.852809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a44d7-b43b-42ad-b738-bd0c01c86e9d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.858993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5a14c-d895-495c-8daf-dd4cb166f7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.859589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a14c-d895-495c-8daf-dd4cb166f7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.859866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a14c-d895-495c-8daf-dd4cb166f7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.860132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a14c-d895-495c-8daf-dd4cb166f7ee admin admin] PATH_INFO: `/v3/projects/bfcd8fccbf8c44b08adf9f29b5f1a186/users/03495fb55dd14c08a531e35319add43e/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.875893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5a14c-d895-495c-8daf-dd4cb166f7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcd8fccbf8c44b08adf9f29b5f1a186, user_id=03495fb55dd14c08a531e35319add43e, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.878579 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5a14c-d895-495c-8daf-dd4cb166f7ee admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.882858 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a4fcf-c374-45f3-90bb-4364c633cd9d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:01.887577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b55a2-8ee0-4131-826c-660167241e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:01.888182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b55a2-8ee0-4131-826c-660167241e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.888461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b55a2-8ee0-4131-826c-660167241e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.888734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b55a2-8ee0-4131-826c-660167241e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.889404 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b55a2-8ee0-4131-826c-660167241e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:01.891021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b55a2-8ee0-4131-826c-660167241e01 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:01.901276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 802/1603] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:01.903122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5659307-7d39-42a5-828b-9acaf45f0d97 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:01.903425 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5659307-7d39-42a5-828b-9acaf45f0d97 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:01.903680 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5659307-7d39-42a5-828b-9acaf45f0d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:01.939499 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a5659307-7d39-42a5-828b-9acaf45f0d97 None None] MFA Rules not processed for user `afc72a79e5bf4531affc4c0023e84025`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:01.940700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a5659307-7d39-42a5-828b-9acaf45f0d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:01.973733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 802/1604] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:01 2022] PUT /identity/v3/projects/bfcd8fccbf8c44b08adf9f29b5f1a186/users/03495fb55dd14c08a531e35319add43e/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:01.973733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5a14c-d895-495c-8daf-dd4cb166f7ee admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:01.976020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:01.998232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:02.012392 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 803/1605] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:02.018898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096ff43-f420-4386-af52-2dc9780f5d6a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.018898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096ff43-f420-4386-af52-2dc9780f5d6a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.018898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096ff43-f420-4386-af52-2dc9780f5d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.047341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2096ff43-f420-4386-af52-2dc9780f5d6a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:02.048591 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2096ff43-f420-4386-af52-2dc9780f5d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:02.069445 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5a14c-d895-495c-8daf-dd4cb166f7ee admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:02.074891 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b1ab8-81d8-4b53-af0e-2be7b096b4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:02.075831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b1ab8-81d8-4b53-af0e-2be7b096b4d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.076301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b1ab8-81d8-4b53-af0e-2be7b096b4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.076574 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b1ab8-81d8-4b53-af0e-2be7b096b4d7 admin admin] PATH_INFO: `/v3/projects/26c2300cba274fc88da5613bcc92e78d/users/5c474d84711b40ff910f81a1c76020ca/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.095002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b1ab8-81d8-4b53-af0e-2be7b096b4d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c2300cba274fc88da5613bcc92e78d, user_id=5c474d84711b40ff910f81a1c76020ca, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:02.098089 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b1ab8-81d8-4b53-af0e-2be7b096b4d7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:02.118121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 804/1606] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:02.119402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98434a71-b7a0-4d4c-ae07-812320e93d13 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.119682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98434a71-b7a0-4d4c-ae07-812320e93d13 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.119950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98434a71-b7a0-4d4c-ae07-812320e93d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.148445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-98434a71-b7a0-4d4c-ae07-812320e93d13 None None] MFA Rules not processed for user `76484010fadc42c6bc59a917f160a897`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:02.149803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-98434a71-b7a0-4d4c-ae07-812320e93d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:02.155423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 803/1607] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:01 2022] PUT /identity/v3/projects/26c2300cba274fc88da5613bcc92e78d/users/5c474d84711b40ff910f81a1c76020ca/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:02.157750 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cde5d1-f2d7-447d-8210-3b51cf23ef7d None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.157750 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cde5d1-f2d7-447d-8210-3b51cf23ef7d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.157750 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cde5d1-f2d7-447d-8210-3b51cf23ef7d None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.158913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 804/1608] 10.222.0.39 () {54 vars in 962 bytes} [Wed Aug 31 04:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:43:02.159597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cde5d1-f2d7-447d-8210-3b51cf23ef7d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:02.219269 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 805/1609] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:02.220811 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58969821-d8e9-4365-8c7f-081dbddd621b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.221307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58969821-d8e9-4365-8c7f-081dbddd621b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.221585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58969821-d8e9-4365-8c7f-081dbddd621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.243705 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cde5d1-f2d7-447d-8210-3b51cf23ef7d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:02.251616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9eb8d-4724-43da-8731-b03fad725f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:02.252732 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9eb8d-4724-43da-8731-b03fad725f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.253273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9eb8d-4724-43da-8731-b03fad725f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.253827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9eb8d-4724-43da-8731-b03fad725f17 admin admin] PATH_INFO: `/v3/projects/b6c53d59763d49aab80daeac0737a244/users/1224284a60e64f07ba98d80901091550/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.271383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9eb8d-4724-43da-8731-b03fad725f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c53d59763d49aab80daeac0737a244, user_id=1224284a60e64f07ba98d80901091550, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:02.272055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-58969821-d8e9-4365-8c7f-081dbddd621b None None] MFA Rules not processed for user `03495fb55dd14c08a531e35319add43e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:02.272885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-58969821-d8e9-4365-8c7f-081dbddd621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:02.274483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9eb8d-4724-43da-8731-b03fad725f17 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:02.320807 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:02.340940 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 806/1610] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:02 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:02.341625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58969821-d8e9-4365-8c7f-081dbddd621b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:02.361509 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 805/1611] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:02 2022] PUT /identity/v3/projects/b6c53d59763d49aab80daeac0737a244/users/1224284a60e64f07ba98d80901091550/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:02.362480 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9eb8d-4724-43da-8731-b03fad725f17 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:02.410607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58969821-d8e9-4365-8c7f-081dbddd621b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:02.423051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9eb8d-4724-43da-8731-b03fad725f17 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:02.427994 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d94f49-30d3-49af-913b-99f63a4b19ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:02.428602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d94f49-30d3-49af-913b-99f63a4b19ec service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.428877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d94f49-30d3-49af-913b-99f63a4b19ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.429146 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d94f49-30d3-49af-913b-99f63a4b19ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.460179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0ddf4-f270-44cf-af53-0a34241dfae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:02.461076 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0ddf4-f270-44cf-af53-0a34241dfae6 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.461390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0ddf4-f270-44cf-af53-0a34241dfae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.461669 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0ddf4-f270-44cf-af53-0a34241dfae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.473376 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:02.495364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d94f49-30d3-49af-913b-99f63a4b19ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:02.497231 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d94f49-30d3-49af-913b-99f63a4b19ec service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:02.507148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 806/1612] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:02.518786 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d53df-5d66-41ae-8eeb-eeca99c6a782 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.519076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d53df-5d66-41ae-8eeb-eeca99c6a782 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.519361 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d53df-5d66-41ae-8eeb-eeca99c6a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.528097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0ddf4-f270-44cf-af53-0a34241dfae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:02.529735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0ddf4-f270-44cf-af53-0a34241dfae6 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:02.541316 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 807/1613] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:02.542851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fbedc-61bd-4e24-9d27-a6ec09d74083 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.543187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fbedc-61bd-4e24-9d27-a6ec09d74083 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.543487 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fbedc-61bd-4e24-9d27-a6ec09d74083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.580253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-813fbedc-61bd-4e24-9d27-a6ec09d74083 None None] MFA Rules not processed for user `5c474d84711b40ff910f81a1c76020ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:02.581334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2b4d53df-5d66-41ae-8eeb-eeca99c6a782 None None] MFA Rules not processed for user `4877b72a6cea410dbb31a35c7acbd5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:02.581755 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-813fbedc-61bd-4e24-9d27-a6ec09d74083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:02.583049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2b4d53df-5d66-41ae-8eeb-eeca99c6a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:02.667492 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 808/1614] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:02.670248 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebfe05-95ac-412b-af82-9b34ffe010f0 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.672604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:02.673405 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebfe05-95ac-412b-af82-9b34ffe010f0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.680893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebfe05-95ac-412b-af82-9b34ffe010f0 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.680893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 809/1615] 10.222.0.39 () {54 vars in 962 bytes} [Wed Aug 31 04:43:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:43:02.681251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 807/1616] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Aug 31 04:43:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:02.681358 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebfe05-95ac-412b-af82-9b34ffe010f0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:02.681445 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5c564-a4eb-470a-85c7-35fa2b2192b9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.681563 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5c564-a4eb-470a-85c7-35fa2b2192b9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.681949 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5c564-a4eb-470a-85c7-35fa2b2192b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.698248 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebfe05-95ac-412b-af82-9b34ffe010f0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:02.704589 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978ed55-87db-41b7-a547-3ef89a62ec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:02.705350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ed55-87db-41b7-a547-3ef89a62ec23 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.709445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ed55-87db-41b7-a547-3ef89a62ec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.709591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2be5c564-a4eb-470a-85c7-35fa2b2192b9 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:02.709719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ed55-87db-41b7-a547-3ef89a62ec23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.709719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978ed55-87db-41b7-a547-3ef89a62ec23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:02.709891 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2be5c564-a4eb-470a-85c7-35fa2b2192b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:02.710078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978ed55-87db-41b7-a547-3ef89a62ec23 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:02.716854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 808/1617] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:02.718071 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5c564-a4eb-470a-85c7-35fa2b2192b9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:02.736852 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5c564-a4eb-470a-85c7-35fa2b2192b9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:02.741921 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf80458-c8ac-4905-bd47-c3b40037afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:02.743212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf80458-c8ac-4905-bd47-c3b40037afd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.743349 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf80458-c8ac-4905-bd47-c3b40037afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.743761 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf80458-c8ac-4905-bd47-c3b40037afd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.744452 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf80458-c8ac-4905-bd47-c3b40037afd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:02.746758 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf80458-c8ac-4905-bd47-c3b40037afd1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:02.822751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 810/1618] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:02 2022] POST /identity/v3/projects => generated 407 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:02.826544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c900-112a-4a80-bff4-6eebb7e33d62 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.827464 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c900-112a-4a80-bff4-6eebb7e33d62 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.833927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c900-112a-4a80-bff4-6eebb7e33d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.864739 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-afa3c900-112a-4a80-bff4-6eebb7e33d62 None None] MFA Rules not processed for user `4877b72a6cea410dbb31a35c7acbd5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:02.869173 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-afa3c900-112a-4a80-bff4-6eebb7e33d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:02.869774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 809/1619] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:02 2022] POST /identity/v3/projects => generated 357 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:02.869774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf80458-c8ac-4905-bd47-c3b40037afd1 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:02.959054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 811/1620] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Aug 31 04:43:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:02.960078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3c900-112a-4a80-bff4-6eebb7e33d62 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:02.969156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf80458-c8ac-4905-bd47-c3b40037afd1 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:02.975596 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aa2b7-cca7-48ef-8abf-ba4f5c087339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:02.976210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aa2b7-cca7-48ef-8abf-ba4f5c087339 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:02.976490 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aa2b7-cca7-48ef-8abf-ba4f5c087339 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:02.976762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aa2b7-cca7-48ef-8abf-ba4f5c087339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:02.996752 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:03.021105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3c900-112a-4a80-bff4-6eebb7e33d62 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:03.025067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4df56-bdf5-4872-bf7d-79ff2bfc9b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:03.025575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4df56-bdf5-4872-bf7d-79ff2bfc9b3a service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:03.026025 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4df56-bdf5-4872-bf7d-79ff2bfc9b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:03.026307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4df56-bdf5-4872-bf7d-79ff2bfc9b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:03.060832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307aa2b7-cca7-48ef-8abf-ba4f5c087339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:03.062980 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307aa2b7-cca7-48ef-8abf-ba4f5c087339 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:03.078536 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 810/1621] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:03.079692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aa2b7-cca7-48ef-8abf-ba4f5c087339 service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:03.128235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4df56-bdf5-4872-bf7d-79ff2bfc9b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:03.130539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4df56-bdf5-4872-bf7d-79ff2bfc9b3a service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:03.157154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 812/1622] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:03.157154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4df56-bdf5-4872-bf7d-79ff2bfc9b3a service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:03.179731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4df56-bdf5-4872-bf7d-79ff2bfc9b3a service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:03.195341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5feaa5-c2ae-4670-94c0-583db542a70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:03.196643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5feaa5-c2ae-4670-94c0-583db542a70f admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:03.197348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5feaa5-c2ae-4670-94c0-583db542a70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:03.197600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5feaa5-c2ae-4670-94c0-583db542a70f admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:03.198318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5feaa5-c2ae-4670-94c0-583db542a70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:03.203101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5feaa5-c2ae-4670-94c0-583db542a70f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:03.210323 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aa2b7-cca7-48ef-8abf-ba4f5c087339 service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:03.219915 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:03.226949 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873edfab-3c0b-4c98-9a26-24df48bddc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:03.229306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873edfab-3c0b-4c98-9a26-24df48bddc1f admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:03.229861 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873edfab-3c0b-4c98-9a26-24df48bddc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:03.231008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873edfab-3c0b-4c98-9a26-24df48bddc1f admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:03.233723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873edfab-3c0b-4c98-9a26-24df48bddc1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:03.237301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873edfab-3c0b-4c98-9a26-24df48bddc1f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:03.307677 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 813/1623] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:03 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:03.309360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5feaa5-c2ae-4670-94c0-583db542a70f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:03.339654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5feaa5-c2ae-4670-94c0-583db542a70f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:03.342223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 811/1624] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:03 2022] POST /identity/v3/users => generated 310 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:03.343738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873edfab-3c0b-4c98-9a26-24df48bddc1f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:03.352956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57641fb9-7cd0-41ce-9e96-3c37217e1033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:03.354514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57641fb9-7cd0-41ce-9e96-3c37217e1033 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:03.356182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57641fb9-7cd0-41ce-9e96-3c37217e1033 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:03.356524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57641fb9-7cd0-41ce-9e96-3c37217e1033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:03.363410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873edfab-3c0b-4c98-9a26-24df48bddc1f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:03.368656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528cf5c-907f-4106-84b5-255799b7758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:03.369550 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528cf5c-907f-4106-84b5-255799b7758f admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:03.370070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528cf5c-907f-4106-84b5-255799b7758f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:03.370553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528cf5c-907f-4106-84b5-255799b7758f admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:03.372134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528cf5c-907f-4106-84b5-255799b7758f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:03.374102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528cf5c-907f-4106-84b5-255799b7758f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:03.387213 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 812/1625] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:03.388393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528cf5c-907f-4106-84b5-255799b7758f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:03.414952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528cf5c-907f-4106-84b5-255799b7758f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:03.426313 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e869e-b0f1-4689-910b-29fa2d0adf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:03.426937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e869e-b0f1-4689-910b-29fa2d0adf2f admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:03.427226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e869e-b0f1-4689-910b-29fa2d0adf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:03.427514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e869e-b0f1-4689-910b-29fa2d0adf2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:03.428141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e869e-b0f1-4689-910b-29fa2d0adf2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:03.429851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e869e-b0f1-4689-910b-29fa2d0adf2f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:03.461999 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 813/1626] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:03.461999 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e869e-b0f1-4689-910b-29fa2d0adf2f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:03.470811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e869e-b0f1-4689-910b-29fa2d0adf2f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:03.479113 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57641fb9-7cd0-41ce-9e96-3c37217e1033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:03.482042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57641fb9-7cd0-41ce-9e96-3c37217e1033 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:03.487245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8bc8b-b812-46ff-ac48-610c0afdacf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:03.487984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8bc8b-b812-46ff-ac48-610c0afdacf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:03.488268 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8bc8b-b812-46ff-ac48-610c0afdacf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:03.488548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8bc8b-b812-46ff-ac48-610c0afdacf8 admin admin] PATH_INFO: `/v3/projects/581b444ef71642ee98a3124377ad3ca1/users/ba92c7266d0247d09455f62209c70d10/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:03.505797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 814/1627] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:03.507460 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5b5e7-43ef-4994-8bed-e3a9bab4e241 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:03.512189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5b5e7-43ef-4994-8bed-e3a9bab4e241 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:03.512496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5b5e7-43ef-4994-8bed-e3a9bab4e241 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:03.516168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 815/1628] 10.222.0.39 () {54 vars in 912 bytes} [Wed Aug 31 04:43:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:43:03.518292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5b5e7-43ef-4994-8bed-e3a9bab4e241 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:03.528256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8bc8b-b812-46ff-ac48-610c0afdacf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581b444ef71642ee98a3124377ad3ca1, user_id=ba92c7266d0247d09455f62209c70d10, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:03.530943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8bc8b-b812-46ff-ac48-610c0afdacf8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:03.554608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5b5e7-43ef-4994-8bed-e3a9bab4e241 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:03.582709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a735746-534f-47a2-b637-fe7428c5782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:03.593953 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a735746-534f-47a2-b637-fe7428c5782b admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:03.594237 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a735746-534f-47a2-b637-fe7428c5782b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:03.594533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a735746-534f-47a2-b637-fe7428c5782b admin admin] PATH_INFO: `/v3/projects/cbdd65f41dc34f3b81333f96a4a63f45/users/ef74d2a6468d4b4e9baf5b3d02191c04/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:03.654699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a735746-534f-47a2-b637-fe7428c5782b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbdd65f41dc34f3b81333f96a4a63f45, user_id=ef74d2a6468d4b4e9baf5b3d02191c04, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:03.661607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 814/1629] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:03 2022] PUT /identity/v3/projects/581b444ef71642ee98a3124377ad3ca1/users/ba92c7266d0247d09455f62209c70d10/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:03.665739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3b27d-e73e-434e-b486-6c1a1c620bc9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:03.666060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3b27d-e73e-434e-b486-6c1a1c620bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:03.666191 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a735746-534f-47a2-b637-fe7428c5782b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:03.666398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3b27d-e73e-434e-b486-6c1a1c620bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:03.689470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ddf3b27d-e73e-434e-b486-6c1a1c620bc9 None None] MFA Rules not processed for user `4877b72a6cea410dbb31a35c7acbd5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:03.690749 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ddf3b27d-e73e-434e-b486-6c1a1c620bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:03.752604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 816/1630] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:03 2022] PUT /identity/v3/projects/cbdd65f41dc34f3b81333f96a4a63f45/users/ef74d2a6468d4b4e9baf5b3d02191c04/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:03.753498 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a735746-534f-47a2-b637-fe7428c5782b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:03.764012 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:03.810566 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 815/1631] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:43:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:03.811950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3b27d-e73e-434e-b486-6c1a1c620bc9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:03.914869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a735746-534f-47a2-b637-fe7428c5782b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:03.929160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3b27d-e73e-434e-b486-6c1a1c620bc9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:03.932395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefebcf-1a70-4bf0-baaa-6a857ac18914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:03.933013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefebcf-1a70-4bf0-baaa-6a857ac18914 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:03.933450 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefebcf-1a70-4bf0-baaa-6a857ac18914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:03.933729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefebcf-1a70-4bf0-baaa-6a857ac18914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:03.934172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898f9e0-8bde-4eca-a227-8d97157a64cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:03.934938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898f9e0-8bde-4eca-a227-8d97157a64cc admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:03.935228 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898f9e0-8bde-4eca-a227-8d97157a64cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:03.935502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898f9e0-8bde-4eca-a227-8d97157a64cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:03.936157 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898f9e0-8bde-4eca-a227-8d97157a64cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:03.937103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefebcf-1a70-4bf0-baaa-6a857ac18914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:03.937978 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898f9e0-8bde-4eca-a227-8d97157a64cc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:03.940566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefebcf-1a70-4bf0-baaa-6a857ac18914 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:03.953391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 816/1632] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:03.953391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898f9e0-8bde-4eca-a227-8d97157a64cc admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:03.978191 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 817/1633] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:03.979250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefebcf-1a70-4bf0-baaa-6a857ac18914 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:04.005254 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefebcf-1a70-4bf0-baaa-6a857ac18914 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:04.028367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f59ec8-4f7a-4380-aa01-b284dd831860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:04.029406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f59ec8-4f7a-4380-aa01-b284dd831860 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:04.029913 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f59ec8-4f7a-4380-aa01-b284dd831860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:04.034360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f59ec8-4f7a-4380-aa01-b284dd831860 admin admin] PATH_INFO: `/v3/projects/cbdd65f41dc34f3b81333f96a4a63f45/users/ef74d2a6468d4b4e9baf5b3d02191c04/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:04.034729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f59ec8-4f7a-4380-aa01-b284dd831860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbdd65f41dc34f3b81333f96a4a63f45, user_id=ef74d2a6468d4b4e9baf5b3d02191c04, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:04.040193 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f59ec8-4f7a-4380-aa01-b284dd831860 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:04.083647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 818/1634] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:03 2022] PUT /identity/v3/projects/cbdd65f41dc34f3b81333f96a4a63f45/users/ef74d2a6468d4b4e9baf5b3d02191c04/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:04.084720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f59ec8-4f7a-4380-aa01-b284dd831860 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:04.117436 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898f9e0-8bde-4eca-a227-8d97157a64cc admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:04.185299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:04.217231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f59ec8-4f7a-4380-aa01-b284dd831860 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:04.223274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528d811-bbbc-4313-bb70-c0af8325dec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:04.224054 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d811-bbbc-4313-bb70-c0af8325dec9 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:04.224331 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d811-bbbc-4313-bb70-c0af8325dec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:04.224602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d811-bbbc-4313-bb70-c0af8325dec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:04.231941 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd994-4b6a-4c35-8a21-754345dedb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:04.232615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd994-4b6a-4c35-8a21-754345dedb87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:04.234079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd994-4b6a-4c35-8a21-754345dedb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:04.234491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd994-4b6a-4c35-8a21-754345dedb87 admin admin] PATH_INFO: `/v3/projects/581b444ef71642ee98a3124377ad3ca1/users/ba92c7266d0247d09455f62209c70d10/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:04.239970 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcd994-4b6a-4c35-8a21-754345dedb87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581b444ef71642ee98a3124377ad3ca1, user_id=ba92c7266d0247d09455f62209c70d10, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:04.246843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcd994-4b6a-4c35-8a21-754345dedb87 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:04.264399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 819/1635] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:04 2022] PUT /identity/v3/projects/581b444ef71642ee98a3124377ad3ca1/users/ba92c7266d0247d09455f62209c70d10/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:04.266853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a624ede-1ec8-463f-aabc-d5d1eb3eb0fe None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:04.266853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a624ede-1ec8-463f-aabc-d5d1eb3eb0fe None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:04.267115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a624ede-1ec8-463f-aabc-d5d1eb3eb0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:04.305141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3a624ede-1ec8-463f-aabc-d5d1eb3eb0fe None None] MFA Rules not processed for user `ef74d2a6468d4b4e9baf5b3d02191c04`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:04.307042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3a624ede-1ec8-463f-aabc-d5d1eb3eb0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:04.314194 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:04.327571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528d811-bbbc-4313-bb70-c0af8325dec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:04.329498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528d811-bbbc-4313-bb70-c0af8325dec9 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:04.344015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 817/1636] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:04.345506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecbc32-d736-4f72-aacc-34cdb3708cb2 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:04.345838 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecbc32-d736-4f72-aacc-34cdb3708cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:04.346355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecbc32-d736-4f72-aacc-34cdb3708cb2 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:04.347612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 818/1637] 10.222.0.39 () {54 vars in 912 bytes} [Wed Aug 31 04:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:43:04.348640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6ac9d-eadc-417e-a8d4-939eb29b9965 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:04.348967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6ac9d-eadc-417e-a8d4-939eb29b9965 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:04.349245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6ac9d-eadc-417e-a8d4-939eb29b9965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:04.414605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-aaa6ac9d-eadc-417e-a8d4-939eb29b9965 None None] MFA Rules not processed for user `ba92c7266d0247d09455f62209c70d10`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:04.415993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-aaa6ac9d-eadc-417e-a8d4-939eb29b9965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:04.445549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 820/1638] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:04 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:04.446927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b10be-91fd-49c8-b7ce-0138cdce4c6e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:04.447233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b10be-91fd-49c8-b7ce-0138cdce4c6e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:04.447498 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b10be-91fd-49c8-b7ce-0138cdce4c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:04.489133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-752b10be-91fd-49c8-b7ce-0138cdce4c6e None None] MFA Rules not processed for user `4877b72a6cea410dbb31a35c7acbd5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:04.491513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-752b10be-91fd-49c8-b7ce-0138cdce4c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:04.615609 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 821/1639] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:43:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:04.616691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b10be-91fd-49c8-b7ce-0138cdce4c6e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:04.650722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 819/1640] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:04.752675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b10be-91fd-49c8-b7ce-0138cdce4c6e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:04.758995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739a679-ac0e-421b-a7c9-218fb5c8d2df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:04.760008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739a679-ac0e-421b-a7c9-218fb5c8d2df service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:04.760517 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739a679-ac0e-421b-a7c9-218fb5c8d2df service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:04.760954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739a679-ac0e-421b-a7c9-218fb5c8d2df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:04.814942 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739a679-ac0e-421b-a7c9-218fb5c8d2df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:04.818764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739a679-ac0e-421b-a7c9-218fb5c8d2df service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:04.834766 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 822/1641] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:04 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:04.959587 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:04.960226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6ac9d-eadc-417e-a8d4-939eb29b9965 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:04.974883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6ac9d-eadc-417e-a8d4-939eb29b9965 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:04.985826 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34ecf8-b842-4d0c-84ef-7886298ec1ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:04.986761 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34ecf8-b842-4d0c-84ef-7886298ec1ae service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:04.987075 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34ecf8-b842-4d0c-84ef-7886298ec1ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:04.987379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34ecf8-b842-4d0c-84ef-7886298ec1ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:05.019135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34ecf8-b842-4d0c-84ef-7886298ec1ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:05.021393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34ecf8-b842-4d0c-84ef-7886298ec1ae service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:05.047513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 820/1642] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:05.281339 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739a679-ac0e-421b-a7c9-218fb5c8d2df service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:05.291851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739a679-ac0e-421b-a7c9-218fb5c8d2df service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:05.300489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad12d2d-fac7-4633-82aa-f39937cbf03a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:05.301128 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad12d2d-fac7-4633-82aa-f39937cbf03a service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:05.301432 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad12d2d-fac7-4633-82aa-f39937cbf03a service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:05.301701 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad12d2d-fac7-4633-82aa-f39937cbf03a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:05.581938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad12d2d-fac7-4633-82aa-f39937cbf03a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:05.581938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad12d2d-fac7-4633-82aa-f39937cbf03a service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:05.581938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 823/1643] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:06.372570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34ecf8-b842-4d0c-84ef-7886298ec1ae service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:06.399362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34ecf8-b842-4d0c-84ef-7886298ec1ae service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:06.415080 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae0a6a-2dd7-480e-84c6-6696ad028376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:06.415765 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae0a6a-2dd7-480e-84c6-6696ad028376 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:06.416047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae0a6a-2dd7-480e-84c6-6696ad028376 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:06.416321 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae0a6a-2dd7-480e-84c6-6696ad028376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:06.570470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad12d2d-fac7-4633-82aa-f39937cbf03a service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:06.578226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae0a6a-2dd7-480e-84c6-6696ad028376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:06.579749 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae0a6a-2dd7-480e-84c6-6696ad028376 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:06.581021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad12d2d-fac7-4633-82aa-f39937cbf03a service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:06.592086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30594837-8261-4aec-b108-d112ecca7d40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:06.593063 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 821/1644] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:06 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:06.594484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30594837-8261-4aec-b108-d112ecca7d40 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:06.594769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30594837-8261-4aec-b108-d112ecca7d40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:06.596928 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30594837-8261-4aec-b108-d112ecca7d40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:06.760578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30594837-8261-4aec-b108-d112ecca7d40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:06.762156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30594837-8261-4aec-b108-d112ecca7d40 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:06.794980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 824/1645] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:43:10.475253 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401c422-b710-4cd0-acee-19b5bb5a7630 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:10.475871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401c422-b710-4cd0-acee-19b5bb5a7630 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:10.476097 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401c422-b710-4cd0-acee-19b5bb5a7630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:10.581188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7401c422-b710-4cd0-acee-19b5bb5a7630 None None] MFA Rules not processed for user `08d652c6d993483fa474bcd6cf59bc30`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:10.582455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7401c422-b710-4cd0-acee-19b5bb5a7630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:10.685009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:10.709565 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30594837-8261-4aec-b108-d112ecca7d40 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:10.721814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 822/1646] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:10.737515 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c39b-c2db-440d-96e5-07c6b5ade91b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:10.738393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c39b-c2db-440d-96e5-07c6b5ade91b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:10.739299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c39b-c2db-440d-96e5-07c6b5ade91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:10.790811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a4f6c39b-c2db-440d-96e5-07c6b5ade91b None None] MFA Rules not processed for user `08d652c6d993483fa474bcd6cf59bc30`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:10.795483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a4f6c39b-c2db-440d-96e5-07c6b5ade91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:10.817761 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 823/1647] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:10.827835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6c39b-c2db-440d-96e5-07c6b5ade91b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:10.857884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6c39b-c2db-440d-96e5-07c6b5ade91b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:10.872273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30594837-8261-4aec-b108-d112ecca7d40 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:10.879878 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820e51a-4f20-4c35-bf71-03dbe61939e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:10.881164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1e8a5-981d-4784-b7fb-812a69e13401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:10.881758 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e51a-4f20-4c35-bf71-03dbe61939e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:10.881860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1e8a5-981d-4784-b7fb-812a69e13401 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:10.882078 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1e8a5-981d-4784-b7fb-812a69e13401 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:10.882408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1e8a5-981d-4784-b7fb-812a69e13401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:10.883507 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e51a-4f20-4c35-bf71-03dbe61939e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:10.883965 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e51a-4f20-4c35-bf71-03dbe61939e7 admin admin] PATH_INFO: `/v3/users/24506faab5314c3c9dcf4638982bc483` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:10.889054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820e51a-4f20-4c35-bf71-03dbe61939e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24506faab5314c3c9dcf4638982bc483)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:10.897040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820e51a-4f20-4c35-bf71-03dbe61939e7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:10.904059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1e8a5-981d-4784-b7fb-812a69e13401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:10.905770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1e8a5-981d-4784-b7fb-812a69e13401 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:10.930050 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 824/1648] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:43:11.178647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8820e51a-4f20-4c35-bf71-03dbe61939e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24506faab5314c3c9dcf4638982bc483'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:11.182528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8820e51a-4f20-4c35-bf71-03dbe61939e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24506faab5314c3c9dcf4638982bc483'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:11.210586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8820e51a-4f20-4c35-bf71-03dbe61939e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24506faab5314c3c9dcf4638982bc483'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:11.229471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8820e51a-4f20-4c35-bf71-03dbe61939e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24506faab5314c3c9dcf4638982bc483'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:11.230322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8820e51a-4f20-4c35-bf71-03dbe61939e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24506faab5314c3c9dcf4638982bc483'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:11.320897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedef74-bf13-4d05-9bcb-79bf9712dcf3 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:11.321183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedef74-bf13-4d05-9bcb-79bf9712dcf3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:11.321535 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedef74-bf13-4d05-9bcb-79bf9712dcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:11.324563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 825/1649] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:10 2022] DELETE /identity/v3/users/24506faab5314c3c9dcf4638982bc483 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:11.361907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-beedef74-bf13-4d05-9bcb-79bf9712dcf3 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:11.363160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-beedef74-bf13-4d05-9bcb-79bf9712dcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:11.534217 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 825/1650] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:43:11.614129 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820e51a-4f20-4c35-bf71-03dbe61939e7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:11.616681 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8820e51a-4f20-4c35-bf71-03dbe61939e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:11.624652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:11.806085 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820e51a-4f20-4c35-bf71-03dbe61939e7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:11.835536 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da09d9-1d5f-4789-9eaa-1615fff5009b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:11.850749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da09d9-1d5f-4789-9eaa-1615fff5009b service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:11.852323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da09d9-1d5f-4789-9eaa-1615fff5009b service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:11.852323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da09d9-1d5f-4789-9eaa-1615fff5009b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:11.878232 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da09d9-1d5f-4789-9eaa-1615fff5009b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:11.882253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da09d9-1d5f-4789-9eaa-1615fff5009b service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:11.912326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 826/1651] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:12.235355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743db5-d2b1-4180-b671-70dc23e2b13e None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:12.235680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743db5-d2b1-4180-b671-70dc23e2b13e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:12.235932 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743db5-d2b1-4180-b671-70dc23e2b13e None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:12.237987 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 826/1652] 10.222.0.39 () {54 vars in 912 bytes} [Wed Aug 31 04:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:43:12.245000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b5b9a-4e93-4cc0-86cc-c690387b22e9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:12.245548 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b5b9a-4e93-4cc0-86cc-c690387b22e9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:12.245990 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b5b9a-4e93-4cc0-86cc-c690387b22e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:12.326490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-820b5b9a-4e93-4cc0-86cc-c690387b22e9 None None] MFA Rules not processed for user `2c63e7e4105b41d1abfe58bf13c6125d`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:12.328435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-820b5b9a-4e93-4cc0-86cc-c690387b22e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:12.338463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 827/1653] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:43:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:12.352074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743db5-d2b1-4180-b671-70dc23e2b13e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:12.356332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-10743db5-d2b1-4180-b671-70dc23e2b13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:12.382577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743db5-d2b1-4180-b671-70dc23e2b13e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:12.392248 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f39148-edb2-46ff-8523-616db3719650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:12.393265 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f39148-edb2-46ff-8523-616db3719650 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:12.393681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f39148-edb2-46ff-8523-616db3719650 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:12.394134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f39148-edb2-46ff-8523-616db3719650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:12.411761 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f39148-edb2-46ff-8523-616db3719650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:12.414654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f39148-edb2-46ff-8523-616db3719650 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:12.432485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 827/1654] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:43:13.444297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b5b9a-4e93-4cc0-86cc-c690387b22e9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:13.446465 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-820b5b9a-4e93-4cc0-86cc-c690387b22e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:13.478375 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b5b9a-4e93-4cc0-86cc-c690387b22e9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:13.523600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3317bc-11ed-4e49-8818-30438f02d28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:13.524504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3317bc-11ed-4e49-8818-30438f02d28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:13.524922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3317bc-11ed-4e49-8818-30438f02d28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:13.525356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3317bc-11ed-4e49-8818-30438f02d28d admin admin] PATH_INFO: `/v3/projects/cf840b4b1fac49a0b7dc9b09154125c9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:13.533456 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3317bc-11ed-4e49-8818-30438f02d28d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf840b4b1fac49a0b7dc9b09154125c9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:13.533456 dv-cinder-855307-1-smb devstack@keystone.service[81644]: WARNING py.warnings [None req-4b3317bc-11ed-4e49-8818-30438f02d28d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:43:13.533456 dv-cinder-855307-1-smb devstack@keystone.service[81644]: warnings.warn(msg) Aug 31 04:43:13.533456 dv-cinder-855307-1-smb devstack@keystone.service[81644]: Aug 31 04:43:13.533456 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3317bc-11ed-4e49-8818-30438f02d28d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:13.801054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4b3317bc-11ed-4e49-8818-30438f02d28d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf840b4b1fac49a0b7dc9b09154125c9', 'request_id': 'req-4b3317bc-11ed-4e49-8818-30438f02d28d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:13.900362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f39148-edb2-46ff-8523-616db3719650 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:13.901859 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-61f39148-edb2-46ff-8523-616db3719650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:13.917101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4b3317bc-11ed-4e49-8818-30438f02d28d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf840b4b1fac49a0b7dc9b09154125c9', 'request_id': 'req-4b3317bc-11ed-4e49-8818-30438f02d28d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:13.932642 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4b3317bc-11ed-4e49-8818-30438f02d28d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf840b4b1fac49a0b7dc9b09154125c9', 'request_id': 'req-4b3317bc-11ed-4e49-8818-30438f02d28d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:14.009932 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4b3317bc-11ed-4e49-8818-30438f02d28d admin admin] The token cache is being invalidate because project cf840b4b1fac49a0b7dc9b09154125c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:14.010329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4b3317bc-11ed-4e49-8818-30438f02d28d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:14.012797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4b3317bc-11ed-4e49-8818-30438f02d28d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:14.022633 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 828/1655] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:13 2022] DELETE /identity/v3/projects/cf840b4b1fac49a0b7dc9b09154125c9 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:14.022633 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5771a3-ab85-41bf-a8b6-df25d48c0c2c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:14.024843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5771a3-ab85-41bf-a8b6-df25d48c0c2c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:14.025129 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5771a3-ab85-41bf-a8b6-df25d48c0c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:14.100665 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f39148-edb2-46ff-8523-616db3719650 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:14.104686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2d5771a3-ab85-41bf-a8b6-df25d48c0c2c None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:14.106561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2d5771a3-ab85-41bf-a8b6-df25d48c0c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:14.256364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:14.291253 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e10de4-0751-4c3c-a548-673b08471cee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ad954bbb7749ee8861e8da98619006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:14.292274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e10de4-0751-4c3c-a548-673b08471cee service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:14.292850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e10de4-0751-4c3c-a548-673b08471cee service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:14.294710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e10de4-0751-4c3c-a548-673b08471cee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:14.303583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-14e10de4-0751-4c3c-a548-673b08471cee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:14.324675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 829/1656] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:14.333538 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0843a54-eec3-41a3-bc8d-9e2663e7a95e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:14.333828 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0843a54-eec3-41a3-bc8d-9e2663e7a95e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:14.334107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0843a54-eec3-41a3-bc8d-9e2663e7a95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:14.334594 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e10de4-0751-4c3c-a548-673b08471cee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:14.336569 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e10de4-0751-4c3c-a548-673b08471cee service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:14.384679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e0843a54-eec3-41a3-bc8d-9e2663e7a95e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:14.384679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e0843a54-eec3-41a3-bc8d-9e2663e7a95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:14.384818 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 828/1657] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:43:14.386951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 830/1658] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:14.391117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e10de4-0751-4c3c-a548-673b08471cee service placement] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:14.442765 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e10de4-0751-4c3c-a548-673b08471cee service placement] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:14.473931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5efc8-6ac7-4dbb-b8c8-b4eba9a78ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:14.474655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5efc8-6ac7-4dbb-b8c8-b4eba9a78ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:14.474973 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5efc8-6ac7-4dbb-b8c8-b4eba9a78ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:14.475551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5efc8-6ac7-4dbb-b8c8-b4eba9a78ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:14.476226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5efc8-6ac7-4dbb-b8c8-b4eba9a78ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:43:14.476537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5efc8-6ac7-4dbb-b8c8-b4eba9a78ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:14.478276 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5efc8-6ac7-4dbb-b8c8-b4eba9a78ce7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:14.537261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0843a54-eec3-41a3-bc8d-9e2663e7a95e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:14.537848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 829/1659] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:43:14.549415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:14.564722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0843a54-eec3-41a3-bc8d-9e2663e7a95e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:14.583951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c189a-c48d-4004-8377-15605285b8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:14.585028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c189a-c48d-4004-8377-15605285b8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:14.585342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c189a-c48d-4004-8377-15605285b8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:14.585615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c189a-c48d-4004-8377-15605285b8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:14.586270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c189a-c48d-4004-8377-15605285b8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:14.593068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c189a-c48d-4004-8377-15605285b8e1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:14.806901 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 831/1660] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:14 2022] POST /identity/v3/projects => generated 371 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:14.823553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5efc8-6ac7-4dbb-b8c8-b4eba9a78ce7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:14.898628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5efc8-6ac7-4dbb-b8c8-b4eba9a78ce7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:15.182804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69dfb9-b2ae-4cb7-afc7-c914ea31f510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:15.184640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69dfb9-b2ae-4cb7-afc7-c914ea31f510 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:15.184640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69dfb9-b2ae-4cb7-afc7-c914ea31f510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:15.184787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69dfb9-b2ae-4cb7-afc7-c914ea31f510 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:15.185458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69dfb9-b2ae-4cb7-afc7-c914ea31f510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:15.193497 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69dfb9-b2ae-4cb7-afc7-c914ea31f510 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:15.353466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 830/1661] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:14 2022] POST /identity/v3/users => generated 286 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:15.359057 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c189a-c48d-4004-8377-15605285b8e1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:15.385096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c189a-c48d-4004-8377-15605285b8e1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:15.434850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c916e-4eec-43c8-b0a1-729fbd1bec6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:15.435797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c916e-4eec-43c8-b0a1-729fbd1bec6f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:15.441576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c916e-4eec-43c8-b0a1-729fbd1bec6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:15.441932 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c916e-4eec-43c8-b0a1-729fbd1bec6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:15.446898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c916e-4eec-43c8-b0a1-729fbd1bec6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:15.449908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c916e-4eec-43c8-b0a1-729fbd1bec6f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:15.496305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 832/1662] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:15.502599 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69dfb9-b2ae-4cb7-afc7-c914ea31f510 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:15.517048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69dfb9-b2ae-4cb7-afc7-c914ea31f510 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:15.523723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41fe88-da5c-49e3-abef-60f5c36560b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:15.524618 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41fe88-da5c-49e3-abef-60f5c36560b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:15.525073 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41fe88-da5c-49e3-abef-60f5c36560b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:15.525521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41fe88-da5c-49e3-abef-60f5c36560b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:15.526371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41fe88-da5c-49e3-abef-60f5c36560b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:15.530125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41fe88-da5c-49e3-abef-60f5c36560b7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:15.555523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c916e-4eec-43c8-b0a1-729fbd1bec6f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:15.556782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 831/1663] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:15.575267 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c916e-4eec-43c8-b0a1-729fbd1bec6f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:15.603598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed59bdd-17c1-4fa2-ad68-abf07c197843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:15.604461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed59bdd-17c1-4fa2-ad68-abf07c197843 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:15.606431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed59bdd-17c1-4fa2-ad68-abf07c197843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:15.606431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed59bdd-17c1-4fa2-ad68-abf07c197843 admin admin] PATH_INFO: `/v3/projects/1eb668c55deb4ea28d688cb542ba59d9/users/e3dec86add21489e99117335987d11b9/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:15.661822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b66623-d5c9-4aba-a823-6a3f76d3d6a3 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:15.662109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b66623-d5c9-4aba-a823-6a3f76d3d6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:15.662385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b66623-d5c9-4aba-a823-6a3f76d3d6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:15.694160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed59bdd-17c1-4fa2-ad68-abf07c197843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb668c55deb4ea28d688cb542ba59d9, user_id=e3dec86add21489e99117335987d11b9, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:15.721034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed59bdd-17c1-4fa2-ad68-abf07c197843 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:15.759367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-92b66623-d5c9-4aba-a823-6a3f76d3d6a3 None None] MFA Rules not processed for user `75d4111e41a743bfa5016241e48bc9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:15.759367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-92b66623-d5c9-4aba-a823-6a3f76d3d6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:15.817597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 833/1664] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:15 2022] PUT /identity/v3/projects/1eb668c55deb4ea28d688cb542ba59d9/users/e3dec86add21489e99117335987d11b9/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:15.818965 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197b46-4006-4ae0-a179-9d6a15040d99 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:15.819259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197b46-4006-4ae0-a179-9d6a15040d99 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:15.819538 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197b46-4006-4ae0-a179-9d6a15040d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:15.941613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-13197b46-4006-4ae0-a179-9d6a15040d99 None None] MFA Rules not processed for user `1224284a60e64f07ba98d80901091550`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:15.950422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-13197b46-4006-4ae0-a179-9d6a15040d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:15.988581 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 832/1665] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:15.990248 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a9115-d337-4247-8222-262c4affbc24 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:15.993632 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a9115-d337-4247-8222-262c4affbc24 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:15.994091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a9115-d337-4247-8222-262c4affbc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:16.034183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d93a9115-d337-4247-8222-262c4affbc24 None None] MFA Rules not processed for user `e3dec86add21489e99117335987d11b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:16.037276 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d93a9115-d337-4247-8222-262c4affbc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:16.125476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 834/1666] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:16.125476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13197b46-4006-4ae0-a179-9d6a15040d99 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:16.125476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-13197b46-4006-4ae0-a179-9d6a15040d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:16.146827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:16.220065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 833/1667] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:16.223357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ed066-c7d9-4121-9c49-b7ae82a23aec None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:16.223924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ed066-c7d9-4121-9c49-b7ae82a23aec None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:16.224308 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ed066-c7d9-4121-9c49-b7ae82a23aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:16.255551 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13197b46-4006-4ae0-a179-9d6a15040d99 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:16.268829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff955e-fff0-4923-9a45-853a908eeb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:16.268829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff955e-fff0-4923-9a45-853a908eeb6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:16.268829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff955e-fff0-4923-9a45-853a908eeb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:16.268829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff955e-fff0-4923-9a45-853a908eeb6d admin admin] PATH_INFO: `/v3/users/76484010fadc42c6bc59a917f160a897` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:16.269852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff955e-fff0-4923-9a45-853a908eeb6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=76484010fadc42c6bc59a917f160a897)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:16.274135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2f7ed066-c7d9-4121-9c49-b7ae82a23aec None None] MFA Rules not processed for user `75d4111e41a743bfa5016241e48bc9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:16.274372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff955e-fff0-4923-9a45-853a908eeb6d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:16.275368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2f7ed066-c7d9-4121-9c49-b7ae82a23aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:16.396438 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 834/1668] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:16.398074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ed066-c7d9-4121-9c49-b7ae82a23aec None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:16.403105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2f7ed066-c7d9-4121-9c49-b7ae82a23aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:16.501771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ed066-c7d9-4121-9c49-b7ae82a23aec None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:16.509260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9234ac8-d277-4694-9541-35231dd3962e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:16.510082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9234ac8-d277-4694-9541-35231dd3962e service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:16.510376 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9234ac8-d277-4694-9541-35231dd3962e service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:16.511968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9234ac8-d277-4694-9541-35231dd3962e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:16.524562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9234ac8-d277-4694-9541-35231dd3962e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:16.524562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9234ac8-d277-4694-9541-35231dd3962e service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:16.542037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 835/1669] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:16.543645 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9234ac8-d277-4694-9541-35231dd3962e service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:16.545121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d9234ac8-d277-4694-9541-35231dd3962e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:16.554592 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ebff955e-fff0-4923-9a45-853a908eeb6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76484010fadc42c6bc59a917f160a897'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:16.558591 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ebff955e-fff0-4923-9a45-853a908eeb6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76484010fadc42c6bc59a917f160a897'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:16.560573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9234ac8-d277-4694-9541-35231dd3962e service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:16.568468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f07c2-6def-4951-9249-d38242040106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:16.569110 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f07c2-6def-4951-9249-d38242040106 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:16.569453 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f07c2-6def-4951-9249-d38242040106 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:16.569730 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f07c2-6def-4951-9249-d38242040106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:16.573549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cf2f07c2-6def-4951-9249-d38242040106 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:16.574103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ebff955e-fff0-4923-9a45-853a908eeb6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76484010fadc42c6bc59a917f160a897'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:16.584125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ebff955e-fff0-4923-9a45-853a908eeb6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76484010fadc42c6bc59a917f160a897'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:16.593434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ebff955e-fff0-4923-9a45-853a908eeb6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76484010fadc42c6bc59a917f160a897'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:16.593726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f07c2-6def-4951-9249-d38242040106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:16.593726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f07c2-6def-4951-9249-d38242040106 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:16.600090 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 836/1670] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:16.633024 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f07c2-6def-4951-9249-d38242040106 service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:16.635858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cf2f07c2-6def-4951-9249-d38242040106 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:16.652293 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f07c2-6def-4951-9249-d38242040106 service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:16.658669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027e586-830c-43f4-a869-e529d4008e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:16.659422 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e586-830c-43f4-a869-e529d4008e1a service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:16.659700 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e586-830c-43f4-a869-e529d4008e1a service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:16.659973 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e586-830c-43f4-a869-e529d4008e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:16.661886 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a027e586-830c-43f4-a869-e529d4008e1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:16.674664 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027e586-830c-43f4-a869-e529d4008e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:16.676317 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027e586-830c-43f4-a869-e529d4008e1a service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:16.686131 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 837/1671] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:16 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:43:16.691095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:16.697635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 835/1672] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:16 2022] DELETE /identity/v3/users/76484010fadc42c6bc59a917f160a897 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:16.703622 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29ea03-e937-4631-a3b6-3446fabfe6b2 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:16.703992 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29ea03-e937-4631-a3b6-3446fabfe6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:16.704278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29ea03-e937-4631-a3b6-3446fabfe6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:16.732745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bd29ea03-e937-4631-a3b6-3446fabfe6b2 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:16.732745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bd29ea03-e937-4631-a3b6-3446fabfe6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:16.853253 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 838/1673] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:16.875321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff955e-fff0-4923-9a45-853a908eeb6d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:16.877038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ebff955e-fff0-4923-9a45-853a908eeb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:16.971842 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff955e-fff0-4923-9a45-853a908eeb6d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:17.006321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cd2f1-3326-4a44-8361-f62cab60d450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:17.009164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cd2f1-3326-4a44-8361-f62cab60d450 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:17.009673 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cd2f1-3326-4a44-8361-f62cab60d450 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:17.010202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cd2f1-3326-4a44-8361-f62cab60d450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:17.031795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cd2f1-3326-4a44-8361-f62cab60d450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:17.033724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cd2f1-3326-4a44-8361-f62cab60d450 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:17.050692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 836/1674] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:17.087065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29ea03-e937-4631-a3b6-3446fabfe6b2 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:17.089819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bd29ea03-e937-4631-a3b6-3446fabfe6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:17.110924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29ea03-e937-4631-a3b6-3446fabfe6b2 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:17.125375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8361fa-6a7e-466d-b548-d1df6772c42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:17.126050 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8361fa-6a7e-466d-b548-d1df6772c42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:17.127537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8361fa-6a7e-466d-b548-d1df6772c42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:17.128030 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8361fa-6a7e-466d-b548-d1df6772c42f admin admin] PATH_INFO: `/v3/users/03495fb55dd14c08a531e35319add43e` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:17.130302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8361fa-6a7e-466d-b548-d1df6772c42f admin admin] RBAC: Authorizing `identity:delete_user(user_id=03495fb55dd14c08a531e35319add43e)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:17.135542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: WARNING py.warnings [None req-1c8361fa-6a7e-466d-b548-d1df6772c42f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:43:17.135542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: warnings.warn(msg) Aug 31 04:43:17.135542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: Aug 31 04:43:17.137261 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8361fa-6a7e-466d-b548-d1df6772c42f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:17.348053 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cd2f1-3326-4a44-8361-f62cab60d450 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:17.352020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d32cd2f1-3326-4a44-8361-f62cab60d450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:17.402430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cd2f1-3326-4a44-8361-f62cab60d450 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:17.417966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775aba7-0192-48da-8bac-385c411af906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:17.418594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775aba7-0192-48da-8bac-385c411af906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:17.418913 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775aba7-0192-48da-8bac-385c411af906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:17.419175 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775aba7-0192-48da-8bac-385c411af906 admin admin] PATH_INFO: `/v3/users/e3dec86add21489e99117335987d11b9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:17.422290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775aba7-0192-48da-8bac-385c411af906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3dec86add21489e99117335987d11b9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:17.439437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775aba7-0192-48da-8bac-385c411af906 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:17.462952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1c8361fa-6a7e-466d-b548-d1df6772c42f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03495fb55dd14c08a531e35319add43e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:17.524843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1c8361fa-6a7e-466d-b548-d1df6772c42f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03495fb55dd14c08a531e35319add43e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:17.553018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:17.647377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1c8361fa-6a7e-466d-b548-d1df6772c42f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03495fb55dd14c08a531e35319add43e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:17.662456 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1c8361fa-6a7e-466d-b548-d1df6772c42f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03495fb55dd14c08a531e35319add43e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:17.664649 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1c8361fa-6a7e-466d-b548-d1df6772c42f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03495fb55dd14c08a531e35319add43e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:17.675095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 839/1675] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:17 2022] DELETE /identity/v3/users/03495fb55dd14c08a531e35319add43e => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:17.676530 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22158432-b969-489b-b369-57c45ca3b098 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:17.676915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22158432-b969-489b-b369-57c45ca3b098 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:17.677323 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22158432-b969-489b-b369-57c45ca3b098 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:17.684960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 840/1676] 10.222.0.39 () {54 vars in 912 bytes} [Wed Aug 31 04:43:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:43:17.686843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b916c2-42dc-4323-8154-e5e4ae03b919 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:17.687228 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b916c2-42dc-4323-8154-e5e4ae03b919 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:17.687566 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b916c2-42dc-4323-8154-e5e4ae03b919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:17.784701 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e775aba7-0192-48da-8bac-385c411af906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3dec86add21489e99117335987d11b9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:17.786055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e775aba7-0192-48da-8bac-385c411af906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3dec86add21489e99117335987d11b9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:17.832588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-69b916c2-42dc-4323-8154-e5e4ae03b919 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:17.836885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-69b916c2-42dc-4323-8154-e5e4ae03b919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:17.848954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e775aba7-0192-48da-8bac-385c411af906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3dec86add21489e99117335987d11b9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:17.903717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e775aba7-0192-48da-8bac-385c411af906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3dec86add21489e99117335987d11b9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:17.904761 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e775aba7-0192-48da-8bac-385c411af906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3dec86add21489e99117335987d11b9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:17.962753 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 841/1677] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:17.964993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b801131-1446-4055-929d-894fa6b1edc6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:17.974793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b801131-1446-4055-929d-894fa6b1edc6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:17.975123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b801131-1446-4055-929d-894fa6b1edc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:17.975979 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 837/1678] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:17 2022] DELETE /identity/v3/users/e3dec86add21489e99117335987d11b9 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:17.981495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995ac74-5682-46e7-908a-07593489a37d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:17.981867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995ac74-5682-46e7-908a-07593489a37d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:17.982222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995ac74-5682-46e7-908a-07593489a37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:18.038518 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9b801131-1446-4055-929d-894fa6b1edc6 None None] MFA Rules not processed for user `2c63e7e4105b41d1abfe58bf13c6125d`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:18.040621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9b801131-1446-4055-929d-894fa6b1edc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:18.047105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f995ac74-5682-46e7-908a-07593489a37d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:18.049630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f995ac74-5682-46e7-908a-07593489a37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:18.154226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 838/1679] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:18.155489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995ac74-5682-46e7-908a-07593489a37d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:18.157288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f995ac74-5682-46e7-908a-07593489a37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:18.177755 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 842/1680] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:43:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:18.195481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995ac74-5682-46e7-908a-07593489a37d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:18.207449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b801131-1446-4055-929d-894fa6b1edc6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:18.209002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9b801131-1446-4055-929d-894fa6b1edc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:18.210510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb06822-b2e2-449d-b23b-a32623ea7e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:18.211491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb06822-b2e2-449d-b23b-a32623ea7e54 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:18.214743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb06822-b2e2-449d-b23b-a32623ea7e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:18.225448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb06822-b2e2-449d-b23b-a32623ea7e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:18.233064 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:18.239641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b801131-1446-4055-929d-894fa6b1edc6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:18.253118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed67ed8-d56a-4594-83ef-ed9a9cb1f7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:18.253780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed67ed8-d56a-4594-83ef-ed9a9cb1f7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:18.253911 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb06822-b2e2-449d-b23b-a32623ea7e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:18.254073 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed67ed8-d56a-4594-83ef-ed9a9cb1f7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:18.254322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed67ed8-d56a-4594-83ef-ed9a9cb1f7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:18.255553 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb06822-b2e2-449d-b23b-a32623ea7e54 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:18.271397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 839/1681] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:18.273453 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb06822-b2e2-449d-b23b-a32623ea7e54 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:18.276143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed67ed8-d56a-4594-83ef-ed9a9cb1f7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:18.278026 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed67ed8-d56a-4594-83ef-ed9a9cb1f7a0 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:18.285577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb06822-b2e2-449d-b23b-a32623ea7e54 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:18.291180 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d905ba7-b019-41a4-92ab-430db408ed3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:18.291692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 843/1682] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:18.303263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d905ba7-b019-41a4-92ab-430db408ed3d service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:18.303796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d905ba7-b019-41a4-92ab-430db408ed3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:18.304112 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d905ba7-b019-41a4-92ab-430db408ed3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:18.325255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d905ba7-b019-41a4-92ab-430db408ed3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:18.326880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d905ba7-b019-41a4-92ab-430db408ed3d service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:18.332123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed67ed8-d56a-4594-83ef-ed9a9cb1f7a0 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:18.334073 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2ed67ed8-d56a-4594-83ef-ed9a9cb1f7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:18.352060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 840/1683] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:18.374854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed67ed8-d56a-4594-83ef-ed9a9cb1f7a0 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:18.391520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:18.392712 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:18.394263 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:18.398685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0 admin admin] PATH_INFO: `/v3/projects/562799ffee914ac9af9645b965a7471a` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:18.398685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=562799ffee914ac9af9645b965a7471a)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:18.406018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:18.595600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:18.648582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562799ffee914ac9af9645b965a7471a', 'request_id': 'req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:18.757029 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562799ffee914ac9af9645b965a7471a', 'request_id': 'req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:18.764900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562799ffee914ac9af9645b965a7471a', 'request_id': 'req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:18.787981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0 admin admin] The token cache is being invalidate because project 562799ffee914ac9af9645b965a7471a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:18.788275 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:18.789274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b67bc0c7-f92b-47d0-8f95-ae38c1c830e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:18.798911 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 844/1684] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:18 2022] DELETE /identity/v3/projects/562799ffee914ac9af9645b965a7471a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:18.804255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b904a-d16a-4b3e-96ad-1cf0f4f3133a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:18.804916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b904a-d16a-4b3e-96ad-1cf0f4f3133a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:18.804916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b904a-d16a-4b3e-96ad-1cf0f4f3133a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:18.857019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-839b904a-d16a-4b3e-96ad-1cf0f4f3133a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:18.858278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-839b904a-d16a-4b3e-96ad-1cf0f4f3133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:19.028100 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 841/1685] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:19.036703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251abc9b-c41e-4cb8-b178-bc8d9f0b8955 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:19.037301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251abc9b-c41e-4cb8-b178-bc8d9f0b8955 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:19.037979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251abc9b-c41e-4cb8-b178-bc8d9f0b8955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:19.081595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-251abc9b-c41e-4cb8-b178-bc8d9f0b8955 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:19.083176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-251abc9b-c41e-4cb8-b178-bc8d9f0b8955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:19.095173 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 845/1686] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:19.100160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b904a-d16a-4b3e-96ad-1cf0f4f3133a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:19.114462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b904a-d16a-4b3e-96ad-1cf0f4f3133a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:19.130660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741acefd-1f09-44bf-b9b2-d16329e37ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:19.132716 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741acefd-1f09-44bf-b9b2-d16329e37ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:19.138372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741acefd-1f09-44bf-b9b2-d16329e37ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:19.138853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741acefd-1f09-44bf-b9b2-d16329e37ae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:19.139784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741acefd-1f09-44bf-b9b2-d16329e37ae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:43:19.146013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741acefd-1f09-44bf-b9b2-d16329e37ae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:19.148407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741acefd-1f09-44bf-b9b2-d16329e37ae2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:19.189246 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 842/1687] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:43:19.194284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251abc9b-c41e-4cb8-b178-bc8d9f0b8955 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:19.218935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251abc9b-c41e-4cb8-b178-bc8d9f0b8955 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:19.228074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd18a5a-8c32-422a-9761-4747ee60c0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:19.236521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd18a5a-8c32-422a-9761-4747ee60c0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:19.236767 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd18a5a-8c32-422a-9761-4747ee60c0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:19.237133 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd18a5a-8c32-422a-9761-4747ee60c0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:19.238303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd18a5a-8c32-422a-9761-4747ee60c0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:19.244644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd18a5a-8c32-422a-9761-4747ee60c0c7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:19.372045 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 846/1688] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:19 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:43:19.378801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741acefd-1f09-44bf-b9b2-d16329e37ae2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:19.398362 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741acefd-1f09-44bf-b9b2-d16329e37ae2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:19.521783 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dadc04-8437-4979-9b38-e7c811ec0567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:19.522692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dadc04-8437-4979-9b38-e7c811ec0567 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:19.523853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dadc04-8437-4979-9b38-e7c811ec0567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:19.524163 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dadc04-8437-4979-9b38-e7c811ec0567 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:19.538727 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dadc04-8437-4979-9b38-e7c811ec0567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:19.548372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dadc04-8437-4979-9b38-e7c811ec0567 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:19.721961 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 843/1689] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:19 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:19.722144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd18a5a-8c32-422a-9761-4747ee60c0c7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:19.737992 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd18a5a-8c32-422a-9761-4747ee60c0c7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:19.749454 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7173d-dcac-450f-bc1d-c145ead4d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:19.750098 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7173d-dcac-450f-bc1d-c145ead4d5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:19.750387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7173d-dcac-450f-bc1d-c145ead4d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:19.750654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7173d-dcac-450f-bc1d-c145ead4d5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:19.753235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7173d-dcac-450f-bc1d-c145ead4d5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:19.754934 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7173d-dcac-450f-bc1d-c145ead4d5b9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:19.798555 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 847/1690] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:19.799795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dadc04-8437-4979-9b38-e7c811ec0567 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:19.834264 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dadc04-8437-4979-9b38-e7c811ec0567 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:19.853474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7173d-dcac-450f-bc1d-c145ead4d5b9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:19.858213 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-caa7173d-dcac-450f-bc1d-c145ead4d5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:19.884699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838dd6e-71d5-450e-809a-9f31ecc0dd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:19.885472 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838dd6e-71d5-450e-809a-9f31ecc0dd0f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:19.885632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838dd6e-71d5-450e-809a-9f31ecc0dd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:19.890772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838dd6e-71d5-450e-809a-9f31ecc0dd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:19.891830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838dd6e-71d5-450e-809a-9f31ecc0dd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:19.896178 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7173d-dcac-450f-bc1d-c145ead4d5b9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:19.897463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838dd6e-71d5-450e-809a-9f31ecc0dd0f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:19.914861 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:19.915517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:19.921536 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:19.921858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] PATH_INFO: `/v3/projects/1eb668c55deb4ea28d688cb542ba59d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:19.928477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb668c55deb4ea28d688cb542ba59d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:19.933027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 844/1691] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:19.935258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e434e-02b5-4a2d-92eb-56acdfd8aea7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:19.935459 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:19.935891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e434e-02b5-4a2d-92eb-56acdfd8aea7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:19.938423 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e434e-02b5-4a2d-92eb-56acdfd8aea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:19.975720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0f1e434e-02b5-4a2d-92eb-56acdfd8aea7 None None] MFA Rules not processed for user `75d4111e41a743bfa5016241e48bc9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:19.978692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0f1e434e-02b5-4a2d-92eb-56acdfd8aea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:20.135012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 845/1692] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:20.136716 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8ed4a-9658-4172-9834-295546f2fc47 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:20.139305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8ed4a-9658-4172-9834-295546f2fc47 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:20.141394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8ed4a-9658-4172-9834-295546f2fc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:20.154918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:20.176298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb668c55deb4ea28d688cb542ba59d9', 'request_id': 'req-8ed7c016-9771-45d1-8c07-462b26f67d93'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:20.283473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb668c55deb4ea28d688cb542ba59d9', 'request_id': 'req-8ed7c016-9771-45d1-8c07-462b26f67d93'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:20.294086 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb668c55deb4ea28d688cb542ba59d9', 'request_id': 'req-8ed7c016-9771-45d1-8c07-462b26f67d93'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:20.299580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e2c8ed4a-9658-4172-9834-295546f2fc47 None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:20.300965 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e2c8ed4a-9658-4172-9834-295546f2fc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:20.319633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] The token cache is being invalidate because project 1eb668c55deb4ea28d688cb542ba59d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:20.319929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:20.320599 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:20.326154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 848/1693] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:19 2022] DELETE /identity/v3/projects/1eb668c55deb4ea28d688cb542ba59d9 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:20.326154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:20.328428 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:20.348727 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:20.460892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7c016-9771-45d1-8c07-462b26f67d93 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:20.475872 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad592bf5-fa4a-4039-985d-a364939d9ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:20.476947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad592bf5-fa4a-4039-985d-a364939d9ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:20.477481 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad592bf5-fa4a-4039-985d-a364939d9ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:20.478315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad592bf5-fa4a-4039-985d-a364939d9ad9 admin admin] PATH_INFO: `/v3/projects/bfcd8fccbf8c44b08adf9f29b5f1a186` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:20.480465 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad592bf5-fa4a-4039-985d-a364939d9ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfcd8fccbf8c44b08adf9f29b5f1a186)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:20.484056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad592bf5-fa4a-4039-985d-a364939d9ad9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:20.524475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 846/1694] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:43:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:20.525758 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8ed4a-9658-4172-9834-295546f2fc47 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:20.527634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e2c8ed4a-9658-4172-9834-295546f2fc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:20.557177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8ed4a-9658-4172-9834-295546f2fc47 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:20.588539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73612e-2b04-4591-a291-92f6208b139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:20.589394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73612e-2b04-4591-a291-92f6208b139b admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:20.589757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73612e-2b04-4591-a291-92f6208b139b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:20.590033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73612e-2b04-4591-a291-92f6208b139b admin admin] PATH_INFO: `/v3/projects/c9cd0a58e6854b92a9f988f2f915d65f/users/d3d23a0fd2f64b418a5cda010866ba6c/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:20.633807 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73612e-2b04-4591-a291-92f6208b139b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9cd0a58e6854b92a9f988f2f915d65f, user_id=d3d23a0fd2f64b418a5cda010866ba6c, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:20.637450 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73612e-2b04-4591-a291-92f6208b139b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:20.663294 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ad592bf5-fa4a-4039-985d-a364939d9ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfcd8fccbf8c44b08adf9f29b5f1a186', 'request_id': 'req-ad592bf5-fa4a-4039-985d-a364939d9ad9'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:20.730404 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 847/1695] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:20 2022] PUT /identity/v3/projects/c9cd0a58e6854b92a9f988f2f915d65f/users/d3d23a0fd2f64b418a5cda010866ba6c/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:20.730404 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73612e-2b04-4591-a291-92f6208b139b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:20.736190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cb73612e-2b04-4591-a291-92f6208b139b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:20.784280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ad592bf5-fa4a-4039-985d-a364939d9ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfcd8fccbf8c44b08adf9f29b5f1a186', 'request_id': 'req-ad592bf5-fa4a-4039-985d-a364939d9ad9'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:20.796166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ad592bf5-fa4a-4039-985d-a364939d9ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfcd8fccbf8c44b08adf9f29b5f1a186', 'request_id': 'req-ad592bf5-fa4a-4039-985d-a364939d9ad9'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:20.873326 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ad592bf5-fa4a-4039-985d-a364939d9ad9 admin admin] The token cache is being invalidate because project bfcd8fccbf8c44b08adf9f29b5f1a186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:20.873653 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ad592bf5-fa4a-4039-985d-a364939d9ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:20.874450 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ad592bf5-fa4a-4039-985d-a364939d9ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:20.882511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 849/1696] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:20 2022] DELETE /identity/v3/projects/bfcd8fccbf8c44b08adf9f29b5f1a186 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:20.882511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bc189-c990-4aa4-a184-17ac21bcf0c2 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:20.883656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bc189-c990-4aa4-a184-17ac21bcf0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:20.883811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bc189-c990-4aa4-a184-17ac21bcf0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:20.953455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-866bc189-c990-4aa4-a184-17ac21bcf0c2 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:20.955151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-866bc189-c990-4aa4-a184-17ac21bcf0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:21.021461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73612e-2b04-4591-a291-92f6208b139b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:21.037626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a28b9-7872-4354-8e7a-979d284f302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:21.039449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a28b9-7872-4354-8e7a-979d284f302f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:21.039750 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a28b9-7872-4354-8e7a-979d284f302f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:21.040896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a28b9-7872-4354-8e7a-979d284f302f admin admin] PATH_INFO: `/v3/users/afc72a79e5bf4531affc4c0023e84025` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:21.044201 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a28b9-7872-4354-8e7a-979d284f302f admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc72a79e5bf4531affc4c0023e84025)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:21.052892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a28b9-7872-4354-8e7a-979d284f302f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:21.126667 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 850/1697] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:21.132110 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ad66-87cf-4e36-a89f-7022d1cac4b2 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:21.134173 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ad66-87cf-4e36-a89f-7022d1cac4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:21.135845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ad66-87cf-4e36-a89f-7022d1cac4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:21.197342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-89c7ad66-87cf-4e36-a89f-7022d1cac4b2 None None] MFA Rules not processed for user `d3d23a0fd2f64b418a5cda010866ba6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:21.199310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-89c7ad66-87cf-4e36-a89f-7022d1cac4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:21.339812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 851/1698] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:21.342662 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7ad66-87cf-4e36-a89f-7022d1cac4b2 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:21.345266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-89c7ad66-87cf-4e36-a89f-7022d1cac4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:21.351696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:21.364664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d9a28b9-7872-4354-8e7a-979d284f302f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc72a79e5bf4531affc4c0023e84025'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:21.365940 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d9a28b9-7872-4354-8e7a-979d284f302f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc72a79e5bf4531affc4c0023e84025'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:21.382576 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7ad66-87cf-4e36-a89f-7022d1cac4b2 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:21.394581 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4159-6a93-4360-a6d6-379c0e186934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:21.395853 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4159-6a93-4360-a6d6-379c0e186934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:21.396854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4159-6a93-4360-a6d6-379c0e186934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:21.397016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4159-6a93-4360-a6d6-379c0e186934 admin admin] PATH_INFO: `/v3/users/ef74d2a6468d4b4e9baf5b3d02191c04` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:21.404822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d9a28b9-7872-4354-8e7a-979d284f302f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc72a79e5bf4531affc4c0023e84025'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:21.412957 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f4159-6a93-4360-a6d6-379c0e186934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef74d2a6468d4b4e9baf5b3d02191c04)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:21.418841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d9a28b9-7872-4354-8e7a-979d284f302f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc72a79e5bf4531affc4c0023e84025'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:21.422242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f4159-6a93-4360-a6d6-379c0e186934 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:21.422347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d9a28b9-7872-4354-8e7a-979d284f302f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc72a79e5bf4531affc4c0023e84025'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:21.529436 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 848/1699] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:20 2022] DELETE /identity/v3/users/afc72a79e5bf4531affc4c0023e84025 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:21.530394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a28b9-7872-4354-8e7a-979d284f302f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:21.531815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6d9a28b9-7872-4354-8e7a-979d284f302f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:21.681529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a28b9-7872-4354-8e7a-979d284f302f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:21.689704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51d9ea-b710-4c94-bff6-7a843423650d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:21.690422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51d9ea-b710-4c94-bff6-7a843423650d service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:21.691168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51d9ea-b710-4c94-bff6-7a843423650d service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:21.691168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51d9ea-b710-4c94-bff6-7a843423650d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:21.693192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0b51d9ea-b710-4c94-bff6-7a843423650d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:21.722674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2a4f4159-6a93-4360-a6d6-379c0e186934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef74d2a6468d4b4e9baf5b3d02191c04'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:21.773157 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2a4f4159-6a93-4360-a6d6-379c0e186934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef74d2a6468d4b4e9baf5b3d02191c04'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:21.828096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51d9ea-b710-4c94-bff6-7a843423650d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:21.842986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51d9ea-b710-4c94-bff6-7a843423650d service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:21.860476 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2a4f4159-6a93-4360-a6d6-379c0e186934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef74d2a6468d4b4e9baf5b3d02191c04'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:21.869876 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2a4f4159-6a93-4360-a6d6-379c0e186934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef74d2a6468d4b4e9baf5b3d02191c04'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:21.880454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 849/1700] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:43:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:43:21.883865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2a4f4159-6a93-4360-a6d6-379c0e186934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef74d2a6468d4b4e9baf5b3d02191c04'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:21.887621 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d72af3-861c-40ec-b82f-64e021a701fc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:21.899653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d72af3-861c-40ec-b82f-64e021a701fc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:21.905500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d72af3-861c-40ec-b82f-64e021a701fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:21.918715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 852/1701] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:21 2022] DELETE /identity/v3/users/ef74d2a6468d4b4e9baf5b3d02191c04 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:21.919720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4159-6a93-4360-a6d6-379c0e186934 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:21.921112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2a4f4159-6a93-4360-a6d6-379c0e186934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:21.997818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-88d72af3-861c-40ec-b82f-64e021a701fc None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:21.998659 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-88d72af3-861c-40ec-b82f-64e021a701fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:22.302178 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 850/1702] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:22.307592 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b51072-5dfa-4000-8232-4d9b141419c8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:22.308740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b51072-5dfa-4000-8232-4d9b141419c8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:22.313620 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b51072-5dfa-4000-8232-4d9b141419c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:22.333839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:22.370246 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-28b51072-5dfa-4000-8232-4d9b141419c8 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:22.375708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-28b51072-5dfa-4000-8232-4d9b141419c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:22.405436 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4159-6a93-4360-a6d6-379c0e186934 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:22.405719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 851/1703] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:22.405719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9ceb9-028f-4511-9571-1f8f626494c8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:22.405719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9ceb9-028f-4511-9571-1f8f626494c8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:22.405719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9ceb9-028f-4511-9571-1f8f626494c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:22.430103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948ae1b-231f-4e86-9206-6c28851e98bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:22.435199 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c1d9ceb9-028f-4511-9571-1f8f626494c8 None None] MFA Rules not processed for user `2c63e7e4105b41d1abfe58bf13c6125d`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:22.437956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c1d9ceb9-028f-4511-9571-1f8f626494c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:22.445018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948ae1b-231f-4e86-9206-6c28851e98bd admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:22.445779 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948ae1b-231f-4e86-9206-6c28851e98bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:22.454737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948ae1b-231f-4e86-9206-6c28851e98bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:22.461577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948ae1b-231f-4e86-9206-6c28851e98bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:22.466678 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948ae1b-231f-4e86-9206-6c28851e98bd admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:22.635752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 852/1704] 10.222.0.33 () {58 vars in 1015 bytes} [Wed Aug 31 04:43:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:22.635752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9ceb9-028f-4511-9571-1f8f626494c8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:22.666561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9ceb9-028f-4511-9571-1f8f626494c8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:22.694998 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afffe0a-6c13-46fd-988d-e4fb4df9de29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:22.695648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afffe0a-6c13-46fd-988d-e4fb4df9de29 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:22.697962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afffe0a-6c13-46fd-988d-e4fb4df9de29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:22.698420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afffe0a-6c13-46fd-988d-e4fb4df9de29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:22.702374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 853/1705] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:21 2022] POST /identity/v3/projects => generated 387 bytes in 783 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:22.708285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948ae1b-231f-4e86-9206-6c28851e98bd admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:22.708572 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afffe0a-6c13-46fd-988d-e4fb4df9de29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:43:22.708972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afffe0a-6c13-46fd-988d-e4fb4df9de29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:22.715435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afffe0a-6c13-46fd-988d-e4fb4df9de29 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:22.722152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3948ae1b-231f-4e86-9206-6c28851e98bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:22.751565 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:22.768568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 853/1706] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:43:22.769851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afffe0a-6c13-46fd-988d-e4fb4df9de29 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:22.772481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7afffe0a-6c13-46fd-988d-e4fb4df9de29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:22.789499 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afffe0a-6c13-46fd-988d-e4fb4df9de29 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:22.886802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae8767-bbd8-4b46-b522-719b2addaebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:22.887623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae8767-bbd8-4b46-b522-719b2addaebb service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:22.887907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae8767-bbd8-4b46-b522-719b2addaebb service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:22.888169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae8767-bbd8-4b46-b522-719b2addaebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:22.922871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae8767-bbd8-4b46-b522-719b2addaebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:22.927370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae8767-bbd8-4b46-b522-719b2addaebb service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:22.957490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 854/1707] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:22.958418 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae8767-bbd8-4b46-b522-719b2addaebb service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:23.142231 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948ae1b-231f-4e86-9206-6c28851e98bd admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:23.154482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc92567-b113-41eb-aa97-0d4c063d9599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:23.154754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae8767-bbd8-4b46-b522-719b2addaebb service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:23.155793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc92567-b113-41eb-aa97-0d4c063d9599 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:23.156209 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc92567-b113-41eb-aa97-0d4c063d9599 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:23.156652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc92567-b113-41eb-aa97-0d4c063d9599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:23.173493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17c87c-64b1-4a33-bdbe-f46dd2cbbb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:23.174130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17c87c-64b1-4a33-bdbe-f46dd2cbbb0c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:23.174414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17c87c-64b1-4a33-bdbe-f46dd2cbbb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:23.174708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17c87c-64b1-4a33-bdbe-f46dd2cbbb0c admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:23.175333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17c87c-64b1-4a33-bdbe-f46dd2cbbb0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:23.181958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17c87c-64b1-4a33-bdbe-f46dd2cbbb0c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:23.189110 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc92567-b113-41eb-aa97-0d4c063d9599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:23.195818 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc92567-b113-41eb-aa97-0d4c063d9599 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:23.243396 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 854/1708] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:23.244579 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc92567-b113-41eb-aa97-0d4c063d9599 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:23.268474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc92567-b113-41eb-aa97-0d4c063d9599 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:23.280642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cb5ef-fc74-4056-a68d-146bd1d4f401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:23.281573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb5ef-fc74-4056-a68d-146bd1d4f401 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:23.281773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb5ef-fc74-4056-a68d-146bd1d4f401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:23.282162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb5ef-fc74-4056-a68d-146bd1d4f401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:23.283059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cb5ef-fc74-4056-a68d-146bd1d4f401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:23.287585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cb5ef-fc74-4056-a68d-146bd1d4f401 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:23.313133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 855/1709] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:22 2022] POST /identity/v3/users => generated 300 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:23.314085 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17c87c-64b1-4a33-bdbe-f46dd2cbbb0c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:23.324413 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cb17c87c-64b1-4a33-bdbe-f46dd2cbbb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:23.339703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17c87c-64b1-4a33-bdbe-f46dd2cbbb0c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:23.352866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:23.353582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:23.353851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:23.354292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] PATH_INFO: `/v3/projects/cbdd65f41dc34f3b81333f96a4a63f45` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:23.356141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbdd65f41dc34f3b81333f96a4a63f45)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:23.362451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:23.512393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 855/1710] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:23 2022] POST /identity/v3/projects => generated 405 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:23.513570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cb5ef-fc74-4056-a68d-146bd1d4f401 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:23.644832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbdd65f41dc34f3b81333f96a4a63f45', 'request_id': 'req-bdd3b414-f61e-438e-adfc-6dcbf3388e63'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:23.803483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cb5ef-fc74-4056-a68d-146bd1d4f401 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:23.815052 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbdd65f41dc34f3b81333f96a4a63f45', 'request_id': 'req-bdd3b414-f61e-438e-adfc-6dcbf3388e63'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:23.833630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbdd65f41dc34f3b81333f96a4a63f45', 'request_id': 'req-bdd3b414-f61e-438e-adfc-6dcbf3388e63'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:23.928981 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] The token cache is being invalidate because project cbdd65f41dc34f3b81333f96a4a63f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:23.929310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:23.937334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:23.948235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 856/1711] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:23 2022] DELETE /identity/v3/projects/cbdd65f41dc34f3b81333f96a4a63f45 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:23.951946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:23.958676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:23.984917 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc62f02-f059-4c41-9d41-c35c8d504239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:23.985567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc62f02-f059-4c41-9d41-c35c8d504239 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:23.985999 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc62f02-f059-4c41-9d41-c35c8d504239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:23.987674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc62f02-f059-4c41-9d41-c35c8d504239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:23.996530 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:23.997532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc62f02-f059-4c41-9d41-c35c8d504239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:23.999390 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc62f02-f059-4c41-9d41-c35c8d504239 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:24.007855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3b414-f61e-438e-adfc-6dcbf3388e63 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:24.017414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12e7e-0c59-4358-b8b8-85bbc0f4147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:24.018994 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12e7e-0c59-4358-b8b8-85bbc0f4147e admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:24.019476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12e7e-0c59-4358-b8b8-85bbc0f4147e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:24.019912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12e7e-0c59-4358-b8b8-85bbc0f4147e admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:24.020736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be12e7e-0c59-4358-b8b8-85bbc0f4147e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:24.022977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be12e7e-0c59-4358-b8b8-85bbc0f4147e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:24.037980 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 856/1712] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:24.041807 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4dca-223d-419f-8531-6fec1a84169b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:24.042096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4dca-223d-419f-8531-6fec1a84169b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:24.051048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4dca-223d-419f-8531-6fec1a84169b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:24.138783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-348f4dca-223d-419f-8531-6fec1a84169b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:24.141649 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-348f4dca-223d-419f-8531-6fec1a84169b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:24.151210 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 857/1713] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:23 2022] POST /identity/v3/users => generated 303 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:24.151210 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12e7e-0c59-4358-b8b8-85bbc0f4147e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:24.159021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0be12e7e-0c59-4358-b8b8-85bbc0f4147e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:24.162357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 857/1714] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:24.164954 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f4dca-223d-419f-8531-6fec1a84169b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:24.179075 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f4dca-223d-419f-8531-6fec1a84169b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:24.191466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12e7e-0c59-4358-b8b8-85bbc0f4147e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:24.193418 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeabfc-2a13-4e39-8759-cc023b087640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:24.194305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeabfc-2a13-4e39-8759-cc023b087640 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:24.195723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeabfc-2a13-4e39-8759-cc023b087640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:24.197227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeabfc-2a13-4e39-8759-cc023b087640 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:24.198338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeabfc-2a13-4e39-8759-cc023b087640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:24.200779 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeabfc-2a13-4e39-8759-cc023b087640 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:24.218905 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 858/1715] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:24.220532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c903-0d61-4b6b-bb85-ebdd1ce25489 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:24.220821 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c903-0d61-4b6b-bb85-ebdd1ce25489 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:24.221311 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c903-0d61-4b6b-bb85-ebdd1ce25489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:24.224461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be262797-dd43-400f-b82d-c07974feadcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:24.225322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be262797-dd43-400f-b82d-c07974feadcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:24.225598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be262797-dd43-400f-b82d-c07974feadcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:24.226015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be262797-dd43-400f-b82d-c07974feadcc admin admin] PATH_INFO: `/v3/projects/136a0499c62741129c2f188ea5a9e51c/users/8a767fd274a94a00aa0bd82fdbab1351/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:24.245663 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4be7c903-0d61-4b6b-bb85-ebdd1ce25489 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:24.247260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4be7c903-0d61-4b6b-bb85-ebdd1ce25489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:24.257720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 859/1716] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:24.258937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7c903-0d61-4b6b-bb85-ebdd1ce25489 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:24.279913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7c903-0d61-4b6b-bb85-ebdd1ce25489 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:24.296769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be262797-dd43-400f-b82d-c07974feadcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=136a0499c62741129c2f188ea5a9e51c, user_id=8a767fd274a94a00aa0bd82fdbab1351, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:24.300335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be262797-dd43-400f-b82d-c07974feadcc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:24.303735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175402fe-dc16-4227-bc4d-9c3dde20413c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:24.305184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175402fe-dc16-4227-bc4d-9c3dde20413c admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:24.305553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175402fe-dc16-4227-bc4d-9c3dde20413c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:24.305909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175402fe-dc16-4227-bc4d-9c3dde20413c admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:24.306733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175402fe-dc16-4227-bc4d-9c3dde20413c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:24.308749 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175402fe-dc16-4227-bc4d-9c3dde20413c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:24.325131 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 860/1717] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:24.326153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175402fe-dc16-4227-bc4d-9c3dde20413c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:24.345534 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175402fe-dc16-4227-bc4d-9c3dde20413c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:24.367269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dbc97-671a-4fda-8fcc-999dd74dabcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:24.372092 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dbc97-671a-4fda-8fcc-999dd74dabcd admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:24.375947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dbc97-671a-4fda-8fcc-999dd74dabcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:24.376447 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dbc97-671a-4fda-8fcc-999dd74dabcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:24.377380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dbc97-671a-4fda-8fcc-999dd74dabcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:43:24.378655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dbc97-671a-4fda-8fcc-999dd74dabcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:24.383229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dbc97-671a-4fda-8fcc-999dd74dabcd admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:24.392622 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:24.416048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 861/1718] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:43:24.422201 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dbc97-671a-4fda-8fcc-999dd74dabcd admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:24.441722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dbc97-671a-4fda-8fcc-999dd74dabcd admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:24.467485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1de8b-ba70-4e59-92da-ded7d4b180e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:24.469025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1de8b-ba70-4e59-92da-ded7d4b180e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:24.469691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1de8b-ba70-4e59-92da-ded7d4b180e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:24.470219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1de8b-ba70-4e59-92da-ded7d4b180e8 admin admin] PATH_INFO: `/v3/projects/1c94773b7b7b4d42a49f433b498443b2/users/1c21bd0c7e7e4e69bfb47883af123126/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:24.501615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1de8b-ba70-4e59-92da-ded7d4b180e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c94773b7b7b4d42a49f433b498443b2, user_id=1c21bd0c7e7e4e69bfb47883af123126, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:24.504866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1de8b-ba70-4e59-92da-ded7d4b180e8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:24.712805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 858/1719] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:24 2022] PUT /identity/v3/projects/136a0499c62741129c2f188ea5a9e51c/users/8a767fd274a94a00aa0bd82fdbab1351/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:24.717271 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d54cc5-0e56-46b8-a617-2c86e5d3f0a0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:24.717271 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d54cc5-0e56-46b8-a617-2c86e5d3f0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:24.717271 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d54cc5-0e56-46b8-a617-2c86e5d3f0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:24.736710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c4d54cc5-0e56-46b8-a617-2c86e5d3f0a0 None None] MFA Rules not processed for user `1224284a60e64f07ba98d80901091550`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:24.737961 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c4d54cc5-0e56-46b8-a617-2c86e5d3f0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:24.825614 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 859/1720] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:24.826637 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d54cc5-0e56-46b8-a617-2c86e5d3f0a0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:24.949841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 862/1721] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:24 2022] PUT /identity/v3/projects/1c94773b7b7b4d42a49f433b498443b2/users/1c21bd0c7e7e4e69bfb47883af123126/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:24.954150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1de8b-ba70-4e59-92da-ded7d4b180e8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:25.027909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d54cc5-0e56-46b8-a617-2c86e5d3f0a0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:25.135168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1de8b-ba70-4e59-92da-ded7d4b180e8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:25.148519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cceea-92a2-4858-85fb-e9ca1b3f06aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:25.149422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cceea-92a2-4858-85fb-e9ca1b3f06aa admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:25.151211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f51262-7cd2-4b6d-8f1d-262f853f598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:25.156215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cceea-92a2-4858-85fb-e9ca1b3f06aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:25.156215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cceea-92a2-4858-85fb-e9ca1b3f06aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:25.156432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f51262-7cd2-4b6d-8f1d-262f853f598a admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:25.156432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f51262-7cd2-4b6d-8f1d-262f853f598a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:25.156432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f51262-7cd2-4b6d-8f1d-262f853f598a admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:25.156432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f51262-7cd2-4b6d-8f1d-262f853f598a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:25.156690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cceea-92a2-4858-85fb-e9ca1b3f06aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:25.159317 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f51262-7cd2-4b6d-8f1d-262f853f598a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:25.160685 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cceea-92a2-4858-85fb-e9ca1b3f06aa admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:25.192827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 863/1722] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:25.196918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf02cb-94eb-4d98-a2fd-d8cdec04194b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:25.197273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf02cb-94eb-4d98-a2fd-d8cdec04194b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:25.197565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf02cb-94eb-4d98-a2fd-d8cdec04194b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:25.259726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bdaf02cb-94eb-4d98-a2fd-d8cdec04194b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:25.260049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bdaf02cb-94eb-4d98-a2fd-d8cdec04194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:25.282927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 864/1723] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:25.282927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf02cb-94eb-4d98-a2fd-d8cdec04194b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:25.326044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 860/1724] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:24 2022] POST /identity/v3/projects => generated 373 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:25.331628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cceea-92a2-4858-85fb-e9ca1b3f06aa admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:25.346499 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf02cb-94eb-4d98-a2fd-d8cdec04194b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:25.540821 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cceea-92a2-4858-85fb-e9ca1b3f06aa admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:25.552908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:25.555493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90297a-cd43-44a5-83a1-13f1c1532fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:25.558442 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90297a-cd43-44a5-83a1-13f1c1532fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:25.558442 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90297a-cd43-44a5-83a1-13f1c1532fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:25.558442 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90297a-cd43-44a5-83a1-13f1c1532fc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:25.559426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90297a-cd43-44a5-83a1-13f1c1532fc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:25.561813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90297a-cd43-44a5-83a1-13f1c1532fc5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:25.600552 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35476fbd-356c-4ca7-8a7b-52418954c04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:25.601262 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35476fbd-356c-4ca7-8a7b-52418954c04e admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:25.601543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35476fbd-356c-4ca7-8a7b-52418954c04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:25.603070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35476fbd-356c-4ca7-8a7b-52418954c04e admin admin] PATH_INFO: `/v3/projects/136a0499c62741129c2f188ea5a9e51c/users/8a767fd274a94a00aa0bd82fdbab1351/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:25.607171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35476fbd-356c-4ca7-8a7b-52418954c04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=136a0499c62741129c2f188ea5a9e51c, user_id=8a767fd274a94a00aa0bd82fdbab1351, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:25.629514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35476fbd-356c-4ca7-8a7b-52418954c04e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:25.691535 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 865/1725] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:25 2022] PUT /identity/v3/projects/136a0499c62741129c2f188ea5a9e51c/users/8a767fd274a94a00aa0bd82fdbab1351/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:25.692793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35476fbd-356c-4ca7-8a7b-52418954c04e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:25.713782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-35476fbd-356c-4ca7-8a7b-52418954c04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:25.764741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 861/1726] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:25 2022] POST /identity/v3/users => generated 287 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:25.766581 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e3ca7-5629-4f12-971a-3ef301a5975a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:25.767084 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e3ca7-5629-4f12-971a-3ef301a5975a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:25.776477 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e3ca7-5629-4f12-971a-3ef301a5975a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:25.850309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-514e3ca7-5629-4f12-971a-3ef301a5975a None None] MFA Rules not processed for user `8a767fd274a94a00aa0bd82fdbab1351`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:25.852592 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-514e3ca7-5629-4f12-971a-3ef301a5975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:25.881806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35476fbd-356c-4ca7-8a7b-52418954c04e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:25.922026 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69660a62-cfcd-4e66-8565-680ddb9d9a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:25.925154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69660a62-cfcd-4e66-8565-680ddb9d9a86 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:25.925942 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69660a62-cfcd-4e66-8565-680ddb9d9a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:25.928066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69660a62-cfcd-4e66-8565-680ddb9d9a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:26.010856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 862/1727] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:26.015078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e3ca7-5629-4f12-971a-3ef301a5975a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:26.206837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69660a62-cfcd-4e66-8565-680ddb9d9a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:26.210420 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69660a62-cfcd-4e66-8565-680ddb9d9a86 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:26.246372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 866/1728] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:26.247332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69660a62-cfcd-4e66-8565-680ddb9d9a86 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:26.248871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-69660a62-cfcd-4e66-8565-680ddb9d9a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:26.264101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e3ca7-5629-4f12-971a-3ef301a5975a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:26.288306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9037c-5ec2-463b-bf6b-626982f00d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:26.289354 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9037c-5ec2-463b-bf6b-626982f00d51 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:26.289749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9037c-5ec2-463b-bf6b-626982f00d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:26.290089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9037c-5ec2-463b-bf6b-626982f00d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:26.290816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9037c-5ec2-463b-bf6b-626982f00d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:26.292761 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9037c-5ec2-463b-bf6b-626982f00d51 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:26.319855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 863/1729] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:26.324576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9037c-5ec2-463b-bf6b-626982f00d51 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:26.337549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69660a62-cfcd-4e66-8565-680ddb9d9a86 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:26.340987 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:26.348558 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e4e5f-9d83-4b4b-a454-b4b507d1dab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:26.349280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e4e5f-9d83-4b4b-a454-b4b507d1dab5 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:26.349613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e4e5f-9d83-4b4b-a454-b4b507d1dab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:26.350154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e4e5f-9d83-4b4b-a454-b4b507d1dab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:26.350317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9037c-5ec2-463b-bf6b-626982f00d51 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:26.364320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65993e7e-78ce-4a12-9e8b-7814f5e44c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:26.365012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65993e7e-78ce-4a12-9e8b-7814f5e44c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:26.365500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65993e7e-78ce-4a12-9e8b-7814f5e44c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:26.365785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65993e7e-78ce-4a12-9e8b-7814f5e44c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:26.366528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65993e7e-78ce-4a12-9e8b-7814f5e44c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:26.368212 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65993e7e-78ce-4a12-9e8b-7814f5e44c94 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:26.369847 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e4e5f-9d83-4b4b-a454-b4b507d1dab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:26.375530 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e4e5f-9d83-4b4b-a454-b4b507d1dab5 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:26.398634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 864/1730] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:26.399720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65993e7e-78ce-4a12-9e8b-7814f5e44c94 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:26.405309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 867/1731] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:26.444465 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65993e7e-78ce-4a12-9e8b-7814f5e44c94 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:26.463091 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c7892-c472-45ee-8fbe-16238dbaddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:26.463924 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7892-c472-45ee-8fbe-16238dbaddf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:26.464255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7892-c472-45ee-8fbe-16238dbaddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:26.464618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7892-c472-45ee-8fbe-16238dbaddf3 admin admin] PATH_INFO: `/v3/projects/2831d8d49afb495ea86c2ea1dc63b8c2/users/ab4a337783e649a599f4933b16db6027/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:26.501778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c7892-c472-45ee-8fbe-16238dbaddf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2831d8d49afb495ea86c2ea1dc63b8c2, user_id=ab4a337783e649a599f4933b16db6027, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:26.504668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c7892-c472-45ee-8fbe-16238dbaddf3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:26.587652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e4e5f-9d83-4b4b-a454-b4b507d1dab5 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:26.611198 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e4e5f-9d83-4b4b-a454-b4b507d1dab5 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:26.627398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 865/1732] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:26 2022] PUT /identity/v3/projects/2831d8d49afb495ea86c2ea1dc63b8c2/users/ab4a337783e649a599f4933b16db6027/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:26.631137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736f98b-5cf5-4d53-a8c2-b14deff8a99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:26.631137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736f98b-5cf5-4d53-a8c2-b14deff8a99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:26.631137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736f98b-5cf5-4d53-a8c2-b14deff8a99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:26.631137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736f98b-5cf5-4d53-a8c2-b14deff8a99b admin admin] PATH_INFO: `/v3/users/d3d23a0fd2f64b418a5cda010866ba6c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:26.633068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945935ba-870e-4ba0-af10-1192c5c7b72e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:26.633458 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945935ba-870e-4ba0-af10-1192c5c7b72e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:26.633691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736f98b-5cf5-4d53-a8c2-b14deff8a99b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d23a0fd2f64b418a5cda010866ba6c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:26.633836 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945935ba-870e-4ba0-af10-1192c5c7b72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:26.641707 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736f98b-5cf5-4d53-a8c2-b14deff8a99b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:26.674510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-945935ba-870e-4ba0-af10-1192c5c7b72e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:26.675948 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-945935ba-870e-4ba0-af10-1192c5c7b72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:26.889785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 866/1733] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:26.893431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab631e-e546-46ee-bd2d-33967a5d2d7e None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:26.893714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab631e-e546-46ee-bd2d-33967a5d2d7e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:26.894332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab631e-e546-46ee-bd2d-33967a5d2d7e None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:26.898092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 867/1734] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 31 04:43:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:43:26.904666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab631e-e546-46ee-bd2d-33967a5d2d7e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:26.907072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1fab631e-e546-46ee-bd2d-33967a5d2d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:26.968130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab631e-e546-46ee-bd2d-33967a5d2d7e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:26.982049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:26.985807 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:26.989586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:26.989586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] PATH_INFO: `/v3/projects/4156e149b763469f908895d09477c651` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:26.989586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4156e149b763469f908895d09477c651)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:26.996717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:27.007814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:27.043028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8736f98b-5cf5-4d53-a8c2-b14deff8a99b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d23a0fd2f64b418a5cda010866ba6c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:27.087834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8736f98b-5cf5-4d53-a8c2-b14deff8a99b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d23a0fd2f64b418a5cda010866ba6c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:27.172884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8736f98b-5cf5-4d53-a8c2-b14deff8a99b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d23a0fd2f64b418a5cda010866ba6c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:27.189923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4156e149b763469f908895d09477c651', 'request_id': 'req-2a869bf6-0485-488e-9424-f709972ca8cc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:27.195166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8736f98b-5cf5-4d53-a8c2-b14deff8a99b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d23a0fd2f64b418a5cda010866ba6c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:27.199206 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8736f98b-5cf5-4d53-a8c2-b14deff8a99b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d23a0fd2f64b418a5cda010866ba6c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:27.234443 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 868/1735] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:26 2022] DELETE /identity/v3/users/d3d23a0fd2f64b418a5cda010866ba6c => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:27.238945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ca1b8-7e1e-417b-bc17-ba502caa7157 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:27.241380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ca1b8-7e1e-417b-bc17-ba502caa7157 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:27.242441 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ca1b8-7e1e-417b-bc17-ba502caa7157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:27.271242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:27.294825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4156e149b763469f908895d09477c651', 'request_id': 'req-2a869bf6-0485-488e-9424-f709972ca8cc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:27.303939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4156e149b763469f908895d09477c651', 'request_id': 'req-2a869bf6-0485-488e-9424-f709972ca8cc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:27.317712 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-de7ca1b8-7e1e-417b-bc17-ba502caa7157 None None] MFA Rules not processed for user `4877b72a6cea410dbb31a35c7acbd5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:27.319547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-de7ca1b8-7e1e-417b-bc17-ba502caa7157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:27.333127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] The token cache is being invalidate because project 4156e149b763469f908895d09477c651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:27.333494 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:27.334688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:27.361374 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 868/1736] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:26 2022] DELETE /identity/v3/projects/4156e149b763469f908895d09477c651 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:27.361374 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:27.361374 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:27.525915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 869/1737] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 31 04:43:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:27.527993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61339df1-3a0f-4a1b-ae8c-8a292fb250b0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:27.528267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61339df1-3a0f-4a1b-ae8c-8a292fb250b0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:27.528543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61339df1-3a0f-4a1b-ae8c-8a292fb250b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:27.553616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-61339df1-3a0f-4a1b-ae8c-8a292fb250b0 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:27.554895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-61339df1-3a0f-4a1b-ae8c-8a292fb250b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:27.594605 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a869bf6-0485-488e-9424-f709972ca8cc admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:27.691820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 870/1738] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:27.693425 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924649d-a758-4c7e-8eb4-2ce47f36d5f9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:27.699046 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924649d-a758-4c7e-8eb4-2ce47f36d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:27.699046 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924649d-a758-4c7e-8eb4-2ce47f36d5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:27.752831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6924649d-a758-4c7e-8eb4-2ce47f36d5f9 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:27.763410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6924649d-a758-4c7e-8eb4-2ce47f36d5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:27.768062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68f751-f409-480e-a7c1-463aea4173ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:27.769399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68f751-f409-480e-a7c1-463aea4173ad service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:27.769849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68f751-f409-480e-a7c1-463aea4173ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:27.771014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68f751-f409-480e-a7c1-463aea4173ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:27.774650 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 871/1739] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:27.778510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924649d-a758-4c7e-8eb4-2ce47f36d5f9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:27.781065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6924649d-a758-4c7e-8eb4-2ce47f36d5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:27.795566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-be68f751-f409-480e-a7c1-463aea4173ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:27.841696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68f751-f409-480e-a7c1-463aea4173ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:27.843420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68f751-f409-480e-a7c1-463aea4173ad service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:27.862763 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924649d-a758-4c7e-8eb4-2ce47f36d5f9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:27.890430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 869/1740] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:27.891920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960face1-1f0d-4f6a-a1bc-38de0df4abc7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:27.892254 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960face1-1f0d-4f6a-a1bc-38de0df4abc7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:27.892602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960face1-1f0d-4f6a-a1bc-38de0df4abc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:27.894168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ca1d9-c256-49e0-8648-208974fa8898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:27.894945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ca1d9-c256-49e0-8648-208974fa8898 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:27.895350 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ca1d9-c256-49e0-8648-208974fa8898 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:27.895801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ca1d9-c256-49e0-8648-208974fa8898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:27.924473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ca1d9-c256-49e0-8648-208974fa8898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:27.934329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ca1d9-c256-49e0-8648-208974fa8898 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:27.950500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:27.968778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-960face1-1f0d-4f6a-a1bc-38de0df4abc7 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:27.979102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-960face1-1f0d-4f6a-a1bc-38de0df4abc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:28.001297 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 872/1741] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:28.022323 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ca1d9-c256-49e0-8648-208974fa8898 service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:28.022410 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 870/1742] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:28.022493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-921ca1d9-c256-49e0-8648-208974fa8898 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:28.023392 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960face1-1f0d-4f6a-a1bc-38de0df4abc7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:28.037669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ca1d9-c256-49e0-8648-208974fa8898 service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:28.052357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1314b-e8f8-41f4-a5ce-f98b20f6402e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:28.052357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1314b-e8f8-41f4-a5ce-f98b20f6402e service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:28.052357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1314b-e8f8-41f4-a5ce-f98b20f6402e service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:28.052357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1314b-e8f8-41f4-a5ce-f98b20f6402e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:28.062468 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960face1-1f0d-4f6a-a1bc-38de0df4abc7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:28.079516 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1314b-e8f8-41f4-a5ce-f98b20f6402e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:28.081758 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1314b-e8f8-41f4-a5ce-f98b20f6402e service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:28.093540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cf2e5-13eb-4e16-9541-3006c80339b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:28.094849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cf2e5-13eb-4e16-9541-3006c80339b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:28.095289 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cf2e5-13eb-4e16-9541-3006c80339b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:28.095861 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cf2e5-13eb-4e16-9541-3006c80339b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:28.096666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cf2e5-13eb-4e16-9541-3006c80339b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:43:28.104318 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:28.112283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cf2e5-13eb-4e16-9541-3006c80339b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:28.114304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cf2e5-13eb-4e16-9541-3006c80339b6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:28.134240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 873/1743] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:28.170159 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 871/1744] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:43:28.170983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1314b-e8f8-41f4-a5ce-f98b20f6402e service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:28.196453 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1314b-e8f8-41f4-a5ce-f98b20f6402e service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:28.203760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c41b7a-6e93-440e-ac49-b1144633514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:28.204615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c41b7a-6e93-440e-ac49-b1144633514a admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:28.205081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c41b7a-6e93-440e-ac49-b1144633514a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:28.205583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c41b7a-6e93-440e-ac49-b1144633514a admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:28.206440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c41b7a-6e93-440e-ac49-b1144633514a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:28.209831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c41b7a-6e93-440e-ac49-b1144633514a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:28.377583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 874/1745] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:28 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:43:28.381875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cf2e5-13eb-4e16-9541-3006c80339b6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:28.405441 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cf2e5-13eb-4e16-9541-3006c80339b6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:28.504376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6a480-e0dd-4606-baa0-753a94aa95a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:28.506046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6a480-e0dd-4606-baa0-753a94aa95a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:28.506046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6a480-e0dd-4606-baa0-753a94aa95a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:28.506046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6a480-e0dd-4606-baa0-753a94aa95a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:28.506987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6a480-e0dd-4606-baa0-753a94aa95a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:28.509754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6a480-e0dd-4606-baa0-753a94aa95a6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:28.595769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 872/1746] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:28 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:28.597618 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c41b7a-6e93-440e-ac49-b1144633514a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:28.615998 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c41b7a-6e93-440e-ac49-b1144633514a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:28.635392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c562c44-db89-4d68-9032-e66762cacdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:28.635392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562c44-db89-4d68-9032-e66762cacdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:28.635392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562c44-db89-4d68-9032-e66762cacdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:28.635392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562c44-db89-4d68-9032-e66762cacdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:28.635710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c562c44-db89-4d68-9032-e66762cacdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:28.635710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c562c44-db89-4d68-9032-e66762cacdc7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:28.675485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 875/1747] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:28.677289 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6a480-e0dd-4606-baa0-753a94aa95a6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:28.700676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6a480-e0dd-4606-baa0-753a94aa95a6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:28.717593 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebf642-694d-4500-951a-9abc6a537d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:28.719563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebf642-694d-4500-951a-9abc6a537d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:28.719930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebf642-694d-4500-951a-9abc6a537d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:28.720592 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebf642-694d-4500-951a-9abc6a537d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:28.721922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebf642-694d-4500-951a-9abc6a537d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:28.727291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebf642-694d-4500-951a-9abc6a537d19 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:28.768012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 873/1748] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:28.771075 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c562c44-db89-4d68-9032-e66762cacdc7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:28.796147 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c562c44-db89-4d68-9032-e66762cacdc7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:28.811873 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865afa9-ae3d-4a6c-853f-1e43cbc11c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:28.812494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865afa9-ae3d-4a6c-853f-1e43cbc11c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:28.812763 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865afa9-ae3d-4a6c-853f-1e43cbc11c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:28.813230 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865afa9-ae3d-4a6c-853f-1e43cbc11c1e admin admin] PATH_INFO: `/v3/projects/f745f573e51547479ceba8b50eb689e1/users/b2b5a3f4ecfc4c2cbc85425204224aac/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:28.862584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865afa9-ae3d-4a6c-853f-1e43cbc11c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f745f573e51547479ceba8b50eb689e1, user_id=b2b5a3f4ecfc4c2cbc85425204224aac, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:28.871522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865afa9-ae3d-4a6c-853f-1e43cbc11c1e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:28.987866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:29.003920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 876/1749] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:28 2022] PUT /identity/v3/projects/f745f573e51547479ceba8b50eb689e1/users/b2b5a3f4ecfc4c2cbc85425204224aac/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:29.023241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d1652-c0ec-4203-925d-bbd8624b3e1b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:29.023241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d1652-c0ec-4203-925d-bbd8624b3e1b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:29.023241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d1652-c0ec-4203-925d-bbd8624b3e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:29.101190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-327d1652-c0ec-4203-925d-bbd8624b3e1b None None] MFA Rules not processed for user `b2b5a3f4ecfc4c2cbc85425204224aac`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:29.103139 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-327d1652-c0ec-4203-925d-bbd8624b3e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:29.263239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865afa9-ae3d-4a6c-853f-1e43cbc11c1e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:29.265531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 874/1750] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:29.407381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:29.410207 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865afa9-ae3d-4a6c-853f-1e43cbc11c1e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:29.423162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d44a81-9aa6-4ebc-877a-c1f8962b0c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:29.423162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44a81-9aa6-4ebc-877a-c1f8962b0c7d admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:29.423162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44a81-9aa6-4ebc-877a-c1f8962b0c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:29.423162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44a81-9aa6-4ebc-877a-c1f8962b0c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:29.424517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d44a81-9aa6-4ebc-877a-c1f8962b0c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:29.426593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d44a81-9aa6-4ebc-877a-c1f8962b0c7d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:29.591984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 877/1751] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:29 2022] POST /identity/v3/projects => generated 363 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:29.596421 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d1652-c0ec-4203-925d-bbd8624b3e1b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:29.618562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d1652-c0ec-4203-925d-bbd8624b3e1b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:29.788044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bb811-1024-48fe-833c-4b8d06ce7b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:29.788950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bb811-1024-48fe-833c-4b8d06ce7b33 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:29.794283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bb811-1024-48fe-833c-4b8d06ce7b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:29.795313 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bb811-1024-48fe-833c-4b8d06ce7b33 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:29.796776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bb811-1024-48fe-833c-4b8d06ce7b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:29.802144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bb811-1024-48fe-833c-4b8d06ce7b33 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:29.963803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 875/1752] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:29 2022] POST /identity/v3/users => generated 288 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:29.977702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d44a81-9aa6-4ebc-877a-c1f8962b0c7d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:29.993243 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d44a81-9aa6-4ebc-877a-c1f8962b0c7d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:30.008581 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26132e16-d1c7-4b8e-8ea4-921deb5d5956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:30.009386 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26132e16-d1c7-4b8e-8ea4-921deb5d5956 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:30.009559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26132e16-d1c7-4b8e-8ea4-921deb5d5956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:30.009817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26132e16-d1c7-4b8e-8ea4-921deb5d5956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:30.010642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26132e16-d1c7-4b8e-8ea4-921deb5d5956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:30.012395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26132e16-d1c7-4b8e-8ea4-921deb5d5956 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:30.048527 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 878/1753] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:30.052920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bb811-1024-48fe-833c-4b8d06ce7b33 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:30.071671 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bb811-1024-48fe-833c-4b8d06ce7b33 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:30.097672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee44a9-5bf3-40db-9502-107e18431ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:30.099007 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee44a9-5bf3-40db-9502-107e18431ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:30.099459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee44a9-5bf3-40db-9502-107e18431ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:30.099887 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee44a9-5bf3-40db-9502-107e18431ad8 admin admin] PATH_INFO: `/v3/projects/50f6d5c6dcde40e89df16a1d2428146d/users/0fc54778e266474eaafaf1e31475efcb/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:30.126422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee44a9-5bf3-40db-9502-107e18431ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f6d5c6dcde40e89df16a1d2428146d, user_id=0fc54778e266474eaafaf1e31475efcb, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:30.129703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee44a9-5bf3-40db-9502-107e18431ad8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:30.234067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 876/1754] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:30 2022] PUT /identity/v3/projects/50f6d5c6dcde40e89df16a1d2428146d/users/0fc54778e266474eaafaf1e31475efcb/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:30.237865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26132e16-d1c7-4b8e-8ea4-921deb5d5956 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:30.255449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26132e16-d1c7-4b8e-8ea4-921deb5d5956 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:30.365046 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed4113-1275-4274-ab35-3a121c9a9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:30.365985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed4113-1275-4274-ab35-3a121c9a9ade admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:30.366556 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed4113-1275-4274-ab35-3a121c9a9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:30.366682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed4113-1275-4274-ab35-3a121c9a9ade admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:30.367507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed4113-1275-4274-ab35-3a121c9a9ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:30.369267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed4113-1275-4274-ab35-3a121c9a9ade admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:30.414756 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee44a9-5bf3-40db-9502-107e18431ad8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:30.420060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 879/1755] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:30.440451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee44a9-5bf3-40db-9502-107e18431ad8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:30.456197 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fe923-c426-40f4-b866-6f6bb27733e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:30.457660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe923-c426-40f4-b866-6f6bb27733e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:30.458197 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe923-c426-40f4-b866-6f6bb27733e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:30.458721 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fe923-c426-40f4-b866-6f6bb27733e9 admin admin] PATH_INFO: `/v3/projects/50f6d5c6dcde40e89df16a1d2428146d/users/0fc54778e266474eaafaf1e31475efcb/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:30.461938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fe923-c426-40f4-b866-6f6bb27733e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f6d5c6dcde40e89df16a1d2428146d, user_id=0fc54778e266474eaafaf1e31475efcb, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:30.466413 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fe923-c426-40f4-b866-6f6bb27733e9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:30.498632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 877/1756] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:30 2022] PUT /identity/v3/projects/50f6d5c6dcde40e89df16a1d2428146d/users/0fc54778e266474eaafaf1e31475efcb/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:30.509462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462eb4ac-f60a-4f3d-85ee-193e4e67b6e2 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:30.510149 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462eb4ac-f60a-4f3d-85ee-193e4e67b6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:30.510571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462eb4ac-f60a-4f3d-85ee-193e4e67b6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:30.587756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-462eb4ac-f60a-4f3d-85ee-193e4e67b6e2 None None] MFA Rules not processed for user `0fc54778e266474eaafaf1e31475efcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:30.590415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-462eb4ac-f60a-4f3d-85ee-193e4e67b6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:30.710075 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 880/1757] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:30.720586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fe923-c426-40f4-b866-6f6bb27733e9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:30.722534 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-313fe923-c426-40f4-b866-6f6bb27733e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:30.732774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:30.906951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fe923-c426-40f4-b866-6f6bb27733e9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:30.921598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcd69f-76f5-423c-887b-be18a765a961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:30.922402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcd69f-76f5-423c-887b-be18a765a961 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:30.922700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcd69f-76f5-423c-887b-be18a765a961 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:30.922957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcd69f-76f5-423c-887b-be18a765a961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:30.972088 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcd69f-76f5-423c-887b-be18a765a961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:30.974035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcd69f-76f5-423c-887b-be18a765a961 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:30.996772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 878/1758] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:31.006265 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b994361-7396-4dfa-98e7-8351fc733317 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:31.006933 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b994361-7396-4dfa-98e7-8351fc733317 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:31.007723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b994361-7396-4dfa-98e7-8351fc733317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:31.065924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5b994361-7396-4dfa-98e7-8351fc733317 None None] MFA Rules not processed for user `1c21bd0c7e7e4e69bfb47883af123126`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:31.066082 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcd69f-76f5-423c-887b-be18a765a961 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:31.067225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5b994361-7396-4dfa-98e7-8351fc733317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:31.068413 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b3bcd69f-76f5-423c-887b-be18a765a961 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:31.090129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:31.217903 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 881/1759] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:31 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:31.217903 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b994361-7396-4dfa-98e7-8351fc733317 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:31.240388 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5b994361-7396-4dfa-98e7-8351fc733317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:31.264617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcd69f-76f5-423c-887b-be18a765a961 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:31.272822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:31.283402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:31.283930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:31.284361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f admin admin] PATH_INFO: `/v3/projects/c9cd0a58e6854b92a9f988f2f915d65f` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:31.286235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9cd0a58e6854b92a9f988f2f915d65f)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:31.290896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:31.503184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b994361-7396-4dfa-98e7-8351fc733317 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:31.516918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07361528-cd9a-45e4-a00a-f452f8a3ee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:31.521210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07361528-cd9a-45e4-a00a-f452f8a3ee2b admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:31.521509 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07361528-cd9a-45e4-a00a-f452f8a3ee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:31.521786 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07361528-cd9a-45e4-a00a-f452f8a3ee2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:31.522508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07361528-cd9a-45e4-a00a-f452f8a3ee2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:31.531165 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07361528-cd9a-45e4-a00a-f452f8a3ee2b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:31.610840 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9cd0a58e6854b92a9f988f2f915d65f', 'request_id': 'req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:31.646886 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 882/1760] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:31 2022] POST /identity/v3/projects => generated 405 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:43:31.646886 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61c7cc-590f-4736-b7eb-53036ef50611 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:31.646886 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61c7cc-590f-4736-b7eb-53036ef50611 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:31.646886 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61c7cc-590f-4736-b7eb-53036ef50611 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:31.654802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 883/1761] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 31 04:43:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:43:31.656291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61c7cc-590f-4736-b7eb-53036ef50611 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:31.728449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9cd0a58e6854b92a9f988f2f915d65f', 'request_id': 'req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:31.748386 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9cd0a58e6854b92a9f988f2f915d65f', 'request_id': 'req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:31.843040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f admin admin] The token cache is being invalidate because project c9cd0a58e6854b92a9f988f2f915d65f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:31.847077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:31.853949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e5d5bf2b-1b5b-498b-a252-69efd4dd997f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:31.863421 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 879/1762] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:31 2022] DELETE /identity/v3/projects/c9cd0a58e6854b92a9f988f2f915d65f => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:31.870926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48accc-07a2-4d2e-8cbf-16371d13d3be None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:31.880400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48accc-07a2-4d2e-8cbf-16371d13d3be None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:31.880400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48accc-07a2-4d2e-8cbf-16371d13d3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:31.884339 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61c7cc-590f-4736-b7eb-53036ef50611 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:31.914893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fb130-7f0d-4d58-81e5-2d0b9dd12a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:31.914893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fb130-7f0d-4d58-81e5-2d0b9dd12a61 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:31.915249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fb130-7f0d-4d58-81e5-2d0b9dd12a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:31.915718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fb130-7f0d-4d58-81e5-2d0b9dd12a61 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:31.916531 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fb130-7f0d-4d58-81e5-2d0b9dd12a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:31.920499 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fb130-7f0d-4d58-81e5-2d0b9dd12a61 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:31.974715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ea48accc-07a2-4d2e-8cbf-16371d13d3be None None] MFA Rules not processed for user `4877b72a6cea410dbb31a35c7acbd5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:31.979121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ea48accc-07a2-4d2e-8cbf-16371d13d3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:32.031199 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 884/1763] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:31 2022] POST /identity/v3/users => generated 309 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:32.032453 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fb130-7f0d-4d58-81e5-2d0b9dd12a61 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:32.038396 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-995fb130-7f0d-4d58-81e5-2d0b9dd12a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:32.100682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fb130-7f0d-4d58-81e5-2d0b9dd12a61 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:32.108115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aedad3-9ec8-4543-af61-9e6a7c41ea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:32.108907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aedad3-9ec8-4543-af61-9e6a7c41ea6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:32.109693 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aedad3-9ec8-4543-af61-9e6a7c41ea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:32.110319 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aedad3-9ec8-4543-af61-9e6a7c41ea6c admin admin] PATH_INFO: `/v3/users/8a767fd274a94a00aa0bd82fdbab1351` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:32.112322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aedad3-9ec8-4543-af61-9e6a7c41ea6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a767fd274a94a00aa0bd82fdbab1351)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:32.114666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aedad3-9ec8-4543-af61-9e6a7c41ea6c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:32.134229 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:32.290877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 880/1764] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 31 04:43:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:32.293639 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48accc-07a2-4d2e-8cbf-16371d13d3be None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:32.296040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ea48accc-07a2-4d2e-8cbf-16371d13d3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:32.308916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:32.340906 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48accc-07a2-4d2e-8cbf-16371d13d3be None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:32.349877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0c6a6-81da-4f2d-950f-49809e42dbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:32.350722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0c6a6-81da-4f2d-950f-49809e42dbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:32.352103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0c6a6-81da-4f2d-950f-49809e42dbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:32.353692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0c6a6-81da-4f2d-950f-49809e42dbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:32.354614 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0c6a6-81da-4f2d-950f-49809e42dbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:32.358340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0c6a6-81da-4f2d-950f-49809e42dbf1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:32.405192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 881/1765] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:32.407823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0c6a6-81da-4f2d-950f-49809e42dbf1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:32.413804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e1c0c6a6-81da-4f2d-950f-49809e42dbf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:32.448859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0c6a6-81da-4f2d-950f-49809e42dbf1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:32.455858 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd675b9-e8a4-41be-8a1a-0c6a558668a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:32.456487 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd675b9-e8a4-41be-8a1a-0c6a558668a6 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:32.456767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd675b9-e8a4-41be-8a1a-0c6a558668a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:32.457041 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd675b9-e8a4-41be-8a1a-0c6a558668a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:32.462321 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-98aedad3-9ec8-4543-af61-9e6a7c41ea6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a767fd274a94a00aa0bd82fdbab1351'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:32.467765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd675b9-e8a4-41be-8a1a-0c6a558668a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:32.469982 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd675b9-e8a4-41be-8a1a-0c6a558668a6 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:32.488522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 882/1766] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:32.489615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd675b9-e8a4-41be-8a1a-0c6a558668a6 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:32.502487 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd675b9-e8a4-41be-8a1a-0c6a558668a6 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:32.510058 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6407c9-7b48-4d76-8b30-c3ceac20d6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:32.516049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6407c9-7b48-4d76-8b30-c3ceac20d6a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:32.516049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6407c9-7b48-4d76-8b30-c3ceac20d6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:32.516049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6407c9-7b48-4d76-8b30-c3ceac20d6a5 admin admin] PATH_INFO: `/v3/projects/851718f7d1fe4744943b965568a89586/users/70af4657e7f4430e8b172ff01bc3971f/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:32.531452 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-98aedad3-9ec8-4543-af61-9e6a7c41ea6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a767fd274a94a00aa0bd82fdbab1351'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:32.534610 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6407c9-7b48-4d76-8b30-c3ceac20d6a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=851718f7d1fe4744943b965568a89586, user_id=70af4657e7f4430e8b172ff01bc3971f, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:32.551099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6407c9-7b48-4d76-8b30-c3ceac20d6a5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:32.652676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-98aedad3-9ec8-4543-af61-9e6a7c41ea6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a767fd274a94a00aa0bd82fdbab1351'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:32.663950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-98aedad3-9ec8-4543-af61-9e6a7c41ea6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a767fd274a94a00aa0bd82fdbab1351'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:32.666918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-98aedad3-9ec8-4543-af61-9e6a7c41ea6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a767fd274a94a00aa0bd82fdbab1351'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:32.671109 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 883/1767] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:32 2022] PUT /identity/v3/projects/851718f7d1fe4744943b965568a89586/users/70af4657e7f4430e8b172ff01bc3971f/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:32.676059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6407c9-7b48-4d76-8b30-c3ceac20d6a5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:32.683554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eb6407c9-7b48-4d76-8b30-c3ceac20d6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:32.694164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 885/1768] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:32 2022] DELETE /identity/v3/users/8a767fd274a94a00aa0bd82fdbab1351 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:32.812947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dbd3c-2140-4a19-ba82-a2bffea06fe6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:32.813633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dbd3c-2140-4a19-ba82-a2bffea06fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:32.814127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dbd3c-2140-4a19-ba82-a2bffea06fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:32.906353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6407c9-7b48-4d76-8b30-c3ceac20d6a5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:32.920500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c63dbd3c-2140-4a19-ba82-a2bffea06fe6 None None] MFA Rules not processed for user `ab4a337783e649a599f4933b16db6027`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:32.921797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c63dbd3c-2140-4a19-ba82-a2bffea06fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:33.037502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87685c-7074-45e8-be21-ac0384f3ef94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:33.038196 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87685c-7074-45e8-be21-ac0384f3ef94 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:33.038490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87685c-7074-45e8-be21-ac0384f3ef94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:33.041153 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87685c-7074-45e8-be21-ac0384f3ef94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:33.041153 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87685c-7074-45e8-be21-ac0384f3ef94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:33.041517 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87685c-7074-45e8-be21-ac0384f3ef94 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:33.068842 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 884/1769] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:33.069991 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87685c-7074-45e8-be21-ac0384f3ef94 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:33.077618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-db87685c-7074-45e8-be21-ac0384f3ef94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:33.106246 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87685c-7074-45e8-be21-ac0384f3ef94 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:33.121734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cd31e-0f03-46a7-9c52-a14188ace4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:33.122562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cd31e-0f03-46a7-9c52-a14188ace4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:33.122949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cd31e-0f03-46a7-9c52-a14188ace4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:33.123370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cd31e-0f03-46a7-9c52-a14188ace4eb admin admin] PATH_INFO: `/v3/users/5c474d84711b40ff910f81a1c76020ca` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:33.130934 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cd31e-0f03-46a7-9c52-a14188ace4eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c474d84711b40ff910f81a1c76020ca)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:33.131960 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cd31e-0f03-46a7-9c52-a14188ace4eb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:33.200380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 886/1770] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:33.201702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dbd3c-2140-4a19-ba82-a2bffea06fe6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:33.203266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c63dbd3c-2140-4a19-ba82-a2bffea06fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:33.235027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dbd3c-2140-4a19-ba82-a2bffea06fe6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:33.249014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c4061-f031-4b1f-b2ac-3a1aa00984b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:33.250074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c4061-f031-4b1f-b2ac-3a1aa00984b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:33.250637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c4061-f031-4b1f-b2ac-3a1aa00984b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:33.251022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c4061-f031-4b1f-b2ac-3a1aa00984b4 admin admin] PATH_INFO: `/v3/users/b2b5a3f4ecfc4c2cbc85425204224aac` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:33.252347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c4061-f031-4b1f-b2ac-3a1aa00984b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2b5a3f4ecfc4c2cbc85425204224aac)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:33.254585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c4061-f031-4b1f-b2ac-3a1aa00984b4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:33.457404 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4d2cd31e-0f03-46a7-9c52-a14188ace4eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c474d84711b40ff910f81a1c76020ca'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:33.459306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4d2cd31e-0f03-46a7-9c52-a14188ace4eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c474d84711b40ff910f81a1c76020ca'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:33.498080 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4d2cd31e-0f03-46a7-9c52-a14188ace4eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c474d84711b40ff910f81a1c76020ca'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:33.522751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4d2cd31e-0f03-46a7-9c52-a14188ace4eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c474d84711b40ff910f81a1c76020ca'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:33.523915 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4d2cd31e-0f03-46a7-9c52-a14188ace4eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c474d84711b40ff910f81a1c76020ca'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:33.530529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fc3c4061-f031-4b1f-b2ac-3a1aa00984b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2b5a3f4ecfc4c2cbc85425204224aac'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:33.595671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fc3c4061-f031-4b1f-b2ac-3a1aa00984b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2b5a3f4ecfc4c2cbc85425204224aac'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:33.639899 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 885/1771] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:33 2022] DELETE /identity/v3/users/5c474d84711b40ff910f81a1c76020ca => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:33.640833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cd31e-0f03-46a7-9c52-a14188ace4eb admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:33.664056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4d2cd31e-0f03-46a7-9c52-a14188ace4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:33.711174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:33.711846 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fc3c4061-f031-4b1f-b2ac-3a1aa00984b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2b5a3f4ecfc4c2cbc85425204224aac'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:33.731878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fc3c4061-f031-4b1f-b2ac-3a1aa00984b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2b5a3f4ecfc4c2cbc85425204224aac'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:33.731878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fc3c4061-f031-4b1f-b2ac-3a1aa00984b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2b5a3f4ecfc4c2cbc85425204224aac'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:33.735665 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 887/1772] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:33 2022] DELETE /identity/v3/users/b2b5a3f4ecfc4c2cbc85425204224aac => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:33.758370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c4061-f031-4b1f-b2ac-3a1aa00984b4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:33.760142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fc3c4061-f031-4b1f-b2ac-3a1aa00984b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:33.831629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cd31e-0f03-46a7-9c52-a14188ace4eb admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:33.851808 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c4061-f031-4b1f-b2ac-3a1aa00984b4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:33.861051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006a67f-4396-4865-9075-141561dc75c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:33.861868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006a67f-4396-4865-9075-141561dc75c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:33.862117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006a67f-4396-4865-9075-141561dc75c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:33.862463 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006a67f-4396-4865-9075-141561dc75c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:33.863022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006a67f-4396-4865-9075-141561dc75c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:33.865842 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006a67f-4396-4865-9075-141561dc75c0 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:33.958790 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:33.961770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7af38-70ce-456d-890c-ab674ec704be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:33.962650 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7af38-70ce-456d-890c-ab674ec704be admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:33.963006 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7af38-70ce-456d-890c-ab674ec704be admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:33.963290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7af38-70ce-456d-890c-ab674ec704be admin admin] PATH_INFO: `/v3/projects/851718f7d1fe4744943b965568a89586/users/70af4657e7f4430e8b172ff01bc3971f/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:33.965661 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7af38-70ce-456d-890c-ab674ec704be admin admin] RBAC: Authorizing `identity:create_grant(project_id=851718f7d1fe4744943b965568a89586, user_id=70af4657e7f4430e8b172ff01bc3971f, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:33.971416 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7af38-70ce-456d-890c-ab674ec704be admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:33.972123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 888/1773] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:33 2022] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:33.973759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb0f8-614b-49fd-94c3-c69ca4a9deb4 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:33.974091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb0f8-614b-49fd-94c3-c69ca4a9deb4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:33.974421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb0f8-614b-49fd-94c3-c69ca4a9deb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:34.002630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 886/1774] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:33 2022] PUT /identity/v3/projects/851718f7d1fe4744943b965568a89586/users/70af4657e7f4430e8b172ff01bc3971f/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:34.002630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca35c30-d9c3-4edf-ad61-519900035050 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:34.002630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca35c30-d9c3-4edf-ad61-519900035050 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:34.002630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca35c30-d9c3-4edf-ad61-519900035050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:34.011707 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e45cb0f8-614b-49fd-94c3-c69ca4a9deb4 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:34.016215 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e45cb0f8-614b-49fd-94c3-c69ca4a9deb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:34.030741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4ca35c30-d9c3-4edf-ad61-519900035050 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:34.033643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4ca35c30-d9c3-4edf-ad61-519900035050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:34.133607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 887/1775] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:34.134851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca35c30-d9c3-4edf-ad61-519900035050 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:34.137421 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4ca35c30-d9c3-4edf-ad61-519900035050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:34.153767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca35c30-d9c3-4edf-ad61-519900035050 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:34.159747 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:34.160478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:34.161006 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:34.161449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] PATH_INFO: `/v3/projects/136a0499c62741129c2f188ea5a9e51c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:34.162964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=136a0499c62741129c2f188ea5a9e51c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:34.165439 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:34.177841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 889/1776] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:34.180292 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cb0f8-614b-49fd-94c3-c69ca4a9deb4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:34.207402 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cb0f8-614b-49fd-94c3-c69ca4a9deb4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:34.222015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378b858-4c0b-4f52-bb50-3a12e6016369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:34.223839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378b858-4c0b-4f52-bb50-3a12e6016369 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:34.224218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378b858-4c0b-4f52-bb50-3a12e6016369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:34.225792 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378b858-4c0b-4f52-bb50-3a12e6016369 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:34.228026 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378b858-4c0b-4f52-bb50-3a12e6016369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:34.234421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378b858-4c0b-4f52-bb50-3a12e6016369 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:34.341156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 890/1777] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:34 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:34.348931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378b858-4c0b-4f52-bb50-3a12e6016369 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:34.359142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136a0499c62741129c2f188ea5a9e51c', 'request_id': 'req-dd6ed4aa-cad2-4459-a74f-b8d21132a471'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:34.369354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e378b858-4c0b-4f52-bb50-3a12e6016369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:34.442850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136a0499c62741129c2f188ea5a9e51c', 'request_id': 'req-dd6ed4aa-cad2-4459-a74f-b8d21132a471'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:34.452144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136a0499c62741129c2f188ea5a9e51c', 'request_id': 'req-dd6ed4aa-cad2-4459-a74f-b8d21132a471'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:34.491599 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] The token cache is being invalidate because project 136a0499c62741129c2f188ea5a9e51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:34.492883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:34.494428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:34.508923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 888/1778] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:34 2022] DELETE /identity/v3/projects/136a0499c62741129c2f188ea5a9e51c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:34.514280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378b858-4c0b-4f52-bb50-3a12e6016369 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:34.531738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:34.538817 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:34.708369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf8f25-022e-4b18-a46b-1791e415cae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:34.709449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf8f25-022e-4b18-a46b-1791e415cae6 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:34.710168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf8f25-022e-4b18-a46b-1791e415cae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:34.713100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf8f25-022e-4b18-a46b-1791e415cae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:34.715322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-35bf8f25-022e-4b18-a46b-1791e415cae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:34.766537 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ed4aa-cad2-4459-a74f-b8d21132a471 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:34.779103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d715f-26d9-4da1-a77a-9d88564a37ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:34.783676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d715f-26d9-4da1-a77a-9d88564a37ce service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:34.783676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d715f-26d9-4da1-a77a-9d88564a37ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:34.783676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d715f-26d9-4da1-a77a-9d88564a37ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:34.784549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ac2d715f-26d9-4da1-a77a-9d88564a37ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:34.842819 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:34.916923 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf8f25-022e-4b18-a46b-1791e415cae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:34.920162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf8f25-022e-4b18-a46b-1791e415cae6 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:34.938733 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d715f-26d9-4da1-a77a-9d88564a37ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:34.940318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d715f-26d9-4da1-a77a-9d88564a37ce service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:34.941490 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 891/1779] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:34.942498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:34.944027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf8f25-022e-4b18-a46b-1791e415cae6 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:34.945997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-35bf8f25-022e-4b18-a46b-1791e415cae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:34.966427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 889/1780] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:34.967922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fbf28-1552-4f32-9e03-00353c37d8fd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:34.970498 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fbf28-1552-4f32-9e03-00353c37d8fd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:34.971015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fbf28-1552-4f32-9e03-00353c37d8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:34.977625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf8f25-022e-4b18-a46b-1791e415cae6 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:34.985155 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb10d8-91d3-43bb-835f-697b339fbb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:34.986096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb10d8-91d3-43bb-835f-697b339fbb35 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:34.986622 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb10d8-91d3-43bb-835f-697b339fbb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:34.987254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb10d8-91d3-43bb-835f-697b339fbb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:34.988167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb10d8-91d3-43bb-835f-697b339fbb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:34.990270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb10d8-91d3-43bb-835f-697b339fbb35 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:35.011718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 892/1781] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:35.012951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb10d8-91d3-43bb-835f-697b339fbb35 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:35.018299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6c5fbf28-1552-4f32-9e03-00353c37d8fd None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:35.020678 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6c5fbf28-1552-4f32-9e03-00353c37d8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:35.024200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb10d8-91d3-43bb-835f-697b339fbb35 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:35.036986 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70df4e0-9092-45ed-b365-31629eb9ad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:35.038239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70df4e0-9092-45ed-b365-31629eb9ad31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:35.038805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70df4e0-9092-45ed-b365-31629eb9ad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:35.039533 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70df4e0-9092-45ed-b365-31629eb9ad31 admin admin] PATH_INFO: `/v3/projects/634b2d716fbf422fb907c42767ce47bd/users/631c72a61aad4d19a7899fac6fc533cb/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:35.047790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 890/1782] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:35.057116 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688b02b-5cf4-45d6-8a27-11a3da12468c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:35.058168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688b02b-5cf4-45d6-8a27-11a3da12468c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:35.058676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688b02b-5cf4-45d6-8a27-11a3da12468c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:35.089638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70df4e0-9092-45ed-b365-31629eb9ad31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634b2d716fbf422fb907c42767ce47bd, user_id=631c72a61aad4d19a7899fac6fc533cb, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:35.093881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70df4e0-9092-45ed-b365-31629eb9ad31 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:35.106528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1688b02b-5cf4-45d6-8a27-11a3da12468c None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:35.108809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1688b02b-5cf4-45d6-8a27-11a3da12468c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:35.129394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 891/1783] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:35.134453 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688b02b-5cf4-45d6-8a27-11a3da12468c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:35.155321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688b02b-5cf4-45d6-8a27-11a3da12468c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:35.163030 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d15336-6442-4113-ba54-e3022a42a698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:35.163860 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d15336-6442-4113-ba54-e3022a42a698 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:35.164534 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d15336-6442-4113-ba54-e3022a42a698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:35.164954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d15336-6442-4113-ba54-e3022a42a698 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:35.166044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d15336-6442-4113-ba54-e3022a42a698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:43:35.180221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 893/1784] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:35 2022] PUT /identity/v3/projects/634b2d716fbf422fb907c42767ce47bd/users/631c72a61aad4d19a7899fac6fc533cb/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:35.185644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70df4e0-9092-45ed-b365-31629eb9ad31 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:35.186284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d15336-6442-4113-ba54-e3022a42a698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:35.190926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d15336-6442-4113-ba54-e3022a42a698 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:35.240589 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 892/1785] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:43:35.246463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d15336-6442-4113-ba54-e3022a42a698 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:35.271764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d15336-6442-4113-ba54-e3022a42a698 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:35.322317 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70df4e0-9092-45ed-b365-31629eb9ad31 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:35.331157 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811e797-4138-4090-818e-12b64fb0af2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:35.334970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811e797-4138-4090-818e-12b64fb0af2f admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:35.334970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811e797-4138-4090-818e-12b64fb0af2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:35.334970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811e797-4138-4090-818e-12b64fb0af2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:35.334970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811e797-4138-4090-818e-12b64fb0af2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:35.335354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811e797-4138-4090-818e-12b64fb0af2f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:35.354019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 894/1786] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:35.355399 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811e797-4138-4090-818e-12b64fb0af2f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:35.368800 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811e797-4138-4090-818e-12b64fb0af2f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:35.376001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d68deb-d288-4db5-83fc-2fe0bb743571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:35.376913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d68deb-d288-4db5-83fc-2fe0bb743571 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:35.377288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d68deb-d288-4db5-83fc-2fe0bb743571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:35.377635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d68deb-d288-4db5-83fc-2fe0bb743571 admin admin] PATH_INFO: `/v3/projects/634b2d716fbf422fb907c42767ce47bd/users/631c72a61aad4d19a7899fac6fc533cb/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:35.379874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d68deb-d288-4db5-83fc-2fe0bb743571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634b2d716fbf422fb907c42767ce47bd, user_id=631c72a61aad4d19a7899fac6fc533cb, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:35.383018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d68deb-d288-4db5-83fc-2fe0bb743571 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:35.400160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 895/1787] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:35 2022] PUT /identity/v3/projects/634b2d716fbf422fb907c42767ce47bd/users/631c72a61aad4d19a7899fac6fc533cb/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:35.522327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2ad80-7983-4f92-a753-8b61dc40acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:35.523065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2ad80-7983-4f92-a753-8b61dc40acf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:35.523348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2ad80-7983-4f92-a753-8b61dc40acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:35.523616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2ad80-7983-4f92-a753-8b61dc40acf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:35.524680 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2ad80-7983-4f92-a753-8b61dc40acf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:35.526230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2ad80-7983-4f92-a753-8b61dc40acf5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:35.633540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 893/1788] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:35 2022] POST /identity/v3/projects => generated 381 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:35.634160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d68deb-d288-4db5-83fc-2fe0bb743571 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:35.861498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d68deb-d288-4db5-83fc-2fe0bb743571 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:35.926720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:35.966929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6314e-836d-45e4-a7d5-2e30c381677c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:35.967920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6314e-836d-45e4-a7d5-2e30c381677c admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:35.968423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6314e-836d-45e4-a7d5-2e30c381677c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:35.969085 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6314e-836d-45e4-a7d5-2e30c381677c admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:35.973515 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6314e-836d-45e4-a7d5-2e30c381677c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:35.977575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6314e-836d-45e4-a7d5-2e30c381677c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:36.061904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 896/1789] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:35 2022] POST /identity/v3/users => generated 291 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:36.066098 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2ad80-7983-4f92-a753-8b61dc40acf5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:36.088085 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2ad80-7983-4f92-a753-8b61dc40acf5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:36.095225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b2df-5078-4ad5-9b36-4c608cc581ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:36.096115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b2df-5078-4ad5-9b36-4c608cc581ff admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:36.096542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b2df-5078-4ad5-9b36-4c608cc581ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:36.099497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b2df-5078-4ad5-9b36-4c608cc581ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:36.106147 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b2df-5078-4ad5-9b36-4c608cc581ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:36.110087 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b2df-5078-4ad5-9b36-4c608cc581ff admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:36.123701 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 894/1790] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:43:36.127510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6314e-836d-45e4-a7d5-2e30c381677c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:36.142392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6314e-836d-45e4-a7d5-2e30c381677c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:36.145056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:36.157170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40d7e6-6b2c-4496-99f6-6984b7b314e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:36.157859 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40d7e6-6b2c-4496-99f6-6984b7b314e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:36.158139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40d7e6-6b2c-4496-99f6-6984b7b314e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:36.158406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40d7e6-6b2c-4496-99f6-6984b7b314e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:36.159050 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40d7e6-6b2c-4496-99f6-6984b7b314e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:36.160657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40d7e6-6b2c-4496-99f6-6984b7b314e6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:36.181462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 897/1791] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:36.186605 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b2df-5078-4ad5-9b36-4c608cc581ff admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:36.201595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b2df-5078-4ad5-9b36-4c608cc581ff admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:36.215206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7642ca2-f91a-4a03-80cd-44d8c3ccfb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:36.218126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40d7e6-6b2c-4496-99f6-6984b7b314e6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:36.219727 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642ca2-f91a-4a03-80cd-44d8c3ccfb75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:36.219867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ec40d7e6-6b2c-4496-99f6-6984b7b314e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:36.220019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642ca2-f91a-4a03-80cd-44d8c3ccfb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:36.220304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7642ca2-f91a-4a03-80cd-44d8c3ccfb75 admin admin] PATH_INFO: `/v3/projects/1b45a6419be742af9dcb4ffc738fd781/users/33cb9aa59d2e4fd2b638154a426acf61/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:36.241084 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40d7e6-6b2c-4496-99f6-6984b7b314e6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:36.256412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:36.257062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:36.257501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:36.257739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] PATH_INFO: `/v3/projects/f745f573e51547479ceba8b50eb689e1` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:36.258952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f745f573e51547479ceba8b50eb689e1)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:36.261550 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:36.266355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7642ca2-f91a-4a03-80cd-44d8c3ccfb75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b45a6419be742af9dcb4ffc738fd781, user_id=33cb9aa59d2e4fd2b638154a426acf61, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:36.301460 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7642ca2-f91a-4a03-80cd-44d8c3ccfb75 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:36.462067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 895/1792] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:36 2022] PUT /identity/v3/projects/1b45a6419be742af9dcb4ffc738fd781/users/33cb9aa59d2e4fd2b638154a426acf61/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:36.466117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f745f573e51547479ceba8b50eb689e1', 'request_id': 'req-0bd23ad5-b09e-4395-becf-e3732e1b7758'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:36.480360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af3c76-02c5-4f80-82a7-ff120293f282 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:36.480661 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af3c76-02c5-4f80-82a7-ff120293f282 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:36.480838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af3c76-02c5-4f80-82a7-ff120293f282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:36.533864 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f745f573e51547479ceba8b50eb689e1', 'request_id': 'req-0bd23ad5-b09e-4395-becf-e3732e1b7758'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:36.540612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f745f573e51547479ceba8b50eb689e1', 'request_id': 'req-0bd23ad5-b09e-4395-becf-e3732e1b7758'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:36.566603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] The token cache is being invalidate because project f745f573e51547479ceba8b50eb689e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:36.567085 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:36.568678 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:36.575246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 898/1793] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:36 2022] DELETE /identity/v3/projects/f745f573e51547479ceba8b50eb689e1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:36.577726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:36.579558 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:36.600945 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d1af3c76-02c5-4f80-82a7-ff120293f282 None None] MFA Rules not processed for user `33cb9aa59d2e4fd2b638154a426acf61`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:36.603628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d1af3c76-02c5-4f80-82a7-ff120293f282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:36.685431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:36.703264 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd23ad5-b09e-4395-becf-e3732e1b7758 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:36.719696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a0891-5b0e-46c4-ab26-1e60fd8bb71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:36.720602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a0891-5b0e-46c4-ab26-1e60fd8bb71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:36.720919 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a0891-5b0e-46c4-ab26-1e60fd8bb71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:36.721163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a0891-5b0e-46c4-ab26-1e60fd8bb71f admin admin] PATH_INFO: `/v3/users/0fc54778e266474eaafaf1e31475efcb` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:36.723111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a0891-5b0e-46c4-ab26-1e60fd8bb71f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc54778e266474eaafaf1e31475efcb)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:36.726118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a0891-5b0e-46c4-ab26-1e60fd8bb71f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:36.818923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 896/1794] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:36.825918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af3c76-02c5-4f80-82a7-ff120293f282 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:36.827794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d1af3c76-02c5-4f80-82a7-ff120293f282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:36.842723 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af3c76-02c5-4f80-82a7-ff120293f282 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:36.847977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae92c0-078c-4f2d-813a-bebe9bce17c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:36.848611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae92c0-078c-4f2d-813a-bebe9bce17c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:36.848892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae92c0-078c-4f2d-813a-bebe9bce17c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:36.849171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae92c0-078c-4f2d-813a-bebe9bce17c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:36.850251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae92c0-078c-4f2d-813a-bebe9bce17c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:36.861055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae92c0-078c-4f2d-813a-bebe9bce17c3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:36.975398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-814a0891-5b0e-46c4-ab26-1e60fd8bb71f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc54778e266474eaafaf1e31475efcb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.014615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-814a0891-5b0e-46c4-ab26-1e60fd8bb71f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc54778e266474eaafaf1e31475efcb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.018116 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 897/1795] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:36 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:37.019732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae92c0-078c-4f2d-813a-bebe9bce17c3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:37.023233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ddae92c0-078c-4f2d-813a-bebe9bce17c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:37.117210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-814a0891-5b0e-46c4-ab26-1e60fd8bb71f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc54778e266474eaafaf1e31475efcb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.121286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae92c0-078c-4f2d-813a-bebe9bce17c3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:37.127326 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-814a0891-5b0e-46c4-ab26-1e60fd8bb71f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc54778e266474eaafaf1e31475efcb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.128578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-814a0891-5b0e-46c4-ab26-1e60fd8bb71f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc54778e266474eaafaf1e31475efcb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.134906 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:37.135586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:37.136481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:37.136786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] PATH_INFO: `/v3/projects/26c2300cba274fc88da5613bcc92e78d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:37.140524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c2300cba274fc88da5613bcc92e78d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:37.142719 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 899/1796] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:36 2022] DELETE /identity/v3/users/0fc54778e266474eaafaf1e31475efcb => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:37.143385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a0891-5b0e-46c4-ab26-1e60fd8bb71f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:37.145927 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:37.148694 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-814a0891-5b0e-46c4-ab26-1e60fd8bb71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:37.270082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a0891-5b0e-46c4-ab26-1e60fd8bb71f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:37.287740 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d9e8d-41b9-42a5-8562-e906f4b0e007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:37.288440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d9e8d-41b9-42a5-8562-e906f4b0e007 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:37.288881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d9e8d-41b9-42a5-8562-e906f4b0e007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:37.289682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d9e8d-41b9-42a5-8562-e906f4b0e007 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:37.291641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d9e8d-41b9-42a5-8562-e906f4b0e007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:37.299346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d9e8d-41b9-42a5-8562-e906f4b0e007 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:37.332446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c2300cba274fc88da5613bcc92e78d', 'request_id': 'req-8ce6f188-7996-4558-be56-aba888b389ba'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.424816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c2300cba274fc88da5613bcc92e78d', 'request_id': 'req-8ce6f188-7996-4558-be56-aba888b389ba'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.432350 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 900/1797] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:37 2022] POST /identity/v3/users => generated 298 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:37.434167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c2300cba274fc88da5613bcc92e78d', 'request_id': 'req-8ce6f188-7996-4558-be56-aba888b389ba'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.436229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d9e8d-41b9-42a5-8562-e906f4b0e007 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:37.437778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:37.454910 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d9e8d-41b9-42a5-8562-e906f4b0e007 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:37.459839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] The token cache is being invalidate because project 26c2300cba274fc88da5613bcc92e78d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:37.460362 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.465437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.467436 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 898/1798] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:37 2022] DELETE /identity/v3/projects/26c2300cba274fc88da5613bcc92e78d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:37.471535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:37.473445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:37.560597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70af963-cfc1-4713-b0e6-92322d47fe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:37.561255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70af963-cfc1-4713-b0e6-92322d47fe62 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:37.561608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70af963-cfc1-4713-b0e6-92322d47fe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:37.562306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70af963-cfc1-4713-b0e6-92322d47fe62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:37.562535 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70af963-cfc1-4713-b0e6-92322d47fe62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:37.564154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70af963-cfc1-4713-b0e6-92322d47fe62 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:37.576180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 901/1799] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:37.580131 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70af963-cfc1-4713-b0e6-92322d47fe62 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:37.582080 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f70af963-cfc1-4713-b0e6-92322d47fe62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:37.597030 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70af963-cfc1-4713-b0e6-92322d47fe62 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:37.610049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0510d6b-39da-4bc0-a647-c1210a21ff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:37.610888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0510d6b-39da-4bc0-a647-c1210a21ff00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:37.611172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0510d6b-39da-4bc0-a647-c1210a21ff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:37.621436 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0510d6b-39da-4bc0-a647-c1210a21ff00 admin admin] PATH_INFO: `/v3/projects/85856c0924684114aa4e0086fc2db921/users/3ec0c7884283455fa30eb1f41e1a59ed/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:37.621582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6f188-7996-4558-be56-aba888b389ba admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:37.622853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaa6e5-ddf0-49ca-9eb0-89d7cb6e4263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:37.623710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaa6e5-ddf0-49ca-9eb0-89d7cb6e4263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:37.624519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaa6e5-ddf0-49ca-9eb0-89d7cb6e4263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:37.624935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaa6e5-ddf0-49ca-9eb0-89d7cb6e4263 admin admin] PATH_INFO: `/v3/users/ba92c7266d0247d09455f62209c70d10` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:37.626451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afaa6e5-ddf0-49ca-9eb0-89d7cb6e4263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba92c7266d0247d09455f62209c70d10)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:37.629031 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afaa6e5-ddf0-49ca-9eb0-89d7cb6e4263 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:37.630214 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0510d6b-39da-4bc0-a647-c1210a21ff00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85856c0924684114aa4e0086fc2db921, user_id=3ec0c7884283455fa30eb1f41e1a59ed, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:37.633131 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0510d6b-39da-4bc0-a647-c1210a21ff00 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:37.736609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 902/1800] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:37 2022] PUT /identity/v3/projects/85856c0924684114aa4e0086fc2db921/users/3ec0c7884283455fa30eb1f41e1a59ed/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:37.742150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0510d6b-39da-4bc0-a647-c1210a21ff00 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:37.852998 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2afaa6e5-ddf0-49ca-9eb0-89d7cb6e4263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba92c7266d0247d09455f62209c70d10'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.855320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2afaa6e5-ddf0-49ca-9eb0-89d7cb6e4263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba92c7266d0247d09455f62209c70d10'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.877992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2afaa6e5-ddf0-49ca-9eb0-89d7cb6e4263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba92c7266d0247d09455f62209c70d10'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.886276 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0510d6b-39da-4bc0-a647-c1210a21ff00 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:37.890546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2afaa6e5-ddf0-49ca-9eb0-89d7cb6e4263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba92c7266d0247d09455f62209c70d10'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.892703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2afaa6e5-ddf0-49ca-9eb0-89d7cb6e4263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba92c7266d0247d09455f62209c70d10'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:37.898222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee8f55-5e7a-4338-820b-72fde0c204a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:37.898424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8f55-5e7a-4338-820b-72fde0c204a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:37.898722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8f55-5e7a-4338-820b-72fde0c204a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:37.898968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8f55-5e7a-4338-820b-72fde0c204a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:37.899642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee8f55-5e7a-4338-820b-72fde0c204a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:37.901309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee8f55-5e7a-4338-820b-72fde0c204a7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:37.912259 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 903/1801] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:37.913617 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2c184-bce1-495a-8463-5ce0445e85db None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:37.913851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2c184-bce1-495a-8463-5ce0445e85db None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:37.914122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2c184-bce1-495a-8463-5ce0445e85db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:37.944593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-67f2c184-bce1-495a-8463-5ce0445e85db None None] MFA Rules not processed for user `70af4657e7f4430e8b172ff01bc3971f`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:37.945847 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-67f2c184-bce1-495a-8463-5ce0445e85db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:37.980219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 899/1802] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:37 2022] DELETE /identity/v3/users/ba92c7266d0247d09455f62209c70d10 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:37.981124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaa6e5-ddf0-49ca-9eb0-89d7cb6e4263 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:37.982623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2afaa6e5-ddf0-49ca-9eb0-89d7cb6e4263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:38.039562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 904/1803] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:37 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:38.079978 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:38.095832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaa6e5-ddf0-49ca-9eb0-89d7cb6e4263 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:38.100964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe0c28-723d-480a-9a25-f177832913d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:38.101724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe0c28-723d-480a-9a25-f177832913d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:38.107293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe0c28-723d-480a-9a25-f177832913d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:38.107293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe0c28-723d-480a-9a25-f177832913d6 admin admin] PATH_INFO: `/v3/projects/85856c0924684114aa4e0086fc2db921/users/3ec0c7884283455fa30eb1f41e1a59ed/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:38.107293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe0c28-723d-480a-9a25-f177832913d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85856c0924684114aa4e0086fc2db921, user_id=3ec0c7884283455fa30eb1f41e1a59ed, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:38.107569 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe0c28-723d-480a-9a25-f177832913d6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:38.123250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 900/1804] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:37 2022] PUT /identity/v3/projects/85856c0924684114aa4e0086fc2db921/users/3ec0c7884283455fa30eb1f41e1a59ed/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:38.140300 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448f79e-779f-4188-acfb-8e527db2a782 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:38.140591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448f79e-779f-4188-acfb-8e527db2a782 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:38.140998 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448f79e-779f-4188-acfb-8e527db2a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:38.142950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe0c28-723d-480a-9a25-f177832913d6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:38.148874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-99fe0c28-723d-480a-9a25-f177832913d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:38.186125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4448f79e-779f-4188-acfb-8e527db2a782 None None] MFA Rules not processed for user `3ec0c7884283455fa30eb1f41e1a59ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:38.187730 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4448f79e-779f-4188-acfb-8e527db2a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:38.260125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe0c28-723d-480a-9a25-f177832913d6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:38.262279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:38.262751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:38.263100 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:38.263479 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd admin admin] PATH_INFO: `/v3/projects/50f6d5c6dcde40e89df16a1d2428146d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:38.264886 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f6d5c6dcde40e89df16a1d2428146d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:38.267676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:38.316862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 905/1805] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:38.319845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd8168-21c3-4987-b7ee-52c02fc66bff None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:38.320211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd8168-21c3-4987-b7ee-52c02fc66bff None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:38.320603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd8168-21c3-4987-b7ee-52c02fc66bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:38.357306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-55bd8168-21c3-4987-b7ee-52c02fc66bff None None] MFA Rules not processed for user `631c72a61aad4d19a7899fac6fc533cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:38.362764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-55bd8168-21c3-4987-b7ee-52c02fc66bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:38.406476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f6d5c6dcde40e89df16a1d2428146d', 'request_id': 'req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:38.439709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:38.450612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 906/1806] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:38.451551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd8168-21c3-4987-b7ee-52c02fc66bff None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:38.452829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-55bd8168-21c3-4987-b7ee-52c02fc66bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:38.515330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd8168-21c3-4987-b7ee-52c02fc66bff None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:38.516616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f6d5c6dcde40e89df16a1d2428146d', 'request_id': 'req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:38.523786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f6d5c6dcde40e89df16a1d2428146d', 'request_id': 'req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:38.536702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd admin admin] The token cache is being invalidate because project 50f6d5c6dcde40e89df16a1d2428146d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:38.537113 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:38.537990 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-890ce50a-cab4-4604-9a7c-b6bf4e9e23bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:38.539863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 901/1807] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:38 2022] DELETE /identity/v3/projects/50f6d5c6dcde40e89df16a1d2428146d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:38.541237 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297be64-1393-4cb7-a7f5-fe58f1596621 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:38.541635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297be64-1393-4cb7-a7f5-fe58f1596621 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:38.542768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297be64-1393-4cb7-a7f5-fe58f1596621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:38.566202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4297be64-1393-4cb7-a7f5-fe58f1596621 None None] MFA Rules not processed for user `ab4a337783e649a599f4933b16db6027`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:38.567650 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4297be64-1393-4cb7-a7f5-fe58f1596621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:38.579691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe807d-f925-4924-bd2a-74c55adfc42d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:38.580298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe807d-f925-4924-bd2a-74c55adfc42d service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:38.580581 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe807d-f925-4924-bd2a-74c55adfc42d service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:38.584390 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe807d-f925-4924-bd2a-74c55adfc42d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:38.584390 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6ffe807d-f925-4924-bd2a-74c55adfc42d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:38.633305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 902/1808] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:38.642468 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5914543-5325-4176-b024-bb62a543ed70 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:38.643527 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5914543-5325-4176-b024-bb62a543ed70 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:38.644280 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5914543-5325-4176-b024-bb62a543ed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:38.662844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe807d-f925-4924-bd2a-74c55adfc42d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:38.664620 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe807d-f925-4924-bd2a-74c55adfc42d service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:38.676250 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 907/1809] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:38.677346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe807d-f925-4924-bd2a-74c55adfc42d service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:38.678761 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6ffe807d-f925-4924-bd2a-74c55adfc42d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:38.683635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d5914543-5325-4176-b024-bb62a543ed70 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:38.687539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d5914543-5325-4176-b024-bb62a543ed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:38.782809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe807d-f925-4924-bd2a-74c55adfc42d service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:38.797508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf6347-ca5e-44b0-9bdc-189e325a7376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:38.797508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf6347-ca5e-44b0-9bdc-189e325a7376 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:38.797508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf6347-ca5e-44b0-9bdc-189e325a7376 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:38.797508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf6347-ca5e-44b0-9bdc-189e325a7376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:38.798055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 903/1810] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:38.798130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5baf6347-ca5e-44b0-9bdc-189e325a7376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:38.806827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df019203-060f-491a-a40f-617d3cbb0053 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:38.806827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df019203-060f-491a-a40f-617d3cbb0053 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:38.806827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df019203-060f-491a-a40f-617d3cbb0053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:38.819577 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf6347-ca5e-44b0-9bdc-189e325a7376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:38.821188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf6347-ca5e-44b0-9bdc-189e325a7376 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:38.831321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-df019203-060f-491a-a40f-617d3cbb0053 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:38.831321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-df019203-060f-491a-a40f-617d3cbb0053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:38.832862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 908/1811] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:38.833758 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf6347-ca5e-44b0-9bdc-189e325a7376 service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:38.835252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5baf6347-ca5e-44b0-9bdc-189e325a7376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:38.841029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 904/1812] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:38.845237 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df019203-060f-491a-a40f-617d3cbb0053 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:38.850849 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf6347-ca5e-44b0-9bdc-189e325a7376 service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:38.857830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df019203-060f-491a-a40f-617d3cbb0053 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:38.859550 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a135fe-c026-4b29-abbd-0d07112803d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:38.865777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a135fe-c026-4b29-abbd-0d07112803d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:38.865777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a135fe-c026-4b29-abbd-0d07112803d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:38.865777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a135fe-c026-4b29-abbd-0d07112803d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:38.865777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-29a135fe-c026-4b29-abbd-0d07112803d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:38.866092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187738f-dd56-4bc7-a08a-0e5fa1d7c7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:38.866092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187738f-dd56-4bc7-a08a-0e5fa1d7c7ba admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:38.866092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187738f-dd56-4bc7-a08a-0e5fa1d7c7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:38.866092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187738f-dd56-4bc7-a08a-0e5fa1d7c7ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:38.866351 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187738f-dd56-4bc7-a08a-0e5fa1d7c7ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:43:38.866417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187738f-dd56-4bc7-a08a-0e5fa1d7c7ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:38.868164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187738f-dd56-4bc7-a08a-0e5fa1d7c7ba admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:38.886765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 905/1813] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:43:38.891015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187738f-dd56-4bc7-a08a-0e5fa1d7c7ba admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:38.898972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187738f-dd56-4bc7-a08a-0e5fa1d7c7ba admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:38.905857 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d91fd6-beaf-4ef3-bbdd-7d81a5f33bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:38.911931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91fd6-beaf-4ef3-bbdd-7d81a5f33bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:38.911931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91fd6-beaf-4ef3-bbdd-7d81a5f33bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:38.911931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91fd6-beaf-4ef3-bbdd-7d81a5f33bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:38.911931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d91fd6-beaf-4ef3-bbdd-7d81a5f33bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:38.913042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d91fd6-beaf-4ef3-bbdd-7d81a5f33bc4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:38.967040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a135fe-c026-4b29-abbd-0d07112803d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:38.969155 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a135fe-c026-4b29-abbd-0d07112803d6 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:38.982129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 909/1814] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:39.019627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a135fe-c026-4b29-abbd-0d07112803d6 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:39.029365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 906/1815] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:38 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:39.034260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a135fe-c026-4b29-abbd-0d07112803d6 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:39.136431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00c4b8-baf8-40f3-a59d-49b282ba7002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:39.137057 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00c4b8-baf8-40f3-a59d-49b282ba7002 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:39.137375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00c4b8-baf8-40f3-a59d-49b282ba7002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:39.137658 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00c4b8-baf8-40f3-a59d-49b282ba7002 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:39.139188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00c4b8-baf8-40f3-a59d-49b282ba7002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:39.141421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00c4b8-baf8-40f3-a59d-49b282ba7002 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:39.244191 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d91fd6-beaf-4ef3-bbdd-7d81a5f33bc4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:39.245434 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 910/1816] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:39 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:39.256183 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d91fd6-beaf-4ef3-bbdd-7d81a5f33bc4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:39.281391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00c4b8-baf8-40f3-a59d-49b282ba7002 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:39.283510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1b00c4b8-baf8-40f3-a59d-49b282ba7002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:39.295702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebf9a0-1bd3-460c-933e-826398550fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:39.296588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebf9a0-1bd3-460c-933e-826398550fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:39.298362 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebf9a0-1bd3-460c-933e-826398550fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:39.298910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebf9a0-1bd3-460c-933e-826398550fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:39.304989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebf9a0-1bd3-460c-933e-826398550fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:39.305423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00c4b8-baf8-40f3-a59d-49b282ba7002 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:39.305688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebf9a0-1bd3-460c-933e-826398550fe0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:39.314519 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667670c-5a86-4611-aa7e-5fa166660c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:39.315109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667670c-5a86-4611-aa7e-5fa166660c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:39.315464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667670c-5a86-4611-aa7e-5fa166660c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:39.315668 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667670c-5a86-4611-aa7e-5fa166660c59 admin admin] PATH_INFO: `/v3/projects/581b444ef71642ee98a3124377ad3ca1` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:39.320282 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667670c-5a86-4611-aa7e-5fa166660c59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=581b444ef71642ee98a3124377ad3ca1)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:39.322973 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667670c-5a86-4611-aa7e-5fa166660c59 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:39.324896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 907/1817] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:43:39.339349 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebf9a0-1bd3-460c-933e-826398550fe0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:39.357549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebf9a0-1bd3-460c-933e-826398550fe0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:39.363819 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0835a-642b-4816-a8fe-b12f6fc75110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:39.364791 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0835a-642b-4816-a8fe-b12f6fc75110 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:39.365478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0835a-642b-4816-a8fe-b12f6fc75110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:39.365954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0835a-642b-4816-a8fe-b12f6fc75110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:39.367889 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0835a-642b-4816-a8fe-b12f6fc75110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:39.369962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0835a-642b-4816-a8fe-b12f6fc75110 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:39.412244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 908/1818] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:39.413415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0835a-642b-4816-a8fe-b12f6fc75110 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:39.431554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0835a-642b-4816-a8fe-b12f6fc75110 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:39.450234 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7ac7-a3a2-452d-a6e7-ba7eff4c5d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:39.450234 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7ac7-a3a2-452d-a6e7-ba7eff4c5d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:39.450234 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7ac7-a3a2-452d-a6e7-ba7eff4c5d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:39.450234 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7ac7-a3a2-452d-a6e7-ba7eff4c5d40 admin admin] PATH_INFO: `/v3/projects/316831c42cae4ad9b12ee34962b32fe8/users/b1af3769663f4d1eb27a579b08822fb6/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:39.462421 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e7ac7-a3a2-452d-a6e7-ba7eff4c5d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=316831c42cae4ad9b12ee34962b32fe8, user_id=b1af3769663f4d1eb27a579b08822fb6, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:39.465374 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e7ac7-a3a2-452d-a6e7-ba7eff4c5d40 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:39.474898 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c667670c-5a86-4611-aa7e-5fa166660c59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581b444ef71642ee98a3124377ad3ca1', 'request_id': 'req-c667670c-5a86-4611-aa7e-5fa166660c59'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:39.540008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 909/1819] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:39 2022] PUT /identity/v3/projects/316831c42cae4ad9b12ee34962b32fe8/users/b1af3769663f4d1eb27a579b08822fb6/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:39.551966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9d7b-5721-458c-a847-8afd3250cdcf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:39.552252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9d7b-5721-458c-a847-8afd3250cdcf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:39.552524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9d7b-5721-458c-a847-8afd3250cdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:39.557954 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c667670c-5a86-4611-aa7e-5fa166660c59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581b444ef71642ee98a3124377ad3ca1', 'request_id': 'req-c667670c-5a86-4611-aa7e-5fa166660c59'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:39.566240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c667670c-5a86-4611-aa7e-5fa166660c59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581b444ef71642ee98a3124377ad3ca1', 'request_id': 'req-c667670c-5a86-4611-aa7e-5fa166660c59'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:39.582907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c667670c-5a86-4611-aa7e-5fa166660c59 admin admin] The token cache is being invalidate because project 581b444ef71642ee98a3124377ad3ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:39.583497 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c667670c-5a86-4611-aa7e-5fa166660c59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:39.584365 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c667670c-5a86-4611-aa7e-5fa166660c59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:39.585868 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ec0a9d7b-5721-458c-a847-8afd3250cdcf None None] MFA Rules not processed for user `b1af3769663f4d1eb27a579b08822fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:39.586680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 911/1820] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:39 2022] DELETE /identity/v3/projects/581b444ef71642ee98a3124377ad3ca1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:39.587689 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ec0a9d7b-5721-458c-a847-8afd3250cdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:39.592248 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9eb61-af08-4e4a-8d9f-087d58710b76 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:39.592606 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9eb61-af08-4e4a-8d9f-087d58710b76 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:39.592887 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9eb61-af08-4e4a-8d9f-087d58710b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:39.616571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-0fe9eb61-af08-4e4a-8d9f-087d58710b76 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:39.618493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0fe9eb61-af08-4e4a-8d9f-087d58710b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:39.635093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:39.661763 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 910/1821] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:43:39.666551 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a9d7b-5721-458c-a847-8afd3250cdcf None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:39.669278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ec0a9d7b-5721-458c-a847-8afd3250cdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:39.712704 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 912/1822] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:43:39.723117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63192553-4e45-4dcb-838c-872c7db3cbb5 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:39.727807 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63192553-4e45-4dcb-838c-872c7db3cbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:39.727807 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63192553-4e45-4dcb-838c-872c7db3cbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:39.744255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-63192553-4e45-4dcb-838c-872c7db3cbb5 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:39.746649 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-63192553-4e45-4dcb-838c-872c7db3cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:39.761077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a9d7b-5721-458c-a847-8afd3250cdcf None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:39.770095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 913/1823] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:43:39.773009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3af80-bc4c-4357-8473-c758af23e78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:39.774168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3af80-bc4c-4357-8473-c758af23e78a admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:39.774591 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3af80-bc4c-4357-8473-c758af23e78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:39.775060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3af80-bc4c-4357-8473-c758af23e78a admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:39.779567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3af80-bc4c-4357-8473-c758af23e78a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:39.780007 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3af80-bc4c-4357-8473-c758af23e78a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:39.787259 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63192553-4e45-4dcb-838c-872c7db3cbb5 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:39.815026 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63192553-4e45-4dcb-838c-872c7db3cbb5 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:39.817910 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88863f29-09dd-4963-96d2-180878821ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:39.818648 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88863f29-09dd-4963-96d2-180878821ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:39.819646 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88863f29-09dd-4963-96d2-180878821ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:39.819935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88863f29-09dd-4963-96d2-180878821ba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:39.820870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88863f29-09dd-4963-96d2-180878821ba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:43:39.821174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88863f29-09dd-4963-96d2-180878821ba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:39.824494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88863f29-09dd-4963-96d2-180878821ba4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:39.843619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 914/1824] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:43:39.850264 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88863f29-09dd-4963-96d2-180878821ba4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:39.861271 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88863f29-09dd-4963-96d2-180878821ba4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:39.866547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c249d-5286-4e5f-85e1-574c5fa03ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:39.867989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c249d-5286-4e5f-85e1-574c5fa03ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:39.867989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c249d-5286-4e5f-85e1-574c5fa03ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:39.867989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c249d-5286-4e5f-85e1-574c5fa03ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:39.869002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c249d-5286-4e5f-85e1-574c5fa03ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:39.871884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c249d-5286-4e5f-85e1-574c5fa03ca5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:39.890468 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 911/1825] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:39 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:43:39.894209 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3af80-bc4c-4357-8473-c758af23e78a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:39.968794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3af80-bc4c-4357-8473-c758af23e78a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:39.973979 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12a3ad-6279-453c-bf86-96878d9c2f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:39.974598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12a3ad-6279-453c-bf86-96878d9c2f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:39.974872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12a3ad-6279-453c-bf86-96878d9c2f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:39.975142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12a3ad-6279-453c-bf86-96878d9c2f38 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:39.975829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12a3ad-6279-453c-bf86-96878d9c2f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:39.978084 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12a3ad-6279-453c-bf86-96878d9c2f38 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:39.991614 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 915/1826] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:39 2022] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:39.996773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c249d-5286-4e5f-85e1-574c5fa03ca5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:40.074338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c249d-5286-4e5f-85e1-574c5fa03ca5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:40.079345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c609392-c562-4ebb-8bdd-9883c278276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:40.079957 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c609392-c562-4ebb-8bdd-9883c278276b admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.080621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c609392-c562-4ebb-8bdd-9883c278276b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.080621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c609392-c562-4ebb-8bdd-9883c278276b admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.081120 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c609392-c562-4ebb-8bdd-9883c278276b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:40.083058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c609392-c562-4ebb-8bdd-9883c278276b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:40.095046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 912/1827] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:39 2022] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:40.096955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19cdfb-dad5-4656-8eb7-cbb96ce8c253 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.097613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19cdfb-dad5-4656-8eb7-cbb96ce8c253 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.098114 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19cdfb-dad5-4656-8eb7-cbb96ce8c253 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.099888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 913/1828] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 31 04:43:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:43:40.100699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19cdfb-dad5-4656-8eb7-cbb96ce8c253 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:40.115035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19cdfb-dad5-4656-8eb7-cbb96ce8c253 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:40.120184 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dfa2f-95b1-49b5-874b-aa8c23424544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:40.120803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dfa2f-95b1-49b5-874b-aa8c23424544 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.121085 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dfa2f-95b1-49b5-874b-aa8c23424544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.121400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dfa2f-95b1-49b5-874b-aa8c23424544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.122053 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dfa2f-95b1-49b5-874b-aa8c23424544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:40.123751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dfa2f-95b1-49b5-874b-aa8c23424544 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:40.142013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 914/1829] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:40.142013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871dc61-f671-44ef-a60a-996a50de4836 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.142013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871dc61-f671-44ef-a60a-996a50de4836 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.142013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871dc61-f671-44ef-a60a-996a50de4836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.166746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8871dc61-f671-44ef-a60a-996a50de4836 None None] MFA Rules not processed for user `a4ad954bbb7749ee8861e8da98619006`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:40.168195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8871dc61-f671-44ef-a60a-996a50de4836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:40.211429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 916/1830] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:39 2022] POST /identity/v3/users => generated 284 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:40.211429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c609392-c562-4ebb-8bdd-9883c278276b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:40.241738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c609392-c562-4ebb-8bdd-9883c278276b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:40.253366 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6e80f-846d-4118-8eae-700a5dbc448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:40.261410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6e80f-846d-4118-8eae-700a5dbc448c admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.261410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6e80f-846d-4118-8eae-700a5dbc448c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.261410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6e80f-846d-4118-8eae-700a5dbc448c admin admin] PATH_INFO: `/v3/projects/d16f17a1216d4ba3ba744cac8a7e86b2/users/63f1d96131804b38b0936403348a5167/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.274657 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 915/1831] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 31 04:43:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:40.275706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871dc61-f671-44ef-a60a-996a50de4836 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:40.275922 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6e80f-846d-4118-8eae-700a5dbc448c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16f17a1216d4ba3ba744cac8a7e86b2, user_id=63f1d96131804b38b0936403348a5167, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:40.279401 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6e80f-846d-4118-8eae-700a5dbc448c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:40.288174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871dc61-f671-44ef-a60a-996a50de4836 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:40.294035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26116ba8-9627-4f8f-bf83-adcf70b5c974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:40.294654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26116ba8-9627-4f8f-bf83-adcf70b5c974 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.294931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26116ba8-9627-4f8f-bf83-adcf70b5c974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.295245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26116ba8-9627-4f8f-bf83-adcf70b5c974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.296048 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26116ba8-9627-4f8f-bf83-adcf70b5c974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:40.297692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26116ba8-9627-4f8f-bf83-adcf70b5c974 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:40.309514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 916/1832] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:40.310806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74b5b-f896-4391-a80b-f53f63bc8d82 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.311092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74b5b-f896-4391-a80b-f53f63bc8d82 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.311359 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74b5b-f896-4391-a80b-f53f63bc8d82 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.312724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 917/1833] 10.222.0.39 () {54 vars in 961 bytes} [Wed Aug 31 04:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:43:40.313557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e74b5b-f896-4391-a80b-f53f63bc8d82 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:40.326420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e74b5b-f896-4391-a80b-f53f63bc8d82 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:40.331629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80f409-16e1-45b0-897f-d3485c63bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:40.332269 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80f409-16e1-45b0-897f-d3485c63bb83 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.332550 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80f409-16e1-45b0-897f-d3485c63bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.335929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80f409-16e1-45b0-897f-d3485c63bb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.335929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80f409-16e1-45b0-897f-d3485c63bb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:40.335929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80f409-16e1-45b0-897f-d3485c63bb83 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:40.349743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 918/1834] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:40.349743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f185964-7064-4a47-ba47-5f4478b3df4e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.349743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f185964-7064-4a47-ba47-5f4478b3df4e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.349743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f185964-7064-4a47-ba47-5f4478b3df4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.359166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:40.370963 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0f185964-7064-4a47-ba47-5f4478b3df4e None None] MFA Rules not processed for user `a4ad954bbb7749ee8861e8da98619006`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:40.372314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0f185964-7064-4a47-ba47-5f4478b3df4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:40.381081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 919/1835] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Aug 31 04:43:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:40.381767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f185964-7064-4a47-ba47-5f4478b3df4e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:40.390860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 917/1836] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:40 2022] PUT /identity/v3/projects/d16f17a1216d4ba3ba744cac8a7e86b2/users/63f1d96131804b38b0936403348a5167/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:40.391802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6e80f-846d-4118-8eae-700a5dbc448c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:40.393152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f185964-7064-4a47-ba47-5f4478b3df4e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:40.490899 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8002485-76dc-4411-aea6-b7200b09b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:40.491986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002485-76dc-4411-aea6-b7200b09b303 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.493027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002485-76dc-4411-aea6-b7200b09b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.493473 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002485-76dc-4411-aea6-b7200b09b303 admin admin] PATH_INFO: `/v3/projects/8ad881a216c8441cb105240636fbd365/users/604fb507e0144a5aa04bfc2855891cd7/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.495720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6e80f-846d-4118-8eae-700a5dbc448c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:40.503907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa78405-0461-4304-a431-6dfec06c56b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ad954bbb7749ee8861e8da98619006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:40.504631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa78405-0461-4304-a431-6dfec06c56b3 service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.511352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa78405-0461-4304-a431-6dfec06c56b3 service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.511352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa78405-0461-4304-a431-6dfec06c56b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.515917 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa78405-0461-4304-a431-6dfec06c56b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:40.517572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa78405-0461-4304-a431-6dfec06c56b3 service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:40.528781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8002485-76dc-4411-aea6-b7200b09b303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad881a216c8441cb105240636fbd365, user_id=604fb507e0144a5aa04bfc2855891cd7, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:40.533372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8002485-76dc-4411-aea6-b7200b09b303 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:40.544384 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 918/1837] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:40.548250 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa78405-0461-4304-a431-6dfec06c56b3 service placement] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:40.565775 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa78405-0461-4304-a431-6dfec06c56b3 service placement] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:40.573021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a031e-c97c-4880-bf69-ef04ae06206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:40.574007 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a031e-c97c-4880-bf69-ef04ae06206a admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.574455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a031e-c97c-4880-bf69-ef04ae06206a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.574820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a031e-c97c-4880-bf69-ef04ae06206a admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.575594 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a031e-c97c-4880-bf69-ef04ae06206a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:40.577613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a031e-c97c-4880-bf69-ef04ae06206a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:40.597241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 919/1838] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:40.602926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a031e-c97c-4880-bf69-ef04ae06206a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:40.627337 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a031e-c97c-4880-bf69-ef04ae06206a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:40.631885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 920/1839] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:40 2022] PUT /identity/v3/projects/8ad881a216c8441cb105240636fbd365/users/604fb507e0144a5aa04bfc2855891cd7/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:40.642504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07d4ac-fa79-425c-8dad-23c804fa5b64 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.642801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07d4ac-fa79-425c-8dad-23c804fa5b64 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.643077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07d4ac-fa79-425c-8dad-23c804fa5b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.691859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4d07d4ac-fa79-425c-8dad-23c804fa5b64 None None] MFA Rules not processed for user `604fb507e0144a5aa04bfc2855891cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:40.693090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4d07d4ac-fa79-425c-8dad-23c804fa5b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:40.767502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d261367-8c48-48f0-abaf-7ff85c705972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:40.768291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261367-8c48-48f0-abaf-7ff85c705972 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.768686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261367-8c48-48f0-abaf-7ff85c705972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.769058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261367-8c48-48f0-abaf-7ff85c705972 admin admin] PATH_INFO: `/v3/projects/d16f17a1216d4ba3ba744cac8a7e86b2/users/63f1d96131804b38b0936403348a5167/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.771382 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d261367-8c48-48f0-abaf-7ff85c705972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16f17a1216d4ba3ba744cac8a7e86b2, user_id=63f1d96131804b38b0936403348a5167, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:40.775552 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d261367-8c48-48f0-abaf-7ff85c705972 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:40.792767 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 920/1840] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:40 2022] PUT /identity/v3/projects/d16f17a1216d4ba3ba744cac8a7e86b2/users/63f1d96131804b38b0936403348a5167/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:40.802925 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f60503-befc-4fc0-87dc-cdb61bef63c9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:40.803211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f60503-befc-4fc0-87dc-cdb61bef63c9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:40.803441 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f60503-befc-4fc0-87dc-cdb61bef63c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:40.865104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 921/1841] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:43:40.866488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07d4ac-fa79-425c-8dad-23c804fa5b64 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:40.883904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-41f60503-befc-4fc0-87dc-cdb61bef63c9 None None] MFA Rules not processed for user `63f1d96131804b38b0936403348a5167`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:40.888098 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-41f60503-befc-4fc0-87dc-cdb61bef63c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:40.890909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07d4ac-fa79-425c-8dad-23c804fa5b64 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:41.017539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2c0a4-ac9e-4180-80aa-20fd47e4d483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:41.018339 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2c0a4-ac9e-4180-80aa-20fd47e4d483 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:41.018679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2c0a4-ac9e-4180-80aa-20fd47e4d483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:41.019035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2c0a4-ac9e-4180-80aa-20fd47e4d483 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:41.019722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2c0a4-ac9e-4180-80aa-20fd47e4d483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:41.021875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2c0a4-ac9e-4180-80aa-20fd47e4d483 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:41.032314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 921/1842] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:43:41.047770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f60503-befc-4fc0-87dc-cdb61bef63c9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:41.049441 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-41f60503-befc-4fc0-87dc-cdb61bef63c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:41.145298 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 922/1843] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:40 2022] POST /identity/v3/projects => generated 367 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:41.157868 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2c0a4-ac9e-4180-80aa-20fd47e4d483 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:41.196413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f60503-befc-4fc0-87dc-cdb61bef63c9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:41.299601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1f390-15be-42f8-9394-349a3636a7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:41.300491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1f390-15be-42f8-9394-349a3636a7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:41.300883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1f390-15be-42f8-9394-349a3636a7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:41.301231 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1f390-15be-42f8-9394-349a3636a7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:41.318228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2c0a4-ac9e-4180-80aa-20fd47e4d483 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:41.335799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a28e25-2d7d-46c2-baab-127202cf7e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:41.337054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a28e25-2d7d-46c2-baab-127202cf7e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:41.337361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a28e25-2d7d-46c2-baab-127202cf7e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:41.343810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a28e25-2d7d-46c2-baab-127202cf7e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:41.344759 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a28e25-2d7d-46c2-baab-127202cf7e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:41.351294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a28e25-2d7d-46c2-baab-127202cf7e67 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:41.404596 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:41.457313 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 923/1844] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:41 2022] POST /identity/v3/users => generated 290 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:41.461735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a28e25-2d7d-46c2-baab-127202cf7e67 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:41.485248 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1f390-15be-42f8-9394-349a3636a7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:41.486666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1f390-15be-42f8-9394-349a3636a7f3 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:41.512766 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a28e25-2d7d-46c2-baab-127202cf7e67 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:41.524399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf66b4e-312d-472b-aea1-b28422a49a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:41.525417 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 922/1845] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:43:41.526407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66b4e-312d-472b-aea1-b28422a49a78 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:41.527682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66b4e-312d-472b-aea1-b28422a49a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:41.529603 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66b4e-312d-472b-aea1-b28422a49a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:41.530389 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf66b4e-312d-472b-aea1-b28422a49a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:41.532400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf66b4e-312d-472b-aea1-b28422a49a78 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:41.561260 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 924/1846] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:41.562227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1f390-15be-42f8-9394-349a3636a7f3 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:41.583591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1f390-15be-42f8-9394-349a3636a7f3 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:41.590424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaff18b-5484-475b-9bf6-21a3bb01c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:41.591487 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaff18b-5484-475b-9bf6-21a3bb01c8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:41.592739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaff18b-5484-475b-9bf6-21a3bb01c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:41.593610 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaff18b-5484-475b-9bf6-21a3bb01c8b9 admin admin] PATH_INFO: `/v3/projects/2f0742e7980a44c581f6786094f717f1/users/2ada924bdeec4632b2a7a65e18f256a3/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:41.616203 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaff18b-5484-475b-9bf6-21a3bb01c8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0742e7980a44c581f6786094f717f1, user_id=2ada924bdeec4632b2a7a65e18f256a3, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:41.621891 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaff18b-5484-475b-9bf6-21a3bb01c8b9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:41.732087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 923/1847] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:41 2022] PUT /identity/v3/projects/2f0742e7980a44c581f6786094f717f1/users/2ada924bdeec4632b2a7a65e18f256a3/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:41.732894 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf66b4e-312d-472b-aea1-b28422a49a78 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:41.742874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf66b4e-312d-472b-aea1-b28422a49a78 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:41.799637 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fcc48-327f-4f49-996c-b224e7d92a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:41.800428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fcc48-327f-4f49-996c-b224e7d92a74 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:41.800716 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fcc48-327f-4f49-996c-b224e7d92a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:41.800994 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fcc48-327f-4f49-996c-b224e7d92a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:41.801674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fcc48-327f-4f49-996c-b224e7d92a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:41.803308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fcc48-327f-4f49-996c-b224e7d92a74 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:41.817036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 925/1848] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:43:41.818315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaff18b-5484-475b-9bf6-21a3bb01c8b9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:41.829466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaff18b-5484-475b-9bf6-21a3bb01c8b9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:41.834200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558a754-9e51-47cb-a7f4-2b451dd069d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:41.834868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558a754-9e51-47cb-a7f4-2b451dd069d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:41.835151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558a754-9e51-47cb-a7f4-2b451dd069d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:41.837595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558a754-9e51-47cb-a7f4-2b451dd069d4 admin admin] PATH_INFO: `/v3/projects/2f0742e7980a44c581f6786094f717f1/users/2ada924bdeec4632b2a7a65e18f256a3/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:41.840635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558a754-9e51-47cb-a7f4-2b451dd069d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0742e7980a44c581f6786094f717f1, user_id=2ada924bdeec4632b2a7a65e18f256a3, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:41.849819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558a754-9e51-47cb-a7f4-2b451dd069d4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:41.849961 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fcc48-327f-4f49-996c-b224e7d92a74 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:41.852168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f98fcc48-327f-4f49-996c-b224e7d92a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:41.865388 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 924/1849] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:41 2022] PUT /identity/v3/projects/2f0742e7980a44c581f6786094f717f1/users/2ada924bdeec4632b2a7a65e18f256a3/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:41.875950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fcc48-327f-4f49-996c-b224e7d92a74 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:41.877834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51240b27-fe84-49f7-bcd4-a80ecb0f35c1 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:41.879390 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51240b27-fe84-49f7-bcd4-a80ecb0f35c1 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:41.879593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51240b27-fe84-49f7-bcd4-a80ecb0f35c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:41.912212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-51240b27-fe84-49f7-bcd4-a80ecb0f35c1 None None] MFA Rules not processed for user `2ada924bdeec4632b2a7a65e18f256a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:41.915965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-51240b27-fe84-49f7-bcd4-a80ecb0f35c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:41.965760 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69e4a6-8c0e-45b7-95ba-b7cff780e3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:41.966450 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69e4a6-8c0e-45b7-95ba-b7cff780e3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:41.966776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69e4a6-8c0e-45b7-95ba-b7cff780e3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:41.967043 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69e4a6-8c0e-45b7-95ba-b7cff780e3be admin admin] PATH_INFO: `/v3/users/1c21bd0c7e7e4e69bfb47883af123126` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:41.968379 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69e4a6-8c0e-45b7-95ba-b7cff780e3be admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c21bd0c7e7e4e69bfb47883af123126)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:41.972957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69e4a6-8c0e-45b7-95ba-b7cff780e3be admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:42.029004 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 925/1850] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:42.040278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51240b27-fe84-49f7-bcd4-a80ecb0f35c1 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:42.041652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-51240b27-fe84-49f7-bcd4-a80ecb0f35c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:42.109608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51240b27-fe84-49f7-bcd4-a80ecb0f35c1 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:42.114710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f244a02-9fc6-4d38-bc3b-8a5576f825b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:42.114940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244a02-9fc6-4d38-bc3b-8a5576f825b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:42.115478 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244a02-9fc6-4d38-bc3b-8a5576f825b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:42.115730 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f244a02-9fc6-4d38-bc3b-8a5576f825b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:42.125591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f244a02-9fc6-4d38-bc3b-8a5576f825b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:42.127144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f244a02-9fc6-4d38-bc3b-8a5576f825b7 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:42.137028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 926/1851] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:43:42.212499 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0e69e4a6-8c0e-45b7-95ba-b7cff780e3be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c21bd0c7e7e4e69bfb47883af123126'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:42.213250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0e69e4a6-8c0e-45b7-95ba-b7cff780e3be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c21bd0c7e7e4e69bfb47883af123126'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:42.225725 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0e69e4a6-8c0e-45b7-95ba-b7cff780e3be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c21bd0c7e7e4e69bfb47883af123126'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:42.232565 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0e69e4a6-8c0e-45b7-95ba-b7cff780e3be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c21bd0c7e7e4e69bfb47883af123126'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:42.233306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-0e69e4a6-8c0e-45b7-95ba-b7cff780e3be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c21bd0c7e7e4e69bfb47883af123126'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:42.257077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f244a02-9fc6-4d38-bc3b-8a5576f825b7 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:42.268399 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f244a02-9fc6-4d38-bc3b-8a5576f825b7 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:42.272469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2f9a1-6cad-436a-b2f5-1b8c8cadf604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:42.273076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2f9a1-6cad-436a-b2f5-1b8c8cadf604 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:42.273384 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2f9a1-6cad-436a-b2f5-1b8c8cadf604 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:42.273661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2f9a1-6cad-436a-b2f5-1b8c8cadf604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:42.275574 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-18a2f9a1-6cad-436a-b2f5-1b8c8cadf604 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:42.340932 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2f9a1-6cad-436a-b2f5-1b8c8cadf604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:42.342479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2f9a1-6cad-436a-b2f5-1b8c8cadf604 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:42.355264 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 927/1852] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:42.357637 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 926/1853] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:41 2022] DELETE /identity/v3/users/1c21bd0c7e7e4e69bfb47883af123126 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:42.545358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2f9a1-6cad-436a-b2f5-1b8c8cadf604 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:42.547292 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-18a2f9a1-6cad-436a-b2f5-1b8c8cadf604 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:42.575794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2f9a1-6cad-436a-b2f5-1b8c8cadf604 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:42.648533 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b4145-700d-49a0-97e2-e87ac7f33ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:42.649518 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b4145-700d-49a0-97e2-e87ac7f33ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:42.649670 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b4145-700d-49a0-97e2-e87ac7f33ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:42.650036 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b4145-700d-49a0-97e2-e87ac7f33ad4 admin admin] PATH_INFO: `/v3/users/33cb9aa59d2e4fd2b638154a426acf61` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:42.665702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b4145-700d-49a0-97e2-e87ac7f33ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33cb9aa59d2e4fd2b638154a426acf61)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:42.672505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b4145-700d-49a0-97e2-e87ac7f33ad4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:42.744793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:42.836438 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69e4a6-8c0e-45b7-95ba-b7cff780e3be admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:42.838488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0e69e4a6-8c0e-45b7-95ba-b7cff780e3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:42.869724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69e4a6-8c0e-45b7-95ba-b7cff780e3be admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:42.875351 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:42.876243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:42.876378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:42.876549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] PATH_INFO: `/v3/projects/1c94773b7b7b4d42a49f433b498443b2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:42.877704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c94773b7b7b4d42a49f433b498443b2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:42.879689 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:42.926724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-934b4145-700d-49a0-97e2-e87ac7f33ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33cb9aa59d2e4fd2b638154a426acf61'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:42.954128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-934b4145-700d-49a0-97e2-e87ac7f33ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33cb9aa59d2e4fd2b638154a426acf61'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:43.013948 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c94773b7b7b4d42a49f433b498443b2', 'request_id': 'req-6d3d2b8e-8acb-4b35-ae39-637051bf491f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:43.023652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-934b4145-700d-49a0-97e2-e87ac7f33ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33cb9aa59d2e4fd2b638154a426acf61'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:43.036724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-934b4145-700d-49a0-97e2-e87ac7f33ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33cb9aa59d2e4fd2b638154a426acf61'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:43.037517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-934b4145-700d-49a0-97e2-e87ac7f33ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33cb9aa59d2e4fd2b638154a426acf61'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:43.045045 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 928/1854] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:42 2022] DELETE /identity/v3/users/33cb9aa59d2e4fd2b638154a426acf61 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:43.049147 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195f781-ab3f-4c78-8e10-219963aaea92 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:43.049571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195f781-ab3f-4c78-8e10-219963aaea92 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:43.049855 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195f781-ab3f-4c78-8e10-219963aaea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:43.083669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-0195f781-ab3f-4c78-8e10-219963aaea92 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:43.093238 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0195f781-ab3f-4c78-8e10-219963aaea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:43.165975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 929/1855] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:43.165975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5dc2f2-c54d-402f-a3bb-25851577fde7 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:43.165975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5dc2f2-c54d-402f-a3bb-25851577fde7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:43.165975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5dc2f2-c54d-402f-a3bb-25851577fde7 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:43.166754 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 930/1856] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 31 04:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:43:43.173387 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c94773b7b7b4d42a49f433b498443b2', 'request_id': 'req-6d3d2b8e-8acb-4b35-ae39-637051bf491f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:43.177321 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7e1ea-abc9-4cac-a228-97600d957a34 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:43.177991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7e1ea-abc9-4cac-a228-97600d957a34 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:43.178091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7e1ea-abc9-4cac-a228-97600d957a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:43.181672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c94773b7b7b4d42a49f433b498443b2', 'request_id': 'req-6d3d2b8e-8acb-4b35-ae39-637051bf491f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:43.193731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] The token cache is being invalidate because project 1c94773b7b7b4d42a49f433b498443b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:43.194022 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:43.199274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6fa7e1ea-abc9-4cac-a228-97600d957a34 None None] MFA Rules not processed for user `4877b72a6cea410dbb31a35c7acbd5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:43.200604 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6fa7e1ea-abc9-4cac-a228-97600d957a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:43.201916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:43.216251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 927/1857] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:42 2022] DELETE /identity/v3/projects/1c94773b7b7b4d42a49f433b498443b2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:43.218401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:43.221780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:43.285299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 931/1858] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 31 04:43:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:43.286150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7e1ea-abc9-4cac-a228-97600d957a34 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:43.287582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6fa7e1ea-abc9-4cac-a228-97600d957a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:43.306042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7e1ea-abc9-4cac-a228-97600d957a34 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:43.306542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d2b8e-8acb-4b35-ae39-637051bf491f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:43.311364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a97f5-451c-4ee6-b08b-ce711396f27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:43.312137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a97f5-451c-4ee6-b08b-ce711396f27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:43.312357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a97f5-451c-4ee6-b08b-ce711396f27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:43.312635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a97f5-451c-4ee6-b08b-ce711396f27a admin admin] PATH_INFO: `/v3/users/70af4657e7f4430e8b172ff01bc3971f` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:43.330061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a97f5-451c-4ee6-b08b-ce711396f27a admin admin] RBAC: Authorizing `identity:delete_user(user_id=70af4657e7f4430e8b172ff01bc3971f)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:43.330061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a97f5-451c-4ee6-b08b-ce711396f27a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:43.388866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51402a98-09b7-444b-9efc-96f2e5d0e41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:43.389612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51402a98-09b7-444b-9efc-96f2e5d0e41c service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:43.390141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51402a98-09b7-444b-9efc-96f2e5d0e41c service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:43.390570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51402a98-09b7-444b-9efc-96f2e5d0e41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:43.392677 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-51402a98-09b7-444b-9efc-96f2e5d0e41c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:43.408475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51402a98-09b7-444b-9efc-96f2e5d0e41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:43.411650 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51402a98-09b7-444b-9efc-96f2e5d0e41c service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:43.421840 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 928/1859] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:43.422952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51402a98-09b7-444b-9efc-96f2e5d0e41c service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:43.424314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-51402a98-09b7-444b-9efc-96f2e5d0e41c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:43.441063 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51402a98-09b7-444b-9efc-96f2e5d0e41c service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:43.448255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0745cc-96e2-4277-9203-d53edf8cb4d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:43.449326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0745cc-96e2-4277-9203-d53edf8cb4d8 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:43.449976 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0745cc-96e2-4277-9203-d53edf8cb4d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:43.450255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0745cc-96e2-4277-9203-d53edf8cb4d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:43.460474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0745cc-96e2-4277-9203-d53edf8cb4d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:43.462125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0745cc-96e2-4277-9203-d53edf8cb4d8 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:43.474815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 929/1860] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:43.562221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2f4a97f5-451c-4ee6-b08b-ce711396f27a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70af4657e7f4430e8b172ff01bc3971f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:43.577689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2f4a97f5-451c-4ee6-b08b-ce711396f27a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70af4657e7f4430e8b172ff01bc3971f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:43.686488 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2f4a97f5-451c-4ee6-b08b-ce711396f27a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70af4657e7f4430e8b172ff01bc3971f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:43.693950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2f4a97f5-451c-4ee6-b08b-ce711396f27a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70af4657e7f4430e8b172ff01bc3971f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:43.694575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2f4a97f5-451c-4ee6-b08b-ce711396f27a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70af4657e7f4430e8b172ff01bc3971f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:43.701011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 932/1861] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:43 2022] DELETE /identity/v3/users/70af4657e7f4430e8b172ff01bc3971f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:43.995687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0745cc-96e2-4277-9203-d53edf8cb4d8 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:44.005319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3e0745cc-96e2-4277-9203-d53edf8cb4d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:44.032587 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0745cc-96e2-4277-9203-d53edf8cb4d8 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:44.082954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:44.111858 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:44.112444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:44.112738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:44.113048 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] PATH_INFO: `/v3/projects/1b45a6419be742af9dcb4ffc738fd781` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:44.114256 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b45a6419be742af9dcb4ffc738fd781)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:44.116376 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a97f5-451c-4ee6-b08b-ce711396f27a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:44.116489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:44.118024 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2f4a97f5-451c-4ee6-b08b-ce711396f27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:44.146780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a97f5-451c-4ee6-b08b-ce711396f27a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:44.153628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaa505-62ab-4a6b-b8d7-5f16118aa400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:44.154278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa505-62ab-4a6b-b8d7-5f16118aa400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:44.154562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa505-62ab-4a6b-b8d7-5f16118aa400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:44.154828 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa505-62ab-4a6b-b8d7-5f16118aa400 admin admin] PATH_INFO: `/v3/projects/851718f7d1fe4744943b965568a89586` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:44.156323 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaa505-62ab-4a6b-b8d7-5f16118aa400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=851718f7d1fe4744943b965568a89586)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:44.159073 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaa505-62ab-4a6b-b8d7-5f16118aa400 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:44.168527 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:44.266969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b45a6419be742af9dcb4ffc738fd781', 'request_id': 'req-131fe274-8bf0-4a0a-918d-e624c580621b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.319978 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-45aaa505-62ab-4a6b-b8d7-5f16118aa400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '851718f7d1fe4744943b965568a89586', 'request_id': 'req-45aaa505-62ab-4a6b-b8d7-5f16118aa400'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.385037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b45a6419be742af9dcb4ffc738fd781', 'request_id': 'req-131fe274-8bf0-4a0a-918d-e624c580621b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.392485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b45a6419be742af9dcb4ffc738fd781', 'request_id': 'req-131fe274-8bf0-4a0a-918d-e624c580621b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.407044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] The token cache is being invalidate because project 1b45a6419be742af9dcb4ffc738fd781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:44.407408 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.408297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.410389 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 930/1862] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:43 2022] DELETE /identity/v3/projects/1b45a6419be742af9dcb4ffc738fd781 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:44.419547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:44.420965 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:44.488231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fe274-8bf0-4a0a-918d-e624c580621b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:44.494780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-45aaa505-62ab-4a6b-b8d7-5f16118aa400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '851718f7d1fe4744943b965568a89586', 'request_id': 'req-45aaa505-62ab-4a6b-b8d7-5f16118aa400'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.503405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-45aaa505-62ab-4a6b-b8d7-5f16118aa400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '851718f7d1fe4744943b965568a89586', 'request_id': 'req-45aaa505-62ab-4a6b-b8d7-5f16118aa400'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.518958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-45aaa505-62ab-4a6b-b8d7-5f16118aa400 admin admin] The token cache is being invalidate because project 851718f7d1fe4744943b965568a89586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:44.519613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-45aaa505-62ab-4a6b-b8d7-5f16118aa400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.520982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-45aaa505-62ab-4a6b-b8d7-5f16118aa400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.525442 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 933/1863] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:44 2022] DELETE /identity/v3/projects/851718f7d1fe4744943b965568a89586 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:44.528974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602485e-3d88-44f2-a9a2-949b52ac54ed None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:44.529306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602485e-3d88-44f2-a9a2-949b52ac54ed None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:44.532098 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602485e-3d88-44f2-a9a2-949b52ac54ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:44.562697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273765e-389e-41d1-a574-d814f9fc2ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:44.563543 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273765e-389e-41d1-a574-d814f9fc2ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:44.563823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273765e-389e-41d1-a574-d814f9fc2ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:44.564098 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273765e-389e-41d1-a574-d814f9fc2ce9 admin admin] PATH_INFO: `/v3/users/3ec0c7884283455fa30eb1f41e1a59ed` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:44.565359 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273765e-389e-41d1-a574-d814f9fc2ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec0c7884283455fa30eb1f41e1a59ed)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:44.567492 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273765e-389e-41d1-a574-d814f9fc2ce9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:44.573895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-0602485e-3d88-44f2-a9a2-949b52ac54ed None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:44.576112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0602485e-3d88-44f2-a9a2-949b52ac54ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:44.587933 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 934/1864] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:44.596289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828c6c5-e9d8-476d-84a5-3962d1dc4a46 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:44.596606 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828c6c5-e9d8-476d-84a5-3962d1dc4a46 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:44.596893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828c6c5-e9d8-476d-84a5-3962d1dc4a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:44.621778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c828c6c5-e9d8-476d-84a5-3962d1dc4a46 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:44.623196 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c828c6c5-e9d8-476d-84a5-3962d1dc4a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:44.634564 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 935/1865] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:44.639501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828c6c5-e9d8-476d-84a5-3962d1dc4a46 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:44.652992 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828c6c5-e9d8-476d-84a5-3962d1dc4a46 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:44.658376 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa04b4d-9b94-4e0d-8e81-f128a3b62ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:44.659192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04b4d-9b94-4e0d-8e81-f128a3b62ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:44.659482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04b4d-9b94-4e0d-8e81-f128a3b62ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:44.659755 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04b4d-9b94-4e0d-8e81-f128a3b62ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:44.660409 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa04b4d-9b94-4e0d-8e81-f128a3b62ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:43:44.660771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa04b4d-9b94-4e0d-8e81-f128a3b62ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:44.662498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa04b4d-9b94-4e0d-8e81-f128a3b62ad8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:44.677970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 936/1866] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:43:44.702521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa04b4d-9b94-4e0d-8e81-f128a3b62ad8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:44.728399 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa04b4d-9b94-4e0d-8e81-f128a3b62ad8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:44.735836 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc2ab8-f0db-4a20-b45f-c863dbdc858b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:44.736901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2ab8-f0db-4a20-b45f-c863dbdc858b admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:44.737482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2ab8-f0db-4a20-b45f-c863dbdc858b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:44.739137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2ab8-f0db-4a20-b45f-c863dbdc858b admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:44.740348 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc2ab8-f0db-4a20-b45f-c863dbdc858b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:44.743051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc2ab8-f0db-4a20-b45f-c863dbdc858b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:44.766983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1273765e-389e-41d1-a574-d814f9fc2ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec0c7884283455fa30eb1f41e1a59ed'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.767988 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1273765e-389e-41d1-a574-d814f9fc2ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec0c7884283455fa30eb1f41e1a59ed'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.787206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1273765e-389e-41d1-a574-d814f9fc2ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec0c7884283455fa30eb1f41e1a59ed'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.796892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1273765e-389e-41d1-a574-d814f9fc2ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec0c7884283455fa30eb1f41e1a59ed'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.797775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1273765e-389e-41d1-a574-d814f9fc2ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec0c7884283455fa30eb1f41e1a59ed'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:44.845228 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 937/1867] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:44 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:44.850613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc2ab8-f0db-4a20-b45f-c863dbdc858b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:44.876463 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cbcc2ab8-f0db-4a20-b45f-c863dbdc858b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:44.904293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 931/1868] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:44 2022] DELETE /identity/v3/users/3ec0c7884283455fa30eb1f41e1a59ed => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:44.995964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc2ab8-f0db-4a20-b45f-c863dbdc858b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:45.061104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273765e-389e-41d1-a574-d814f9fc2ce9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:45.062619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1273765e-389e-41d1-a574-d814f9fc2ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:45.109429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d61bd5-39dd-4b51-aa19-95630d999922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:45.110062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d61bd5-39dd-4b51-aa19-95630d999922 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:45.110694 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d61bd5-39dd-4b51-aa19-95630d999922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:45.110972 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d61bd5-39dd-4b51-aa19-95630d999922 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:45.112090 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d61bd5-39dd-4b51-aa19-95630d999922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:45.114074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d61bd5-39dd-4b51-aa19-95630d999922 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:45.179257 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273765e-389e-41d1-a574-d814f9fc2ce9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:45.184360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d64f8-57e0-42ed-a955-403aec09b99c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:45.185340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d64f8-57e0-42ed-a955-403aec09b99c service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:45.185693 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d64f8-57e0-42ed-a955-403aec09b99c service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:45.186031 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d64f8-57e0-42ed-a955-403aec09b99c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:45.189570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-284d64f8-57e0-42ed-a955-403aec09b99c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:45.228663 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 938/1869] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:44 2022] POST /identity/v3/users => generated 293 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:43:45.233232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d61bd5-39dd-4b51-aa19-95630d999922 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:45.259911 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d61bd5-39dd-4b51-aa19-95630d999922 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:45.273760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a95bdc-7c4f-44f6-bbfd-b4b9b6fe22dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:45.274413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a95bdc-7c4f-44f6-bbfd-b4b9b6fe22dc admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:45.275570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a95bdc-7c4f-44f6-bbfd-b4b9b6fe22dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:45.275951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a95bdc-7c4f-44f6-bbfd-b4b9b6fe22dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:45.279770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a95bdc-7c4f-44f6-bbfd-b4b9b6fe22dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:45.285038 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a95bdc-7c4f-44f6-bbfd-b4b9b6fe22dc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:45.315203 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 939/1870] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:43:45.317223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a95bdc-7c4f-44f6-bbfd-b4b9b6fe22dc admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:45.344046 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a95bdc-7c4f-44f6-bbfd-b4b9b6fe22dc admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:45.357984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035871f-3225-418c-98e1-1f6ef1e14135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:45.363643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035871f-3225-418c-98e1-1f6ef1e14135 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:45.363929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035871f-3225-418c-98e1-1f6ef1e14135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:45.364268 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035871f-3225-418c-98e1-1f6ef1e14135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:45.365565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035871f-3225-418c-98e1-1f6ef1e14135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:45.372782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035871f-3225-418c-98e1-1f6ef1e14135 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:45.375219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d64f8-57e0-42ed-a955-403aec09b99c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:45.378369 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d64f8-57e0-42ed-a955-403aec09b99c service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:45.399860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 940/1871] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:45.403904 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 932/1872] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:43:45.404314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035871f-3225-418c-98e1-1f6ef1e14135 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:45.418987 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035871f-3225-418c-98e1-1f6ef1e14135 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:45.424954 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f70b0-e85d-4256-bc34-3091ba3ad9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:45.425763 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f70b0-e85d-4256-bc34-3091ba3ad9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:45.426141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f70b0-e85d-4256-bc34-3091ba3ad9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:45.426535 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f70b0-e85d-4256-bc34-3091ba3ad9cf admin admin] PATH_INFO: `/v3/projects/0a7372efddd44c6698902bcc50b205b9/users/ded803604d694e52a102ea5853edd9be/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:45.452571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f70b0-e85d-4256-bc34-3091ba3ad9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7372efddd44c6698902bcc50b205b9, user_id=ded803604d694e52a102ea5853edd9be, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:45.467164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f70b0-e85d-4256-bc34-3091ba3ad9cf admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:45.584451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 941/1873] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:45 2022] PUT /identity/v3/projects/0a7372efddd44c6698902bcc50b205b9/users/ded803604d694e52a102ea5853edd9be/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:45.595226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb1795-74f1-43f1-9582-48e205d2bcba None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:45.595514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb1795-74f1-43f1-9582-48e205d2bcba None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:45.595849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb1795-74f1-43f1-9582-48e205d2bcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:45.676567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-78eb1795-74f1-43f1-9582-48e205d2bcba None None] MFA Rules not processed for user `ded803604d694e52a102ea5853edd9be`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:45.681328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-78eb1795-74f1-43f1-9582-48e205d2bcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:45.747551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f70b0-e85d-4256-bc34-3091ba3ad9cf admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:45.749371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3f6f70b0-e85d-4256-bc34-3091ba3ad9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:45.769792 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 933/1874] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:45.770825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb1795-74f1-43f1-9582-48e205d2bcba None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:45.869067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb1795-74f1-43f1-9582-48e205d2bcba None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:45.869656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f70b0-e85d-4256-bc34-3091ba3ad9cf admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:45.874407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6cd44-6a7e-4c64-9552-dfd640454579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:45.875107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6cd44-6a7e-4c64-9552-dfd640454579 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:45.875428 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc56d5e-3479-4f1f-a61e-833e985733b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:45.875566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6cd44-6a7e-4c64-9552-dfd640454579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:45.875929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6cd44-6a7e-4c64-9552-dfd640454579 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:45.876166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc56d5e-3479-4f1f-a61e-833e985733b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:45.876459 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc56d5e-3479-4f1f-a61e-833e985733b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:45.876734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc56d5e-3479-4f1f-a61e-833e985733b2 admin admin] PATH_INFO: `/v3/projects/85856c0924684114aa4e0086fc2db921` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:45.876835 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6cd44-6a7e-4c64-9552-dfd640454579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:45.877943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc56d5e-3479-4f1f-a61e-833e985733b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85856c0924684114aa4e0086fc2db921)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:45.878914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6cd44-6a7e-4c64-9552-dfd640454579 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:45.879844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc56d5e-3479-4f1f-a61e-833e985733b2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:46.002480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 934/1875] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:45 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:46.003393 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6cd44-6a7e-4c64-9552-dfd640454579 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:46.056837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-efc56d5e-3479-4f1f-a61e-833e985733b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85856c0924684114aa4e0086fc2db921', 'request_id': 'req-efc56d5e-3479-4f1f-a61e-833e985733b2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:46.082483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6cd44-6a7e-4c64-9552-dfd640454579 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:46.126211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-efc56d5e-3479-4f1f-a61e-833e985733b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85856c0924684114aa4e0086fc2db921', 'request_id': 'req-efc56d5e-3479-4f1f-a61e-833e985733b2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:46.140410 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-efc56d5e-3479-4f1f-a61e-833e985733b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85856c0924684114aa4e0086fc2db921', 'request_id': 'req-efc56d5e-3479-4f1f-a61e-833e985733b2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:46.174496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-efc56d5e-3479-4f1f-a61e-833e985733b2 admin admin] The token cache is being invalidate because project 85856c0924684114aa4e0086fc2db921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:46.174818 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-efc56d5e-3479-4f1f-a61e-833e985733b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:46.187081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-efc56d5e-3479-4f1f-a61e-833e985733b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:46.190654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 942/1876] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:45 2022] DELETE /identity/v3/projects/85856c0924684114aa4e0086fc2db921 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:46.200189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c27940-533a-41e4-9778-4eec738c433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:46.200881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27940-533a-41e4-9778-4eec738c433c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:46.201169 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d1bcd-3c53-493f-8d11-61f70e85b4ac None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:46.201313 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27940-533a-41e4-9778-4eec738c433c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:46.201689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d1bcd-3c53-493f-8d11-61f70e85b4ac None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:46.201928 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d1bcd-3c53-493f-8d11-61f70e85b4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:46.202777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27940-533a-41e4-9778-4eec738c433c admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:46.203434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c27940-533a-41e4-9778-4eec738c433c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:46.205495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c27940-533a-41e4-9778-4eec738c433c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:46.225307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-293d1bcd-3c53-493f-8d11-61f70e85b4ac None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:46.226377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-293d1bcd-3c53-493f-8d11-61f70e85b4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:46.237302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 943/1877] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:46.244603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f93e3-3352-4eff-a77c-560ad9784939 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:46.244892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f93e3-3352-4eff-a77c-560ad9784939 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:46.245277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f93e3-3352-4eff-a77c-560ad9784939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:46.266931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fb5f93e3-3352-4eff-a77c-560ad9784939 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:46.268148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fb5f93e3-3352-4eff-a77c-560ad9784939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:46.276959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 944/1878] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:43:46.281038 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f93e3-3352-4eff-a77c-560ad9784939 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:46.291033 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f93e3-3352-4eff-a77c-560ad9784939 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:46.300548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188961-5d15-474d-bbfc-e7d113817c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:46.301209 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188961-5d15-474d-bbfc-e7d113817c50 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:46.301508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188961-5d15-474d-bbfc-e7d113817c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:46.301787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188961-5d15-474d-bbfc-e7d113817c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:46.302461 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34188961-5d15-474d-bbfc-e7d113817c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:43:46.302767 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34188961-5d15-474d-bbfc-e7d113817c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:46.304399 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34188961-5d15-474d-bbfc-e7d113817c50 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:46.318621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 945/1879] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:43:46.322848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188961-5d15-474d-bbfc-e7d113817c50 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:46.324444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 935/1880] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:46 2022] POST /identity/v3/users => generated 300 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:46.328457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c27940-533a-41e4-9778-4eec738c433c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:46.330771 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-78c27940-533a-41e4-9778-4eec738c433c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:46.335109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188961-5d15-474d-bbfc-e7d113817c50 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:46.343006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf18d90-03ed-429a-a925-393c8c5d2e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:46.343901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf18d90-03ed-429a-a925-393c8c5d2e12 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:46.344463 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf18d90-03ed-429a-a925-393c8c5d2e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:46.354412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf18d90-03ed-429a-a925-393c8c5d2e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:46.354835 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c27940-533a-41e4-9778-4eec738c433c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:46.354927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf18d90-03ed-429a-a925-393c8c5d2e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:46.354927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf18d90-03ed-429a-a925-393c8c5d2e12 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:46.355057 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc77fc-a0a9-4e34-bada-64d629bc4669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:46.355057 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc77fc-a0a9-4e34-bada-64d629bc4669 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:46.355057 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc77fc-a0a9-4e34-bada-64d629bc4669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:46.355057 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc77fc-a0a9-4e34-bada-64d629bc4669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:46.357993 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc77fc-a0a9-4e34-bada-64d629bc4669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:46.359686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc77fc-a0a9-4e34-bada-64d629bc4669 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:46.380235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 936/1881] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:43:46.386309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc77fc-a0a9-4e34-bada-64d629bc4669 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:46.396718 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc77fc-a0a9-4e34-bada-64d629bc4669 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:46.402382 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc2d5c-f424-4d55-b139-1560aa37221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:46.403176 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc2d5c-f424-4d55-b139-1560aa37221b admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:46.403454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc2d5c-f424-4d55-b139-1560aa37221b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:46.403730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc2d5c-f424-4d55-b139-1560aa37221b admin admin] PATH_INFO: `/v3/projects/a769eed5656a47ef8cd1418ded954281/users/ac7b0748dc8342e9804695fe496054aa/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:46.421544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc2d5c-f424-4d55-b139-1560aa37221b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a769eed5656a47ef8cd1418ded954281, user_id=ac7b0748dc8342e9804695fe496054aa, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:46.424540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc2d5c-f424-4d55-b139-1560aa37221b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:46.467819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 946/1882] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:46 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:46.490527 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf18d90-03ed-429a-a925-393c8c5d2e12 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:46.495483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 937/1883] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:46 2022] PUT /identity/v3/projects/a769eed5656a47ef8cd1418ded954281/users/ac7b0748dc8342e9804695fe496054aa/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:46.500171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc2d5c-f424-4d55-b139-1560aa37221b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:46.578623 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf18d90-03ed-429a-a925-393c8c5d2e12 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:46.602091 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc2d5c-f424-4d55-b139-1560aa37221b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:46.608402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71168442-7954-48c5-8639-8808c1192714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:46.609055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168442-7954-48c5-8639-8808c1192714 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:46.609366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168442-7954-48c5-8639-8808c1192714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:46.609639 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168442-7954-48c5-8639-8808c1192714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:46.610737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71168442-7954-48c5-8639-8808c1192714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:46.612762 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71168442-7954-48c5-8639-8808c1192714 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:46.629104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 938/1884] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:46.632329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71168442-7954-48c5-8639-8808c1192714 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:46.652971 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71168442-7954-48c5-8639-8808c1192714 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:46.664660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb7145-5076-4228-9a49-3cf547db7129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:46.665401 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb7145-5076-4228-9a49-3cf547db7129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:46.665689 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb7145-5076-4228-9a49-3cf547db7129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:46.665969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb7145-5076-4228-9a49-3cf547db7129 admin admin] PATH_INFO: `/v3/projects/a769eed5656a47ef8cd1418ded954281/users/ac7b0748dc8342e9804695fe496054aa/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:46.668457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb7145-5076-4228-9a49-3cf547db7129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a769eed5656a47ef8cd1418ded954281, user_id=ac7b0748dc8342e9804695fe496054aa, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:46.671380 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb7145-5076-4228-9a49-3cf547db7129 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:46.682511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70749b-98d9-4db9-8292-833a93ca4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:46.683156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70749b-98d9-4db9-8292-833a93ca4d03 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:46.685429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70749b-98d9-4db9-8292-833a93ca4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:46.685657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70749b-98d9-4db9-8292-833a93ca4d03 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:46.686320 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70749b-98d9-4db9-8292-833a93ca4d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:46.690491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70749b-98d9-4db9-8292-833a93ca4d03 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:46.696173 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 939/1885] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:46 2022] PUT /identity/v3/projects/a769eed5656a47ef8cd1418ded954281/users/ac7b0748dc8342e9804695fe496054aa/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:46.716202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5c61-b807-4aa5-b8f6-a640693e9a81 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:46.719268 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5c61-b807-4aa5-b8f6-a640693e9a81 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:46.719268 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5c61-b807-4aa5-b8f6-a640693e9a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:46.766708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9a0e5c61-b807-4aa5-b8f6-a640693e9a81 None None] MFA Rules not processed for user `ac7b0748dc8342e9804695fe496054aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:46.767981 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9a0e5c61-b807-4aa5-b8f6-a640693e9a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:46.782473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 947/1886] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:46 2022] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:46.787460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70749b-98d9-4db9-8292-833a93ca4d03 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:46.806667 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70749b-98d9-4db9-8292-833a93ca4d03 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:46.875142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 940/1887] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:43:46.896728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e5c61-b807-4aa5-b8f6-a640693e9a81 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:46.898769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9a0e5c61-b807-4aa5-b8f6-a640693e9a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:46.940107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0aea5f-08ff-469a-bba6-c58baf260eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:46.940868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aea5f-08ff-469a-bba6-c58baf260eac admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:46.941151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aea5f-08ff-469a-bba6-c58baf260eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:46.941462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aea5f-08ff-469a-bba6-c58baf260eac admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:46.942270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0aea5f-08ff-469a-bba6-c58baf260eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:46.944191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0aea5f-08ff-469a-bba6-c58baf260eac admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:46.960163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 948/1888] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:43:46.966254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0aea5f-08ff-469a-bba6-c58baf260eac admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:46.987249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0aea5f-08ff-469a-bba6-c58baf260eac admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:46.994749 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a83b4e-c97d-4445-aa30-a2ae54fc8689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:46.995771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a83b4e-c97d-4445-aa30-a2ae54fc8689 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:46.996249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a83b4e-c97d-4445-aa30-a2ae54fc8689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:46.996548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a83b4e-c97d-4445-aa30-a2ae54fc8689 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:46.997526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a83b4e-c97d-4445-aa30-a2ae54fc8689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:46.999805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a83b4e-c97d-4445-aa30-a2ae54fc8689 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:47.019202 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 949/1889] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:43:47.025372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e5c61-b807-4aa5-b8f6-a640693e9a81 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:47.025763 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a83b4e-c97d-4445-aa30-a2ae54fc8689 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:47.030335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0eb72-2921-4b81-8b15-6fc090cb84fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:47.031361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0eb72-2921-4b81-8b15-6fc090cb84fc service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:47.031798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0eb72-2921-4b81-8b15-6fc090cb84fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:47.032226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0eb72-2921-4b81-8b15-6fc090cb84fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:47.041914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a83b4e-c97d-4445-aa30-a2ae54fc8689 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:47.043853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0eb72-2921-4b81-8b15-6fc090cb84fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:47.045559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0eb72-2921-4b81-8b15-6fc090cb84fc service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:47.048987 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d9a23-c911-42aa-8701-2eceaa3f70f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:47.049873 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d9a23-c911-42aa-8701-2eceaa3f70f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:47.050219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d9a23-c911-42aa-8701-2eceaa3f70f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:47.050697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d9a23-c911-42aa-8701-2eceaa3f70f3 admin admin] PATH_INFO: `/v3/projects/816eb5fbd88949d3903b4ea6c9f7047c/users/0656c955c02a4e7abde7c5754d3665d6/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:47.080451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d9a23-c911-42aa-8701-2eceaa3f70f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816eb5fbd88949d3903b4ea6c9f7047c, user_id=0656c955c02a4e7abde7c5754d3665d6, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:47.083691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d9a23-c911-42aa-8701-2eceaa3f70f3 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:47.086328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 941/1890] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:47.113331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0eb72-2921-4b81-8b15-6fc090cb84fc service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:47.125102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0eb72-2921-4b81-8b15-6fc090cb84fc service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:47.130691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485a6c9-1305-4240-bd26-e22e6b796a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:47.131444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485a6c9-1305-4240-bd26-e22e6b796a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:47.131764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485a6c9-1305-4240-bd26-e22e6b796a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:47.132038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485a6c9-1305-4240-bd26-e22e6b796a36 admin admin] PATH_INFO: `/v3/users/ded803604d694e52a102ea5853edd9be` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:47.133282 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485a6c9-1305-4240-bd26-e22e6b796a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded803604d694e52a102ea5853edd9be)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:47.135314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485a6c9-1305-4240-bd26-e22e6b796a36 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:47.180022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 950/1891] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:47 2022] PUT /identity/v3/projects/816eb5fbd88949d3903b4ea6c9f7047c/users/0656c955c02a4e7abde7c5754d3665d6/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:47.193362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ecb6-399a-49de-ba5c-cf06b8532778 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:47.193678 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ecb6-399a-49de-ba5c-cf06b8532778 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:47.193956 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ecb6-399a-49de-ba5c-cf06b8532778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:47.228116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e1b6ecb6-399a-49de-ba5c-cf06b8532778 None None] MFA Rules not processed for user `0656c955c02a4e7abde7c5754d3665d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:47.229446 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e1b6ecb6-399a-49de-ba5c-cf06b8532778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:47.334225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 951/1892] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:43:47.340656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6ecb6-399a-49de-ba5c-cf06b8532778 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:47.343671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e1b6ecb6-399a-49de-ba5c-cf06b8532778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:47.465799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4485a6c9-1305-4240-bd26-e22e6b796a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded803604d694e52a102ea5853edd9be'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:47.467643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4485a6c9-1305-4240-bd26-e22e6b796a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded803604d694e52a102ea5853edd9be'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:47.511195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4485a6c9-1305-4240-bd26-e22e6b796a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded803604d694e52a102ea5853edd9be'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:47.521501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4485a6c9-1305-4240-bd26-e22e6b796a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded803604d694e52a102ea5853edd9be'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:47.522525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-4485a6c9-1305-4240-bd26-e22e6b796a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded803604d694e52a102ea5853edd9be'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:47.576078 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6ecb6-399a-49de-ba5c-cf06b8532778 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:47.580496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05aafe9-6a65-4173-abd4-4528edcdaaa8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526760ad8a04bf486d1e7e74e9ffbe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:47.581239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aafe9-6a65-4173-abd4-4528edcdaaa8 service glance] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:47.581523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aafe9-6a65-4173-abd4-4528edcdaaa8 service glance] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:47.581801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aafe9-6a65-4173-abd4-4528edcdaaa8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:47.583624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c05aafe9-6a65-4173-abd4-4528edcdaaa8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:47.596688 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05aafe9-6a65-4173-abd4-4528edcdaaa8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:47.598160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05aafe9-6a65-4173-abd4-4528edcdaaa8 service glance] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:47.607801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 952/1893] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:43:47.619024 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 942/1894] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:47 2022] DELETE /identity/v3/users/ded803604d694e52a102ea5853edd9be => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:47.624344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25184ae1-862a-4003-85dd-ece42c56c00a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:47.624633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25184ae1-862a-4003-85dd-ece42c56c00a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:47.624926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25184ae1-862a-4003-85dd-ece42c56c00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:47.650479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-25184ae1-862a-4003-85dd-ece42c56c00a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:47.652443 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-25184ae1-862a-4003-85dd-ece42c56c00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:47.671245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:47.734834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:47.738031 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 953/1895] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:47.751150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485a6c9-1305-4240-bd26-e22e6b796a36 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:47.753060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4485a6c9-1305-4240-bd26-e22e6b796a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:47.912314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485a6c9-1305-4240-bd26-e22e6b796a36 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:47.917950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6718d-7879-4fdb-888d-174f6a300c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:47.918876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6718d-7879-4fdb-888d-174f6a300c58 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:47.924044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6718d-7879-4fdb-888d-174f6a300c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:47.924044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6718d-7879-4fdb-888d-174f6a300c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:47.930209 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6718d-7879-4fdb-888d-174f6a300c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:47.931799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6718d-7879-4fdb-888d-174f6a300c58 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:47.945455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 943/1896] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:48.532563 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25184ae1-862a-4003-85dd-ece42c56c00a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:48.535472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-25184ae1-862a-4003-85dd-ece42c56c00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:48.549477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25184ae1-862a-4003-85dd-ece42c56c00a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:48.554311 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:48.555021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:48.555375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:48.555716 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] PATH_INFO: `/v3/projects/0a7372efddd44c6698902bcc50b205b9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:48.557057 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a7372efddd44c6698902bcc50b205b9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:48.559863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:48.723858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a7372efddd44c6698902bcc50b205b9', 'request_id': 'req-d58d1899-dfb6-4da7-9a9a-146d0461288d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:48.842094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a7372efddd44c6698902bcc50b205b9', 'request_id': 'req-d58d1899-dfb6-4da7-9a9a-146d0461288d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:48.848824 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a7372efddd44c6698902bcc50b205b9', 'request_id': 'req-d58d1899-dfb6-4da7-9a9a-146d0461288d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:48.861707 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] The token cache is being invalidate because project 0a7372efddd44c6698902bcc50b205b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:48.861881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:48.862555 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:48.864060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 954/1897] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:48 2022] DELETE /identity/v3/projects/0a7372efddd44c6698902bcc50b205b9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:48.868037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6718d-7879-4fdb-888d-174f6a300c58 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:48.881728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6718d-7879-4fdb-888d-174f6a300c58 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:48.953659 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:48.955839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:48.970356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ced31-164d-4524-9ca8-22f3d8dc2105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:48.971069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ced31-164d-4524-9ca8-22f3d8dc2105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:48.971409 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ced31-164d-4524-9ca8-22f3d8dc2105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:48.971735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ced31-164d-4524-9ca8-22f3d8dc2105 admin admin] PATH_INFO: `/v3/users/ac7b0748dc8342e9804695fe496054aa` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:48.974873 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ced31-164d-4524-9ca8-22f3d8dc2105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7b0748dc8342e9804695fe496054aa)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:48.977837 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ced31-164d-4524-9ca8-22f3d8dc2105 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:49.030256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d1899-dfb6-4da7-9a9a-146d0461288d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:49.035833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f4f6d-b0b0-40b5-bcae-361833da5809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:49.036622 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f4f6d-b0b0-40b5-bcae-361833da5809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:49.036909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f4f6d-b0b0-40b5-bcae-361833da5809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:49.037181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f4f6d-b0b0-40b5-bcae-361833da5809 admin admin] PATH_INFO: `/v3/users/604fb507e0144a5aa04bfc2855891cd7` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:49.038372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f4f6d-b0b0-40b5-bcae-361833da5809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=604fb507e0144a5aa04bfc2855891cd7)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:49.040696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f4f6d-b0b0-40b5-bcae-361833da5809 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:49.139717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:49.195104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-497ced31-164d-4524-9ca8-22f3d8dc2105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7b0748dc8342e9804695fe496054aa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:49.196043 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-497ced31-164d-4524-9ca8-22f3d8dc2105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7b0748dc8342e9804695fe496054aa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:49.210964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-497ced31-164d-4524-9ca8-22f3d8dc2105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7b0748dc8342e9804695fe496054aa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:49.220122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-497ced31-164d-4524-9ca8-22f3d8dc2105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7b0748dc8342e9804695fe496054aa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:49.220850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-497ced31-164d-4524-9ca8-22f3d8dc2105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7b0748dc8342e9804695fe496054aa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:49.231546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:49.274468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f92f4f6d-b0b0-40b5-bcae-361833da5809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '604fb507e0144a5aa04bfc2855891cd7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:49.287464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f92f4f6d-b0b0-40b5-bcae-361833da5809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '604fb507e0144a5aa04bfc2855891cd7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:49.293795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 944/1898] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:48 2022] DELETE /identity/v3/users/ac7b0748dc8342e9804695fe496054aa => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:49.373270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f92f4f6d-b0b0-40b5-bcae-361833da5809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '604fb507e0144a5aa04bfc2855891cd7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:49.382434 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f92f4f6d-b0b0-40b5-bcae-361833da5809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '604fb507e0144a5aa04bfc2855891cd7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:49.383379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f92f4f6d-b0b0-40b5-bcae-361833da5809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '604fb507e0144a5aa04bfc2855891cd7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:49.392025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 955/1899] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:48 2022] DELETE /identity/v3/users/604fb507e0144a5aa04bfc2855891cd7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:49.396679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca049ff9-a86d-4b72-8dc9-c05940b57d4c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:49.396989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca049ff9-a86d-4b72-8dc9-c05940b57d4c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:49.397297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca049ff9-a86d-4b72-8dc9-c05940b57d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:49.418598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ca049ff9-a86d-4b72-8dc9-c05940b57d4c None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:49.419824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ca049ff9-a86d-4b72-8dc9-c05940b57d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:49.493836 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 945/1900] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:49.507464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f4f6d-b0b0-40b5-bcae-361833da5809 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:49.508994 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f92f4f6d-b0b0-40b5-bcae-361833da5809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:49.592364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f4f6d-b0b0-40b5-bcae-361833da5809 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:49.605090 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae055d-ac86-425f-a415-7472744ca185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:49.606588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae055d-ac86-425f-a415-7472744ca185 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:49.606983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae055d-ac86-425f-a415-7472744ca185 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:49.611451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae055d-ac86-425f-a415-7472744ca185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:49.618332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae055d-ac86-425f-a415-7472744ca185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:49.619736 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae055d-ac86-425f-a415-7472744ca185 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:49.629891 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 956/1901] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:49.978209 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca049ff9-a86d-4b72-8dc9-c05940b57d4c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:49.979809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ca049ff9-a86d-4b72-8dc9-c05940b57d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:50.001748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca049ff9-a86d-4b72-8dc9-c05940b57d4c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:50.001748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789437aa-276e-4192-820e-84aad966e949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:50.001748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789437aa-276e-4192-820e-84aad966e949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:50.001748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789437aa-276e-4192-820e-84aad966e949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:50.002083 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789437aa-276e-4192-820e-84aad966e949 admin admin] PATH_INFO: `/v3/projects/a769eed5656a47ef8cd1418ded954281` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:50.018577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789437aa-276e-4192-820e-84aad966e949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a769eed5656a47ef8cd1418ded954281)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:50.018577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789437aa-276e-4192-820e-84aad966e949 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:50.176539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-789437aa-276e-4192-820e-84aad966e949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a769eed5656a47ef8cd1418ded954281', 'request_id': 'req-789437aa-276e-4192-820e-84aad966e949'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:50.205530 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae055d-ac86-425f-a415-7472744ca185 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:50.209399 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9fae055d-ac86-425f-a415-7472744ca185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:50.236282 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae055d-ac86-425f-a415-7472744ca185 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:50.282133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-789437aa-276e-4192-820e-84aad966e949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a769eed5656a47ef8cd1418ded954281', 'request_id': 'req-789437aa-276e-4192-820e-84aad966e949'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:50.289923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-789437aa-276e-4192-820e-84aad966e949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a769eed5656a47ef8cd1418ded954281', 'request_id': 'req-789437aa-276e-4192-820e-84aad966e949'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:50.301582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-789437aa-276e-4192-820e-84aad966e949 admin admin] The token cache is being invalidate because project a769eed5656a47ef8cd1418ded954281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:50.301877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-789437aa-276e-4192-820e-84aad966e949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:50.302941 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-789437aa-276e-4192-820e-84aad966e949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:50.304502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 946/1902] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:49 2022] DELETE /identity/v3/projects/a769eed5656a47ef8cd1418ded954281 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:50.310131 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08f11-6bdf-4605-b523-a84ea7e2d582 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:50.310615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08f11-6bdf-4605-b523-a84ea7e2d582 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:50.311066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08f11-6bdf-4605-b523-a84ea7e2d582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:50.315040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:50.315760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:50.316186 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:50.316517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] PATH_INFO: `/v3/projects/8ad881a216c8441cb105240636fbd365` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:50.322112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad881a216c8441cb105240636fbd365)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:50.322112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:50.348191 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1ad08f11-6bdf-4605-b523-a84ea7e2d582 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:50.349777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1ad08f11-6bdf-4605-b523-a84ea7e2d582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:50.363725 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 947/1903] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:50.374331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6e40-5468-40b1-bae5-79f8a159d45f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:50.374837 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6e40-5468-40b1-bae5-79f8a159d45f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:50.375185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6e40-5468-40b1-bae5-79f8a159d45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:50.395129 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7a8a6e40-5468-40b1-bae5-79f8a159d45f None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:50.396338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7a8a6e40-5468-40b1-bae5-79f8a159d45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:50.404664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 948/1904] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:50.408749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a6e40-5468-40b1-bae5-79f8a159d45f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:50.418685 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a6e40-5468-40b1-bae5-79f8a159d45f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:50.423293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c92d4-784b-4111-b545-58d48e271f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:50.423912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c92d4-784b-4111-b545-58d48e271f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:50.424194 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c92d4-784b-4111-b545-58d48e271f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:50.424470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c92d4-784b-4111-b545-58d48e271f96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:50.425115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c92d4-784b-4111-b545-58d48e271f96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:43:50.425448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c92d4-784b-4111-b545-58d48e271f96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:50.427030 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c92d4-784b-4111-b545-58d48e271f96 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:50.439135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 949/1905] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:43:50.443321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c92d4-784b-4111-b545-58d48e271f96 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:50.452612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c92d4-784b-4111-b545-58d48e271f96 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:50.457384 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd884a-2cec-422b-8eee-3829deaa7108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:50.458021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd884a-2cec-422b-8eee-3829deaa7108 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:50.458312 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd884a-2cec-422b-8eee-3829deaa7108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:50.458580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd884a-2cec-422b-8eee-3829deaa7108 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:50.459214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd884a-2cec-422b-8eee-3829deaa7108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:50.463162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd884a-2cec-422b-8eee-3829deaa7108 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:50.471969 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad881a216c8441cb105240636fbd365', 'request_id': 'req-890c3bff-2953-4e04-bc04-d858e7f36923'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:50.533052 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad881a216c8441cb105240636fbd365', 'request_id': 'req-890c3bff-2953-4e04-bc04-d858e7f36923'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:50.539287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad881a216c8441cb105240636fbd365', 'request_id': 'req-890c3bff-2953-4e04-bc04-d858e7f36923'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:50.551055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] The token cache is being invalidate because project 8ad881a216c8441cb105240636fbd365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:50.551346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:50.551985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:50.553532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 957/1906] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:50 2022] DELETE /identity/v3/projects/8ad881a216c8441cb105240636fbd365 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:50.560549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:50.562121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:50.566747 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 950/1907] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:50 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:43:50.569551 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd884a-2cec-422b-8eee-3829deaa7108 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:50.572231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-12cd884a-2cec-422b-8eee-3829deaa7108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:50.650489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd884a-2cec-422b-8eee-3829deaa7108 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:50.651693 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3bff-2953-4e04-bc04-d858e7f36923 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:50.657610 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b9686-94e7-49ed-be99-ff76a7cbf66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:50.658554 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b9686-94e7-49ed-be99-ff76a7cbf66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:50.658858 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075d7b8-fa1c-4eef-a52c-a37225c68081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:50.659332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b9686-94e7-49ed-be99-ff76a7cbf66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:50.659472 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d7b8-fa1c-4eef-a52c-a37225c68081 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:50.659748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d7b8-fa1c-4eef-a52c-a37225c68081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:50.660017 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d7b8-fa1c-4eef-a52c-a37225c68081 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:50.660261 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b9686-94e7-49ed-be99-ff76a7cbf66d admin admin] PATH_INFO: `/v3/users/2ada924bdeec4632b2a7a65e18f256a3` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:50.660653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075d7b8-fa1c-4eef-a52c-a37225c68081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:50.661597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b9686-94e7-49ed-be99-ff76a7cbf66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ada924bdeec4632b2a7a65e18f256a3)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:50.662819 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075d7b8-fa1c-4eef-a52c-a37225c68081 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:50.663705 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b9686-94e7-49ed-be99-ff76a7cbf66d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:50.770585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 951/1908] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:50 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:43:50.774779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075d7b8-fa1c-4eef-a52c-a37225c68081 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:50.791173 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075d7b8-fa1c-4eef-a52c-a37225c68081 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:50.796366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b306ae-fc9c-457f-a6b1-e3777b061537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:50.797088 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b306ae-fc9c-457f-a6b1-e3777b061537 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:50.797485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b306ae-fc9c-457f-a6b1-e3777b061537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:50.798010 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b306ae-fc9c-457f-a6b1-e3777b061537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:50.798913 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b306ae-fc9c-457f-a6b1-e3777b061537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:50.800720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b306ae-fc9c-457f-a6b1-e3777b061537 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:50.817245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 952/1909] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:50.820179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b306ae-fc9c-457f-a6b1-e3777b061537 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:50.843151 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b306ae-fc9c-457f-a6b1-e3777b061537 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:50.849365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723f644-a845-4615-b2f6-b6a12e0b32c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:50.849365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723f644-a845-4615-b2f6-b6a12e0b32c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:50.849608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723f644-a845-4615-b2f6-b6a12e0b32c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:50.850023 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723f644-a845-4615-b2f6-b6a12e0b32c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:50.850770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723f644-a845-4615-b2f6-b6a12e0b32c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:50.852548 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723f644-a845-4615-b2f6-b6a12e0b32c2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:50.871946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 953/1910] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:50.875686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723f644-a845-4615-b2f6-b6a12e0b32c2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:50.892040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723f644-a845-4615-b2f6-b6a12e0b32c2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:50.897430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bcf80-6477-44e8-b6e8-ea67757d8307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:50.899178 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bcf80-6477-44e8-b6e8-ea67757d8307 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:50.899462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bcf80-6477-44e8-b6e8-ea67757d8307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:50.899734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bcf80-6477-44e8-b6e8-ea67757d8307 admin admin] PATH_INFO: `/v3/projects/88872d40b8e64ad68c57312cebbedb1a/users/45e69b2d0b354d2ebbf3b426fb17c46f/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:50.919104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bcf80-6477-44e8-b6e8-ea67757d8307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88872d40b8e64ad68c57312cebbedb1a, user_id=45e69b2d0b354d2ebbf3b426fb17c46f, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:50.922043 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bcf80-6477-44e8-b6e8-ea67757d8307 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:50.932039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:50.953740 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-897b9686-94e7-49ed-be99-ff76a7cbf66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ada924bdeec4632b2a7a65e18f256a3'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:50.978181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-897b9686-94e7-49ed-be99-ff76a7cbf66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ada924bdeec4632b2a7a65e18f256a3'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:51.048382 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:51.054713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 954/1911] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:50 2022] PUT /identity/v3/projects/88872d40b8e64ad68c57312cebbedb1a/users/45e69b2d0b354d2ebbf3b426fb17c46f/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:51.066846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85ae7-32b5-43a8-89b4-1ff16bc7d785 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:51.067157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85ae7-32b5-43a8-89b4-1ff16bc7d785 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:51.067472 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85ae7-32b5-43a8-89b4-1ff16bc7d785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:51.082397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-897b9686-94e7-49ed-be99-ff76a7cbf66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ada924bdeec4632b2a7a65e18f256a3'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:51.091869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-897b9686-94e7-49ed-be99-ff76a7cbf66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ada924bdeec4632b2a7a65e18f256a3'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:51.091990 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-897b9686-94e7-49ed-be99-ff76a7cbf66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ada924bdeec4632b2a7a65e18f256a3'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:51.098674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 958/1912] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:43:50 2022] DELETE /identity/v3/users/2ada924bdeec4632b2a7a65e18f256a3 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:51.103652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-67f85ae7-32b5-43a8-89b4-1ff16bc7d785 None None] MFA Rules not processed for user `45e69b2d0b354d2ebbf3b426fb17c46f`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:51.104910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-67f85ae7-32b5-43a8-89b4-1ff16bc7d785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:51.203441 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 955/1913] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:51.216544 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b9686-94e7-49ed-be99-ff76a7cbf66d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:51.218144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-897b9686-94e7-49ed-be99-ff76a7cbf66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:51.290148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b9686-94e7-49ed-be99-ff76a7cbf66d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:51.295421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957ec93-3063-4f4a-87ab-b238d8ee4c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:51.296066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957ec93-3063-4f4a-87ab-b238d8ee4c8f admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:51.296344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957ec93-3063-4f4a-87ab-b238d8ee4c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:51.296616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957ec93-3063-4f4a-87ab-b238d8ee4c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:51.297289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957ec93-3063-4f4a-87ab-b238d8ee4c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:51.299354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957ec93-3063-4f4a-87ab-b238d8ee4c8f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:51.399216 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 959/1914] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:51 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:51.401613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f85ae7-32b5-43a8-89b4-1ff16bc7d785 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:51.412260 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f85ae7-32b5-43a8-89b4-1ff16bc7d785 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:51.485310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51cc7f-7e4f-4482-b458-0392206ef65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:51.485930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51cc7f-7e4f-4482-b458-0392206ef65d admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:51.486210 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51cc7f-7e4f-4482-b458-0392206ef65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:51.486481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51cc7f-7e4f-4482-b458-0392206ef65d admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:51.487118 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51cc7f-7e4f-4482-b458-0392206ef65d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:51.489051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51cc7f-7e4f-4482-b458-0392206ef65d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:51.597652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957ec93-3063-4f4a-87ab-b238d8ee4c8f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:51.600103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3957ec93-3063-4f4a-87ab-b238d8ee4c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:51.609655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 956/1915] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:51 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:51.619073 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957ec93-3063-4f4a-87ab-b238d8ee4c8f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:51.623893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d481b06-36d8-4cfe-9849-21f1caa233b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:51.624529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481b06-36d8-4cfe-9849-21f1caa233b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:51.624808 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481b06-36d8-4cfe-9849-21f1caa233b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:51.625083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481b06-36d8-4cfe-9849-21f1caa233b7 admin admin] PATH_INFO: `/v3/projects/2f0742e7980a44c581f6786094f717f1` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:51.626241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d481b06-36d8-4cfe-9849-21f1caa233b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f0742e7980a44c581f6786094f717f1)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:51.628237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d481b06-36d8-4cfe-9849-21f1caa233b7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:51.636335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51cc7f-7e4f-4482-b458-0392206ef65d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:51.647544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51cc7f-7e4f-4482-b458-0392206ef65d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:51.652957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c1612-8353-4731-92a9-90ab0b56ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:51.653593 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1612-8353-4731-92a9-90ab0b56ec46 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:51.653874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1612-8353-4731-92a9-90ab0b56ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:51.654148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1612-8353-4731-92a9-90ab0b56ec46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:51.655287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c1612-8353-4731-92a9-90ab0b56ec46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:51.656470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c1612-8353-4731-92a9-90ab0b56ec46 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:51.667783 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 957/1916] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:51.671464 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c1612-8353-4731-92a9-90ab0b56ec46 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:51.681329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c1612-8353-4731-92a9-90ab0b56ec46 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:51.687042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101f24e-330f-43e4-8890-b893294e2de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:51.687042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101f24e-330f-43e4-8890-b893294e2de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:51.687042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101f24e-330f-43e4-8890-b893294e2de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:51.687290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101f24e-330f-43e4-8890-b893294e2de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:51.687850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101f24e-330f-43e4-8890-b893294e2de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:51.689478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101f24e-330f-43e4-8890-b893294e2de8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:51.710459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 958/1917] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:43:51.717335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101f24e-330f-43e4-8890-b893294e2de8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:51.741996 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101f24e-330f-43e4-8890-b893294e2de8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:51.757432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8d481b06-36d8-4cfe-9849-21f1caa233b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f0742e7980a44c581f6786094f717f1', 'request_id': 'req-8d481b06-36d8-4cfe-9849-21f1caa233b7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:51.807265 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8d481b06-36d8-4cfe-9849-21f1caa233b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f0742e7980a44c581f6786094f717f1', 'request_id': 'req-8d481b06-36d8-4cfe-9849-21f1caa233b7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:51.814155 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8d481b06-36d8-4cfe-9849-21f1caa233b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f0742e7980a44c581f6786094f717f1', 'request_id': 'req-8d481b06-36d8-4cfe-9849-21f1caa233b7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:51.843371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e55dbd-c544-4b45-af86-28498da3b932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:51.844051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e55dbd-c544-4b45-af86-28498da3b932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:51.844160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8d481b06-36d8-4cfe-9849-21f1caa233b7 admin admin] The token cache is being invalidate because project 2f0742e7980a44c581f6786094f717f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:43:51.844325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e55dbd-c544-4b45-af86-28498da3b932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:51.844421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8d481b06-36d8-4cfe-9849-21f1caa233b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:51.844595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e55dbd-c544-4b45-af86-28498da3b932 admin admin] PATH_INFO: `/v3/projects/a326e29e7c13401fa8c57ee4c4881893/users/ec61eaa1702d4846b5a25700b9cb9cc0/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:51.845115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8d481b06-36d8-4cfe-9849-21f1caa233b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:43:51.846916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 960/1918] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:43:51 2022] DELETE /identity/v3/projects/2f0742e7980a44c581f6786094f717f1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:51.852208 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016c6d-a2d5-43c5-b0b6-db189a2bff9b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:51.852666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016c6d-a2d5-43c5-b0b6-db189a2bff9b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:51.853278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016c6d-a2d5-43c5-b0b6-db189a2bff9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:51.863812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e55dbd-c544-4b45-af86-28498da3b932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a326e29e7c13401fa8c57ee4c4881893, user_id=ec61eaa1702d4846b5a25700b9cb9cc0, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:51.866654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e55dbd-c544-4b45-af86-28498da3b932 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:51.887400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-25016c6d-a2d5-43c5-b0b6-db189a2bff9b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:51.888999 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-25016c6d-a2d5-43c5-b0b6-db189a2bff9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:51.897935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 961/1919] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:43:51.905985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8a59a-f74e-4025-835d-7fc3bc1bbd1f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:51.906531 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8a59a-f74e-4025-835d-7fc3bc1bbd1f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:51.907022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8a59a-f74e-4025-835d-7fc3bc1bbd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:51.940286 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f0e8a59a-f74e-4025-835d-7fc3bc1bbd1f None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:51.942327 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f0e8a59a-f74e-4025-835d-7fc3bc1bbd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:51.954868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 962/1920] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:51.964825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8a59a-f74e-4025-835d-7fc3bc1bbd1f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:51.969293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 959/1921] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:51 2022] PUT /identity/v3/projects/a326e29e7c13401fa8c57ee4c4881893/users/ec61eaa1702d4846b5a25700b9cb9cc0/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:51.982838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6f9c8-12c6-4a0e-b272-732c9d4e6c69 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:51.983066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8a59a-f74e-4025-835d-7fc3bc1bbd1f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:51.983167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6f9c8-12c6-4a0e-b272-732c9d4e6c69 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:51.983384 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6f9c8-12c6-4a0e-b272-732c9d4e6c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.036940 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-56e6f9c8-12c6-4a0e-b272-732c9d4e6c69 None None] MFA Rules not processed for user `ec61eaa1702d4846b5a25700b9cb9cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:52.039848 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-56e6f9c8-12c6-4a0e-b272-732c9d4e6c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:52.082295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c26ab-043c-4c95-910a-eddba3d00d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:52.083077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c26ab-043c-4c95-910a-eddba3d00d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.083364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c26ab-043c-4c95-910a-eddba3d00d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.083640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c26ab-043c-4c95-910a-eddba3d00d76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.084304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c26ab-043c-4c95-910a-eddba3d00d76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:43:52.084610 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c26ab-043c-4c95-910a-eddba3d00d76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:52.086302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c26ab-043c-4c95-910a-eddba3d00d76 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:52.099010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 963/1922] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:43:52.103209 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c26ab-043c-4c95-910a-eddba3d00d76 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:52.114031 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c26ab-043c-4c95-910a-eddba3d00d76 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:52.119027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a3755-772b-48c8-9932-80d3d24ca851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:52.119856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3755-772b-48c8-9932-80d3d24ca851 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.122187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3755-772b-48c8-9932-80d3d24ca851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.122187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3755-772b-48c8-9932-80d3d24ca851 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.122187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a3755-772b-48c8-9932-80d3d24ca851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:52.123330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a3755-772b-48c8-9932-80d3d24ca851 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:52.128450 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 960/1923] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:43:52.132284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6f9c8-12c6-4a0e-b272-732c9d4e6c69 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:52.133660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-56e6f9c8-12c6-4a0e-b272-732c9d4e6c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:52.148036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6f9c8-12c6-4a0e-b272-732c9d4e6c69 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:52.152941 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be136a5d-99b5-4ef9-8d84-b4068d496d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:52.153604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be136a5d-99b5-4ef9-8d84-b4068d496d85 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.153891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be136a5d-99b5-4ef9-8d84-b4068d496d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.154169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be136a5d-99b5-4ef9-8d84-b4068d496d85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.154810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be136a5d-99b5-4ef9-8d84-b4068d496d85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:52.156714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be136a5d-99b5-4ef9-8d84-b4068d496d85 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:52.256767 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 964/1924] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:52 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:52.261087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a3755-772b-48c8-9932-80d3d24ca851 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:52.291334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 961/1925] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:52 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:43:52.295038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be136a5d-99b5-4ef9-8d84-b4068d496d85 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:52.325697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a3755-772b-48c8-9932-80d3d24ca851 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:52.358071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be136a5d-99b5-4ef9-8d84-b4068d496d85 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:52.362908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffaae1-60f2-4db3-9ed1-91c53115feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:52.363531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffaae1-60f2-4db3-9ed1-91c53115feb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.363815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffaae1-60f2-4db3-9ed1-91c53115feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.364091 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffaae1-60f2-4db3-9ed1-91c53115feb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.364727 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffaae1-60f2-4db3-9ed1-91c53115feb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:52.366698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffaae1-60f2-4db3-9ed1-91c53115feb7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:52.383314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d5a63-8d00-4d9c-bb6c-fc2a0e91edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:52.383919 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d5a63-8d00-4d9c-bb6c-fc2a0e91edeb admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.384214 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d5a63-8d00-4d9c-bb6c-fc2a0e91edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.384507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d5a63-8d00-4d9c-bb6c-fc2a0e91edeb admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.385145 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d5a63-8d00-4d9c-bb6c-fc2a0e91edeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:52.399047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d5a63-8d00-4d9c-bb6c-fc2a0e91edeb admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:52.446844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 962/1926] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:52 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:43:52.451575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffaae1-60f2-4db3-9ed1-91c53115feb7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:52.464733 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffaae1-60f2-4db3-9ed1-91c53115feb7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:52.469682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218eb8e-d307-48dd-a751-b002f2c732fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:52.473470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218eb8e-d307-48dd-a751-b002f2c732fd admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.473470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218eb8e-d307-48dd-a751-b002f2c732fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.473470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218eb8e-d307-48dd-a751-b002f2c732fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.473470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218eb8e-d307-48dd-a751-b002f2c732fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:52.473844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 965/1927] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:52 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:43:52.473942 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218eb8e-d307-48dd-a751-b002f2c732fd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:52.476206 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d5a63-8d00-4d9c-bb6c-fc2a0e91edeb admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:52.486445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 963/1928] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:43:52.487185 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d5a63-8d00-4d9c-bb6c-fc2a0e91edeb admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:52.490533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218eb8e-d307-48dd-a751-b002f2c732fd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:52.492326 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d359e65-b787-4e81-af98-ba1b6ece9b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:52.492926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d359e65-b787-4e81-af98-ba1b6ece9b1a admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.493217 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d359e65-b787-4e81-af98-ba1b6ece9b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.493506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d359e65-b787-4e81-af98-ba1b6ece9b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.494320 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d359e65-b787-4e81-af98-ba1b6ece9b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:52.499244 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d359e65-b787-4e81-af98-ba1b6ece9b1a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:52.500837 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218eb8e-d307-48dd-a751-b002f2c732fd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:52.505624 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe040d-9902-4e09-8400-564286ff303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:52.506290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe040d-9902-4e09-8400-564286ff303c admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.506547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe040d-9902-4e09-8400-564286ff303c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.509753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe040d-9902-4e09-8400-564286ff303c admin admin] PATH_INFO: `/v3/projects/fb8575fe19cd4713bfd2123203090d33/users/f2012332a2884c23ae18fcf7682b6584/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.509869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 966/1929] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:52.511611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d359e65-b787-4e81-af98-ba1b6ece9b1a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:52.522551 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe040d-9902-4e09-8400-564286ff303c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb8575fe19cd4713bfd2123203090d33, user_id=f2012332a2884c23ae18fcf7682b6584, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:52.527990 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d359e65-b787-4e81-af98-ba1b6ece9b1a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:52.528128 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe040d-9902-4e09-8400-564286ff303c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:52.529333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ec125-f8e7-4f5c-8968-9d7bf50fb344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:52.529945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ec125-f8e7-4f5c-8968-9d7bf50fb344 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.530229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ec125-f8e7-4f5c-8968-9d7bf50fb344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.530510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ec125-f8e7-4f5c-8968-9d7bf50fb344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.531154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ec125-f8e7-4f5c-8968-9d7bf50fb344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:52.532868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ec125-f8e7-4f5c-8968-9d7bf50fb344 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:52.544321 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 967/1930] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:52.548295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ec125-f8e7-4f5c-8968-9d7bf50fb344 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:52.557673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ec125-f8e7-4f5c-8968-9d7bf50fb344 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:52.562305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ec84e-1deb-40f5-9c1f-943c72d48c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:52.562937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ec84e-1deb-40f5-9c1f-943c72d48c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.563207 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ec84e-1deb-40f5-9c1f-943c72d48c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.563484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ec84e-1deb-40f5-9c1f-943c72d48c59 admin admin] PATH_INFO: `/v3/projects/efaab2b40d614e65b54381598e1c8d97/users/b827dcaac46d47558a6b211a6bb79bd3/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.577996 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ec84e-1deb-40f5-9c1f-943c72d48c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efaab2b40d614e65b54381598e1c8d97, user_id=b827dcaac46d47558a6b211a6bb79bd3, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:52.580615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ec84e-1deb-40f5-9c1f-943c72d48c59 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:52.654852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 964/1931] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:52 2022] PUT /identity/v3/projects/fb8575fe19cd4713bfd2123203090d33/users/f2012332a2884c23ae18fcf7682b6584/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:52.658707 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe040d-9902-4e09-8400-564286ff303c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:52.699851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 968/1932] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:52 2022] PUT /identity/v3/projects/efaab2b40d614e65b54381598e1c8d97/users/b827dcaac46d47558a6b211a6bb79bd3/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:52.710398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d87487-2188-4767-b4c8-34cb6d9b543e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.710724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d87487-2188-4767-b4c8-34cb6d9b543e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.711009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d87487-2188-4767-b4c8-34cb6d9b543e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.720497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe040d-9902-4e09-8400-564286ff303c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:52.739447 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-70d87487-2188-4767-b4c8-34cb6d9b543e None None] MFA Rules not processed for user `b827dcaac46d47558a6b211a6bb79bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:52.740701 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-70d87487-2188-4767-b4c8-34cb6d9b543e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:52.777772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdd8b6-728a-4f7c-8c52-15236d684c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:52.778419 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd8b6-728a-4f7c-8c52-15236d684c98 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.778778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd8b6-728a-4f7c-8c52-15236d684c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.779052 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd8b6-728a-4f7c-8c52-15236d684c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.779812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdd8b6-728a-4f7c-8c52-15236d684c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:52.781776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdd8b6-728a-4f7c-8c52-15236d684c98 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:52.796181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 965/1933] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:43:52.800680 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:52.802166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdd8b6-728a-4f7c-8c52-15236d684c98 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:52.815169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdd8b6-728a-4f7c-8c52-15236d684c98 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:52.819303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e7b0d-8394-4f1a-8984-431f4ea4bcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:52.819962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e7b0d-8394-4f1a-8984-431f4ea4bcf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.820246 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e7b0d-8394-4f1a-8984-431f4ea4bcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.820528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e7b0d-8394-4f1a-8984-431f4ea4bcf4 admin admin] PATH_INFO: `/v3/projects/fb8575fe19cd4713bfd2123203090d33/users/f2012332a2884c23ae18fcf7682b6584/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.823867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e7b0d-8394-4f1a-8984-431f4ea4bcf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb8575fe19cd4713bfd2123203090d33, user_id=f2012332a2884c23ae18fcf7682b6584, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:52.824835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 969/1934] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:43:52.826712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e7b0d-8394-4f1a-8984-431f4ea4bcf4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:52.829388 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d87487-2188-4767-b4c8-34cb6d9b543e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:52.837450 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 966/1935] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:52 2022] PUT /identity/v3/projects/fb8575fe19cd4713bfd2123203090d33/users/f2012332a2884c23ae18fcf7682b6584/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:52.841067 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d87487-2188-4767-b4c8-34cb6d9b543e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:52.850208 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe3468-dae8-4168-85a3-431862d941d2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.850507 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe3468-dae8-4168-85a3-431862d941d2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.850789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe3468-dae8-4168-85a3-431862d941d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.879207 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bdfe3468-dae8-4168-85a3-431862d941d2 None None] MFA Rules not processed for user `f2012332a2884c23ae18fcf7682b6584`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:52.880528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bdfe3468-dae8-4168-85a3-431862d941d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:52.888158 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:52.900878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65ce01-6fd2-42b9-8373-1b68b5f9dfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:52.901672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65ce01-6fd2-42b9-8373-1b68b5f9dfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:52.901960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65ce01-6fd2-42b9-8373-1b68b5f9dfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:52.902230 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65ce01-6fd2-42b9-8373-1b68b5f9dfc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:52.902872 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65ce01-6fd2-42b9-8373-1b68b5f9dfc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:52.904775 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65ce01-6fd2-42b9-8373-1b68b5f9dfc8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:52.955918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 967/1936] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:43:52.970519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe3468-dae8-4168-85a3-431862d941d2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:52.972951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bdfe3468-dae8-4168-85a3-431862d941d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:53.003047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 970/1937] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:52 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:43:53.003998 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65ce01-6fd2-42b9-8373-1b68b5f9dfc8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:53.038251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe3468-dae8-4168-85a3-431862d941d2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:53.079072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65ce01-6fd2-42b9-8373-1b68b5f9dfc8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:53.084204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8cf3f-b439-4c8f-9c35-d9fb5a345e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:53.084834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8cf3f-b439-4c8f-9c35-d9fb5a345e9d admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:53.085103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8cf3f-b439-4c8f-9c35-d9fb5a345e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:53.085421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8cf3f-b439-4c8f-9c35-d9fb5a345e9d admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:53.086088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8cf3f-b439-4c8f-9c35-d9fb5a345e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:53.088093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8cf3f-b439-4c8f-9c35-d9fb5a345e9d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:53.118944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c356f45-c44b-4edd-8e17-9d3d9a5b27cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:53.123211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c356f45-c44b-4edd-8e17-9d3d9a5b27cb service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:53.123876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c356f45-c44b-4edd-8e17-9d3d9a5b27cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:53.124344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c356f45-c44b-4edd-8e17-9d3d9a5b27cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:53.203138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 971/1938] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:53 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:43:53.203138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8cf3f-b439-4c8f-9c35-d9fb5a345e9d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:53.214171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8cf3f-b439-4c8f-9c35-d9fb5a345e9d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:53.232165 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3594249-adee-47f3-87c6-17a5689388a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:53.233959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3594249-adee-47f3-87c6-17a5689388a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:53.234306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3594249-adee-47f3-87c6-17a5689388a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:53.234592 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3594249-adee-47f3-87c6-17a5689388a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:53.235240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3594249-adee-47f3-87c6-17a5689388a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:53.236844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3594249-adee-47f3-87c6-17a5689388a7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:53.263700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c356f45-c44b-4edd-8e17-9d3d9a5b27cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:53.264302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 972/1939] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:53.265475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c356f45-c44b-4edd-8e17-9d3d9a5b27cb service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:53.272657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3594249-adee-47f3-87c6-17a5689388a7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:53.281999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 968/1940] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:53.284869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3594249-adee-47f3-87c6-17a5689388a7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:53.294421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f17e8-1d25-4703-a999-c219d7e382ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:53.296378 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f17e8-1d25-4703-a999-c219d7e382ee admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:53.296660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f17e8-1d25-4703-a999-c219d7e382ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:53.297906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f17e8-1d25-4703-a999-c219d7e382ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:53.298867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f17e8-1d25-4703-a999-c219d7e382ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:53.304158 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f17e8-1d25-4703-a999-c219d7e382ee admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:53.349772 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 973/1941] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:43:53.354283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c356f45-c44b-4edd-8e17-9d3d9a5b27cb service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:53.367932 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c356f45-c44b-4edd-8e17-9d3d9a5b27cb service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:53.374496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdefc3-1dc9-44dc-bac5-99c28011ba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:53.374635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdefc3-1dc9-44dc-bac5-99c28011ba21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:53.375164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdefc3-1dc9-44dc-bac5-99c28011ba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:53.375698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdefc3-1dc9-44dc-bac5-99c28011ba21 admin admin] PATH_INFO: `/v3/projects/179bbe58efec4d40bc4c44dfd6086f07/users/b743b55c37614a888fe59c968ff5c81c/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:53.395875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdefc3-1dc9-44dc-bac5-99c28011ba21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=179bbe58efec4d40bc4c44dfd6086f07, user_id=b743b55c37614a888fe59c968ff5c81c, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:53.398766 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdefc3-1dc9-44dc-bac5-99c28011ba21 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:53.444500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f17e8-1d25-4703-a999-c219d7e382ee admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:53.455822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f17e8-1d25-4703-a999-c219d7e382ee admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:53.467877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd7484-f84a-4de0-934f-01581479e128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:53.472408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd7484-f84a-4de0-934f-01581479e128 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:53.472408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd7484-f84a-4de0-934f-01581479e128 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:53.472408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd7484-f84a-4de0-934f-01581479e128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:53.472408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c1fd7484-f84a-4de0-934f-01581479e128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:53.506977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 969/1942] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:53 2022] PUT /identity/v3/projects/179bbe58efec4d40bc4c44dfd6086f07/users/b743b55c37614a888fe59c968ff5c81c/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:53.519654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbcb85-d4c8-4d26-895b-12e583fd87be None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:53.519947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbcb85-d4c8-4d26-895b-12e583fd87be None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:53.520224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbcb85-d4c8-4d26-895b-12e583fd87be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:53.534066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd7484-f84a-4de0-934f-01581479e128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:53.535445 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd7484-f84a-4de0-934f-01581479e128 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:53.545421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 974/1943] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:53.549452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0bdbcb85-d4c8-4d26-895b-12e583fd87be None None] MFA Rules not processed for user `b743b55c37614a888fe59c968ff5c81c`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:53.550673 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0bdbcb85-d4c8-4d26-895b-12e583fd87be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:53.626385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 970/1944] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:53.632616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd7484-f84a-4de0-934f-01581479e128 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:53.644066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd7484-f84a-4de0-934f-01581479e128 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:53.703495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4056377-dd48-4a94-8a24-4b0ea9de3a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:53.704094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4056377-dd48-4a94-8a24-4b0ea9de3a35 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:53.704369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4056377-dd48-4a94-8a24-4b0ea9de3a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:53.704641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4056377-dd48-4a94-8a24-4b0ea9de3a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:53.705301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4056377-dd48-4a94-8a24-4b0ea9de3a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:53.707184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4056377-dd48-4a94-8a24-4b0ea9de3a35 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:53.824691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 975/1945] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:43:53 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:53.828445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbcb85-d4c8-4d26-895b-12e583fd87be None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:53.839972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbcb85-d4c8-4d26-895b-12e583fd87be None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:53.906463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47084ab2-ae1c-43b3-9d29-8c976fa19f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:53.906654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47084ab2-ae1c-43b3-9d29-8c976fa19f0c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:53.906918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47084ab2-ae1c-43b3-9d29-8c976fa19f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:53.907195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47084ab2-ae1c-43b3-9d29-8c976fa19f0c admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:53.908142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47084ab2-ae1c-43b3-9d29-8c976fa19f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:53.910787 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47084ab2-ae1c-43b3-9d29-8c976fa19f0c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:54.019174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 971/1946] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:43:53 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:43:54.023099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4056377-dd48-4a94-8a24-4b0ea9de3a35 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:54.034370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4056377-dd48-4a94-8a24-4b0ea9de3a35 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:54.038962 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbd919-9a8e-4437-b00a-d334d9e297ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:54.039831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbd919-9a8e-4437-b00a-d334d9e297ce admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:54.040116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbd919-9a8e-4437-b00a-d334d9e297ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:54.040409 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbd919-9a8e-4437-b00a-d334d9e297ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:54.041084 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbd919-9a8e-4437-b00a-d334d9e297ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:54.043332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbd919-9a8e-4437-b00a-d334d9e297ce admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:54.057930 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 976/1947] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:54.059163 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47084ab2-ae1c-43b3-9d29-8c976fa19f0c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:54.074315 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47084ab2-ae1c-43b3-9d29-8c976fa19f0c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:54.084298 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08e64c-7b22-43ef-843c-89d84c7f99ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:54.085071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08e64c-7b22-43ef-843c-89d84c7f99ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:54.087683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08e64c-7b22-43ef-843c-89d84c7f99ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:54.088005 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08e64c-7b22-43ef-843c-89d84c7f99ad admin admin] PATH_INFO: `/v3/projects/f968f47733de48299aab1889c2ab09be/users/b1bc33174dae41839e036b156e65ce29/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:54.104962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08e64c-7b22-43ef-843c-89d84c7f99ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f968f47733de48299aab1889c2ab09be, user_id=b1bc33174dae41839e036b156e65ce29, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:54.107702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08e64c-7b22-43ef-843c-89d84c7f99ad admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:54.179379 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 972/1948] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:54 2022] PUT /identity/v3/projects/f968f47733de48299aab1889c2ab09be/users/b1bc33174dae41839e036b156e65ce29/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:43:54.186501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbd919-9a8e-4437-b00a-d334d9e297ce admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:54.194137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbd919-9a8e-4437-b00a-d334d9e297ce admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:54.258773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74167b2-1476-4241-abb9-ae019a8f4184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:54.259480 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74167b2-1476-4241-abb9-ae019a8f4184 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:54.259868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74167b2-1476-4241-abb9-ae019a8f4184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:54.260151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74167b2-1476-4241-abb9-ae019a8f4184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:54.261838 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74167b2-1476-4241-abb9-ae019a8f4184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:54.263680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74167b2-1476-4241-abb9-ae019a8f4184 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:54.281132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 977/1949] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:43:54.286738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08e64c-7b22-43ef-843c-89d84c7f99ad admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:54.299842 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08e64c-7b22-43ef-843c-89d84c7f99ad admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:54.304683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ec966-63f2-48ad-99c8-b335544c2948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:54.305613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ec966-63f2-48ad-99c8-b335544c2948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:54.306102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ec966-63f2-48ad-99c8-b335544c2948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:54.306618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ec966-63f2-48ad-99c8-b335544c2948 admin admin] PATH_INFO: `/v3/projects/f968f47733de48299aab1889c2ab09be/users/b1bc33174dae41839e036b156e65ce29/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:54.309297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ec966-63f2-48ad-99c8-b335544c2948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f968f47733de48299aab1889c2ab09be, user_id=b1bc33174dae41839e036b156e65ce29, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:54.312148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ec966-63f2-48ad-99c8-b335544c2948 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:54.336165 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 973/1950] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:43:54 2022] PUT /identity/v3/projects/f968f47733de48299aab1889c2ab09be/users/b1bc33174dae41839e036b156e65ce29/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:43:54.336590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88dc6-940e-4c72-becf-e4146667a3f8 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:54.336885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88dc6-940e-4c72-becf-e4146667a3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:54.337656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88dc6-940e-4c72-becf-e4146667a3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:54.366811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-aca88dc6-940e-4c72-becf-e4146667a3f8 None None] MFA Rules not processed for user `b1bc33174dae41839e036b156e65ce29`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:43:54.368236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-aca88dc6-940e-4c72-becf-e4146667a3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:43:54.446709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 978/1951] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:43:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:43:54.609123 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ec966-63f2-48ad-99c8-b335544c2948 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:54.670742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ec966-63f2-48ad-99c8-b335544c2948 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:54.676240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92656f1d-8a6f-4055-9421-c10b3fbe82e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:54.676973 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656f1d-8a6f-4055-9421-c10b3fbe82e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:54.677376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656f1d-8a6f-4055-9421-c10b3fbe82e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:54.677482 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656f1d-8a6f-4055-9421-c10b3fbe82e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:54.689876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92656f1d-8a6f-4055-9421-c10b3fbe82e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:54.691870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92656f1d-8a6f-4055-9421-c10b3fbe82e2 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:54.703821 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 974/1952] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:57.025679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:57.107893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:57.702280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca88dc6-940e-4c72-becf-e4146667a3f8 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:43:57.716189 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca88dc6-940e-4c72-becf-e4146667a3f8 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:43:57.726040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf76b46-0f6d-4a4e-8e54-2fba09c8d3f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:43:57.727712 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf76b46-0f6d-4a4e-8e54-2fba09c8d3f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:43:57.728225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf76b46-0f6d-4a4e-8e54-2fba09c8d3f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:43:57.728565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf76b46-0f6d-4a4e-8e54-2fba09c8d3f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:43:57.862895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf76b46-0f6d-4a4e-8e54-2fba09c8d3f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:43:57.864479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf76b46-0f6d-4a4e-8e54-2fba09c8d3f9 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:43:57.881312 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 979/1953] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:43:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:43:59.320815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:43:59.421975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:00.796339 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92656f1d-8a6f-4055-9421-c10b3fbe82e2 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:00.857890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92656f1d-8a6f-4055-9421-c10b3fbe82e2 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:00.862491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be630958-9f78-48f1-b65d-7ab5996bce04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:00.863120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be630958-9f78-48f1-b65d-7ab5996bce04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:00.863413 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be630958-9f78-48f1-b65d-7ab5996bce04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:00.863684 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be630958-9f78-48f1-b65d-7ab5996bce04 admin admin] PATH_INFO: `/v3/users/45e69b2d0b354d2ebbf3b426fb17c46f` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:00.864799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be630958-9f78-48f1-b65d-7ab5996bce04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e69b2d0b354d2ebbf3b426fb17c46f)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:00.866754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be630958-9f78-48f1-b65d-7ab5996bce04 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:01.088666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-be630958-9f78-48f1-b65d-7ab5996bce04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e69b2d0b354d2ebbf3b426fb17c46f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:01.089395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-be630958-9f78-48f1-b65d-7ab5996bce04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e69b2d0b354d2ebbf3b426fb17c46f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:01.101374 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-be630958-9f78-48f1-b65d-7ab5996bce04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e69b2d0b354d2ebbf3b426fb17c46f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:01.108894 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-be630958-9f78-48f1-b65d-7ab5996bce04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e69b2d0b354d2ebbf3b426fb17c46f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:01.109664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-be630958-9f78-48f1-b65d-7ab5996bce04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e69b2d0b354d2ebbf3b426fb17c46f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:01.201917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 975/1954] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:00 2022] DELETE /identity/v3/users/45e69b2d0b354d2ebbf3b426fb17c46f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:01.206615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18594f53-071d-4655-bcc9-e405653e25bc None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:01.207540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18594f53-071d-4655-bcc9-e405653e25bc None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:01.208135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18594f53-071d-4655-bcc9-e405653e25bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:01.232981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-18594f53-071d-4655-bcc9-e405653e25bc None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:01.247056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-18594f53-071d-4655-bcc9-e405653e25bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:01.346191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 980/1955] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:01.353792 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be630958-9f78-48f1-b65d-7ab5996bce04 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:01.355803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-be630958-9f78-48f1-b65d-7ab5996bce04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:01.417008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be630958-9f78-48f1-b65d-7ab5996bce04 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:01.421277 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b5515-29fd-4366-a45b-e06ca10016a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:01.421986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b5515-29fd-4366-a45b-e06ca10016a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:01.422378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b5515-29fd-4366-a45b-e06ca10016a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:01.422745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b5515-29fd-4366-a45b-e06ca10016a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:01.438688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b5515-29fd-4366-a45b-e06ca10016a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:01.438688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b5515-29fd-4366-a45b-e06ca10016a6 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:01.447808 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 976/1956] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:01.700869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:01.784708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:02.173373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18594f53-071d-4655-bcc9-e405653e25bc None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:02.174798 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-18594f53-071d-4655-bcc9-e405653e25bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:02.199430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18594f53-071d-4655-bcc9-e405653e25bc None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:02.207506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:02.208330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:02.209033 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:02.209425 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] PATH_INFO: `/v3/projects/88872d40b8e64ad68c57312cebbedb1a` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:02.210817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=88872d40b8e64ad68c57312cebbedb1a)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:02.212935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:02.345375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88872d40b8e64ad68c57312cebbedb1a', 'request_id': 'req-8ee3934c-f0e5-4828-990e-1b05b169ab6a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:02.411600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88872d40b8e64ad68c57312cebbedb1a', 'request_id': 'req-8ee3934c-f0e5-4828-990e-1b05b169ab6a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:02.420541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88872d40b8e64ad68c57312cebbedb1a', 'request_id': 'req-8ee3934c-f0e5-4828-990e-1b05b169ab6a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:02.434322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] The token cache is being invalidate because project 88872d40b8e64ad68c57312cebbedb1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:02.434771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:02.435645 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:02.437367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 981/1957] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:02 2022] DELETE /identity/v3/projects/88872d40b8e64ad68c57312cebbedb1a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:02.441322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b5515-29fd-4366-a45b-e06ca10016a6 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:02.453452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b5515-29fd-4366-a45b-e06ca10016a6 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:02.514788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba637e-cd48-43a8-91e1-ba17daa1e5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:02.515477 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba637e-cd48-43a8-91e1-ba17daa1e5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:02.515818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba637e-cd48-43a8-91e1-ba17daa1e5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:02.516181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba637e-cd48-43a8-91e1-ba17daa1e5b7 admin admin] PATH_INFO: `/v3/users/ec61eaa1702d4846b5a25700b9cb9cc0` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:02.517409 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba637e-cd48-43a8-91e1-ba17daa1e5b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec61eaa1702d4846b5a25700b9cb9cc0)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:02.519310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba637e-cd48-43a8-91e1-ba17daa1e5b7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:02.759599 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-68ba637e-cd48-43a8-91e1-ba17daa1e5b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec61eaa1702d4846b5a25700b9cb9cc0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:02.760388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-68ba637e-cd48-43a8-91e1-ba17daa1e5b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec61eaa1702d4846b5a25700b9cb9cc0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:02.775402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-68ba637e-cd48-43a8-91e1-ba17daa1e5b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec61eaa1702d4846b5a25700b9cb9cc0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:02.797336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-68ba637e-cd48-43a8-91e1-ba17daa1e5b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec61eaa1702d4846b5a25700b9cb9cc0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:02.798296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-68ba637e-cd48-43a8-91e1-ba17daa1e5b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec61eaa1702d4846b5a25700b9cb9cc0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:02.912451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 977/1958] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:02 2022] DELETE /identity/v3/users/ec61eaa1702d4846b5a25700b9cb9cc0 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:03.467720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:03.469458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:03.517767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba637e-cd48-43a8-91e1-ba17daa1e5b7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:03.519346 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-68ba637e-cd48-43a8-91e1-ba17daa1e5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:03.543587 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3934c-f0e5-4828-990e-1b05b169ab6a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:03.587152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:03.605315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:03.614412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b204fe0-01d8-4b8c-9dd5-afc23e8410e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:03.615332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b204fe0-01d8-4b8c-9dd5-afc23e8410e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:03.615608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b204fe0-01d8-4b8c-9dd5-afc23e8410e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:03.615879 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b204fe0-01d8-4b8c-9dd5-afc23e8410e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:03.617928 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4b204fe0-01d8-4b8c-9dd5-afc23e8410e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:03.625242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba637e-cd48-43a8-91e1-ba17daa1e5b7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:03.630067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:03.630772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:03.631121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:03.631497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] PATH_INFO: `/v3/projects/a326e29e7c13401fa8c57ee4c4881893` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:03.632717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a326e29e7c13401fa8c57ee4c4881893)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:03.634881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:03.681915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b204fe0-01d8-4b8c-9dd5-afc23e8410e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:03.683485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b204fe0-01d8-4b8c-9dd5-afc23e8410e7 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:03.692806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 982/1959] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:03.759273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a326e29e7c13401fa8c57ee4c4881893', 'request_id': 'req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:03.812929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a326e29e7c13401fa8c57ee4c4881893', 'request_id': 'req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:03.819071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a326e29e7c13401fa8c57ee4c4881893', 'request_id': 'req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:03.831107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] The token cache is being invalidate because project a326e29e7c13401fa8c57ee4c4881893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:03.831400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:03.832054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:03.833597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 978/1960] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:03 2022] DELETE /identity/v3/projects/a326e29e7c13401fa8c57ee4c4881893 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:03.837589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b204fe0-01d8-4b8c-9dd5-afc23e8410e7 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:03.848565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b204fe0-01d8-4b8c-9dd5-afc23e8410e7 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:03.907565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01d46a-c2da-4813-8494-2d2ddc7c64a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:03.908499 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01d46a-c2da-4813-8494-2d2ddc7c64a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:03.908779 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01d46a-c2da-4813-8494-2d2ddc7c64a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:03.909058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01d46a-c2da-4813-8494-2d2ddc7c64a3 admin admin] PATH_INFO: `/v3/users/f2012332a2884c23ae18fcf7682b6584` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:03.910251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01d46a-c2da-4813-8494-2d2ddc7c64a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2012332a2884c23ae18fcf7682b6584)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:03.912181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01d46a-c2da-4813-8494-2d2ddc7c64a3 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:04.191852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:04.193749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:04.208962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa2f20-a9ec-47aa-b6b1-1ad32bbdd1ed admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:04.214363 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcce87d-28f0-447d-9c8c-5bc161383e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:04.215088 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcce87d-28f0-447d-9c8c-5bc161383e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:04.215357 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcce87d-28f0-447d-9c8c-5bc161383e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:04.215636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcce87d-28f0-447d-9c8c-5bc161383e61 admin admin] PATH_INFO: `/v3/users/b1af3769663f4d1eb27a579b08822fb6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:04.216801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcce87d-28f0-447d-9c8c-5bc161383e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1af3769663f4d1eb27a579b08822fb6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:04.218772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcce87d-28f0-447d-9c8c-5bc161383e61 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:04.227203 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6b01d46a-c2da-4813-8494-2d2ddc7c64a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2012332a2884c23ae18fcf7682b6584'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:04.240043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6b01d46a-c2da-4813-8494-2d2ddc7c64a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2012332a2884c23ae18fcf7682b6584'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:04.320715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6b01d46a-c2da-4813-8494-2d2ddc7c64a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2012332a2884c23ae18fcf7682b6584'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:04.328602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6b01d46a-c2da-4813-8494-2d2ddc7c64a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2012332a2884c23ae18fcf7682b6584'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:04.329288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6b01d46a-c2da-4813-8494-2d2ddc7c64a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2012332a2884c23ae18fcf7682b6584'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:04.335184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 983/1961] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:03 2022] DELETE /identity/v3/users/f2012332a2884c23ae18fcf7682b6584 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:04.432420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffcce87d-28f0-447d-9c8c-5bc161383e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1af3769663f4d1eb27a579b08822fb6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:04.433264 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffcce87d-28f0-447d-9c8c-5bc161383e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1af3769663f4d1eb27a579b08822fb6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:04.458581 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffcce87d-28f0-447d-9c8c-5bc161383e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1af3769663f4d1eb27a579b08822fb6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:04.473385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffcce87d-28f0-447d-9c8c-5bc161383e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1af3769663f4d1eb27a579b08822fb6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:04.476907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffcce87d-28f0-447d-9c8c-5bc161383e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1af3769663f4d1eb27a579b08822fb6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:04.562395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 979/1962] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:04 2022] DELETE /identity/v3/users/b1af3769663f4d1eb27a579b08822fb6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:04.569073 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a44c7-e1dc-4383-9da2-fdf6e3de26cd None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:04.569549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a44c7-e1dc-4383-9da2-fdf6e3de26cd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:04.569658 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a44c7-e1dc-4383-9da2-fdf6e3de26cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:04.589880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e15a44c7-e1dc-4383-9da2-fdf6e3de26cd None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:04.591198 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e15a44c7-e1dc-4383-9da2-fdf6e3de26cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:04.641080 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:04.655868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 984/1963] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:04.666964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcce87d-28f0-447d-9c8c-5bc161383e61 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:04.668821 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ffcce87d-28f0-447d-9c8c-5bc161383e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:04.710909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:04.750533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcce87d-28f0-447d-9c8c-5bc161383e61 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:04.754939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70444f34-c9d6-4a9f-be2a-248cd0a65ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:04.755564 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70444f34-c9d6-4a9f-be2a-248cd0a65ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:04.755935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70444f34-c9d6-4a9f-be2a-248cd0a65ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:04.756524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70444f34-c9d6-4a9f-be2a-248cd0a65ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:04.767365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70444f34-c9d6-4a9f-be2a-248cd0a65ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:04.768793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70444f34-c9d6-4a9f-be2a-248cd0a65ee9 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:04.778973 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 980/1964] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:04.915257 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a44c7-e1dc-4383-9da2-fdf6e3de26cd None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:04.917985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e15a44c7-e1dc-4383-9da2-fdf6e3de26cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:04.931484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a44c7-e1dc-4383-9da2-fdf6e3de26cd None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:04.938560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:04.941366 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:04.941845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:04.942312 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] PATH_INFO: `/v3/projects/fb8575fe19cd4713bfd2123203090d33` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:04.943772 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb8575fe19cd4713bfd2123203090d33)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:04.946040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:05.058347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb8575fe19cd4713bfd2123203090d33', 'request_id': 'req-52fca27e-1047-4adc-ae46-fdd4a472022a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.178961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb8575fe19cd4713bfd2123203090d33', 'request_id': 'req-52fca27e-1047-4adc-ae46-fdd4a472022a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.188660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb8575fe19cd4713bfd2123203090d33', 'request_id': 'req-52fca27e-1047-4adc-ae46-fdd4a472022a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.221142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] The token cache is being invalidate because project fb8575fe19cd4713bfd2123203090d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:05.221467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.233011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.233011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 985/1965] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:04 2022] DELETE /identity/v3/projects/fb8575fe19cd4713bfd2123203090d33 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:05.238692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe28a77-bad5-4076-9a7f-e5c41d781d2c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:05.239193 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe28a77-bad5-4076-9a7f-e5c41d781d2c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:05.239963 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe28a77-bad5-4076-9a7f-e5c41d781d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:05.266750 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7fe28a77-bad5-4076-9a7f-e5c41d781d2c None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:05.269803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7fe28a77-bad5-4076-9a7f-e5c41d781d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:05.323300 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:05.324954 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:05.360856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 981/1966] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:05.370847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0ebe-86bc-49d9-94aa-285e95bc07a1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:05.371274 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0ebe-86bc-49d9-94aa-285e95bc07a1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:05.371739 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0ebe-86bc-49d9-94aa-285e95bc07a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:05.387837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fca27e-1047-4adc-ae46-fdd4a472022a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:05.391991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8b853-7d55-4195-8927-f90bfe64565e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:05.392606 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8b853-7d55-4195-8927-f90bfe64565e service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:05.392972 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8b853-7d55-4195-8927-f90bfe64565e service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:05.393154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8b853-7d55-4195-8927-f90bfe64565e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:05.394263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-72ad0ebe-86bc-49d9-94aa-285e95bc07a1 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:05.394960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fcd8b853-7d55-4195-8927-f90bfe64565e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:05.395559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-72ad0ebe-86bc-49d9-94aa-285e95bc07a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:05.408671 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 982/1967] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:05.409623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0ebe-86bc-49d9-94aa-285e95bc07a1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:05.420124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0ebe-86bc-49d9-94aa-285e95bc07a1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:05.428360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc197e8-bb55-4100-9dd4-351fc175fe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:05.429225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc197e8-bb55-4100-9dd4-351fc175fe76 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:05.429757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc197e8-bb55-4100-9dd4-351fc175fe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:05.430133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc197e8-bb55-4100-9dd4-351fc175fe76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:05.430851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc197e8-bb55-4100-9dd4-351fc175fe76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:05.431223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc197e8-bb55-4100-9dd4-351fc175fe76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:05.433589 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc197e8-bb55-4100-9dd4-351fc175fe76 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:05.450804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 983/1968] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:44:05.451857 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc197e8-bb55-4100-9dd4-351fc175fe76 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:05.453724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8fc197e8-bb55-4100-9dd4-351fc175fe76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:05.471160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc197e8-bb55-4100-9dd4-351fc175fe76 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:05.473159 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8b853-7d55-4195-8927-f90bfe64565e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:05.474636 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8b853-7d55-4195-8927-f90bfe64565e service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:05.476361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:05.477080 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:05.477558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:05.477903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] PATH_INFO: `/v3/projects/316831c42cae4ad9b12ee34962b32fe8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:05.479762 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=316831c42cae4ad9b12ee34962b32fe8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:05.481986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:05.485605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 986/1969] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:44:05.494225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8b853-7d55-4195-8927-f90bfe64565e service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:05.506362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8b853-7d55-4195-8927-f90bfe64565e service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:05.512373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19651dc0-e970-45c8-8dd9-fdb8df24e4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:05.513064 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19651dc0-e970-45c8-8dd9-fdb8df24e4ff admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:05.513383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19651dc0-e970-45c8-8dd9-fdb8df24e4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:05.513662 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19651dc0-e970-45c8-8dd9-fdb8df24e4ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:05.514369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19651dc0-e970-45c8-8dd9-fdb8df24e4ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:05.516290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19651dc0-e970-45c8-8dd9-fdb8df24e4ff admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:05.577122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316831c42cae4ad9b12ee34962b32fe8', 'request_id': 'req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.614529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 987/1970] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:05 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:05.618532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19651dc0-e970-45c8-8dd9-fdb8df24e4ff admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:05.629820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316831c42cae4ad9b12ee34962b32fe8', 'request_id': 'req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.636026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316831c42cae4ad9b12ee34962b32fe8', 'request_id': 'req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.647907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] The token cache is being invalidate because project 316831c42cae4ad9b12ee34962b32fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:05.648461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.649384 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.654926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 984/1971] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:05 2022] DELETE /identity/v3/projects/316831c42cae4ad9b12ee34962b32fe8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:05.656160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:05.657633 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:05.701952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19651dc0-e970-45c8-8dd9-fdb8df24e4ff admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:05.709622 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc296e8-2110-47fa-9af0-cf62d24f46d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:05.710725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc296e8-2110-47fa-9af0-cf62d24f46d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:05.711474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc296e8-2110-47fa-9af0-cf62d24f46d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:05.711927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc296e8-2110-47fa-9af0-cf62d24f46d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:05.713351 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc296e8-2110-47fa-9af0-cf62d24f46d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:05.716922 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc296e8-2110-47fa-9af0-cf62d24f46d8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:05.740217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb566d76-8b59-4a25-a8a7-44078a6e4b8a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:05.746988 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad11b1-9bbe-413b-b06b-0ea57cbed7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:05.747736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad11b1-9bbe-413b-b06b-0ea57cbed7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:05.748133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad11b1-9bbe-413b-b06b-0ea57cbed7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:05.748488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad11b1-9bbe-413b-b06b-0ea57cbed7fc admin admin] PATH_INFO: `/v3/users/63f1d96131804b38b0936403348a5167` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:05.749851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad11b1-9bbe-413b-b06b-0ea57cbed7fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f1d96131804b38b0936403348a5167)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:05.752052 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad11b1-9bbe-413b-b06b-0ea57cbed7fc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:05.789306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 988/1972] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:05 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:05.793970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc296e8-2110-47fa-9af0-cf62d24f46d8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:05.795796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-afc296e8-2110-47fa-9af0-cf62d24f46d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:05.796548 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:05.809724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc296e8-2110-47fa-9af0-cf62d24f46d8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:05.814569 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e009-ca79-4bf4-925b-137eb9ec14a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:05.815200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e009-ca79-4bf4-925b-137eb9ec14a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:05.815513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e009-ca79-4bf4-925b-137eb9ec14a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:05.815799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e009-ca79-4bf4-925b-137eb9ec14a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:05.816469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e009-ca79-4bf4-925b-137eb9ec14a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:05.818094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e009-ca79-4bf4-925b-137eb9ec14a4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:05.828904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 989/1973] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:05.832879 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e009-ca79-4bf4-925b-137eb9ec14a4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:05.842655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e009-ca79-4bf4-925b-137eb9ec14a4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:05.847243 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13133c20-a5d1-4f84-a178-fad4b95b8975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:05.847823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13133c20-a5d1-4f84-a178-fad4b95b8975 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:05.848100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13133c20-a5d1-4f84-a178-fad4b95b8975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:05.848373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13133c20-a5d1-4f84-a178-fad4b95b8975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:05.849031 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13133c20-a5d1-4f84-a178-fad4b95b8975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:05.850631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13133c20-a5d1-4f84-a178-fad4b95b8975 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:05.858662 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:05.863397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 990/1974] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:05.867508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13133c20-a5d1-4f84-a178-fad4b95b8975 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:05.877778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13133c20-a5d1-4f84-a178-fad4b95b8975 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:05.882515 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fa481-fa1b-4c57-8112-0b0ae30273cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:05.883408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa481-fa1b-4c57-8112-0b0ae30273cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:05.883704 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa481-fa1b-4c57-8112-0b0ae30273cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:05.884022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa481-fa1b-4c57-8112-0b0ae30273cd admin admin] PATH_INFO: `/v3/projects/b4f07ecc049f4951a3e24639671f36a2/users/753a71dbb2af495cb9b760521487c01b/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:05.899756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fa481-fa1b-4c57-8112-0b0ae30273cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f07ecc049f4951a3e24639671f36a2, user_id=753a71dbb2af495cb9b760521487c01b, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:05.902895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fa481-fa1b-4c57-8112-0b0ae30273cd admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:05.925070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5aad11b1-9bbe-413b-b06b-0ea57cbed7fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f1d96131804b38b0936403348a5167'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.925768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5aad11b1-9bbe-413b-b06b-0ea57cbed7fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f1d96131804b38b0936403348a5167'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.938570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5aad11b1-9bbe-413b-b06b-0ea57cbed7fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f1d96131804b38b0936403348a5167'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.945218 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5aad11b1-9bbe-413b-b06b-0ea57cbed7fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f1d96131804b38b0936403348a5167'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.945908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-5aad11b1-9bbe-413b-b06b-0ea57cbed7fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f1d96131804b38b0936403348a5167'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:05.994477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 991/1975] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:05 2022] PUT /identity/v3/projects/b4f07ecc049f4951a3e24639671f36a2/users/753a71dbb2af495cb9b760521487c01b/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:06.005878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d41f9-0547-4ac7-a0dc-3038e70ea4c9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:06.006260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d41f9-0547-4ac7-a0dc-3038e70ea4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:06.006532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d41f9-0547-4ac7-a0dc-3038e70ea4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:06.023395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 985/1976] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:05 2022] DELETE /identity/v3/users/63f1d96131804b38b0936403348a5167 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:06.035356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f93d41f9-0547-4ac7-a0dc-3038e70ea4c9 None None] MFA Rules not processed for user `753a71dbb2af495cb9b760521487c01b`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:06.036554 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f93d41f9-0547-4ac7-a0dc-3038e70ea4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:06.111209 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 992/1977] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:06.115855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad11b1-9bbe-413b-b06b-0ea57cbed7fc admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:06.117318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5aad11b1-9bbe-413b-b06b-0ea57cbed7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:06.186616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad11b1-9bbe-413b-b06b-0ea57cbed7fc admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:06.191437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a883140-59bd-4755-b32f-5dd961bc58a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:06.192050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a883140-59bd-4755-b32f-5dd961bc58a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:06.192333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a883140-59bd-4755-b32f-5dd961bc58a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:06.192607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a883140-59bd-4755-b32f-5dd961bc58a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:06.193284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a883140-59bd-4755-b32f-5dd961bc58a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:06.195166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a883140-59bd-4755-b32f-5dd961bc58a4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:06.325233 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 986/1978] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:06 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:06.329575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d41f9-0547-4ac7-a0dc-3038e70ea4c9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:06.341028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d41f9-0547-4ac7-a0dc-3038e70ea4c9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:06.440998 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f625e-c30f-4408-8997-c456eb6a5386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:06.441763 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f625e-c30f-4408-8997-c456eb6a5386 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:06.442196 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f625e-c30f-4408-8997-c456eb6a5386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:06.442542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f625e-c30f-4408-8997-c456eb6a5386 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:06.443274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f625e-c30f-4408-8997-c456eb6a5386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:06.445866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f625e-c30f-4408-8997-c456eb6a5386 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:06.549177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 993/1979] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:06 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:06.551023 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a883140-59bd-4755-b32f-5dd961bc58a4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:06.551888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f625e-c30f-4408-8997-c456eb6a5386 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:06.558358 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0a883140-59bd-4755-b32f-5dd961bc58a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:06.566800 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f625e-c30f-4408-8997-c456eb6a5386 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:06.571841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b7c3f-e3b9-471e-b511-222ba4b8a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:06.577370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7c3f-e3b9-471e-b511-222ba4b8a1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:06.577370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7c3f-e3b9-471e-b511-222ba4b8a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:06.577370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7c3f-e3b9-471e-b511-222ba4b8a1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:06.577890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a883140-59bd-4755-b32f-5dd961bc58a4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:06.578357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b7c3f-e3b9-471e-b511-222ba4b8a1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:06.578357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b7c3f-e3b9-471e-b511-222ba4b8a1c8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:06.579607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:06.580557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:06.581189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:06.581736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef admin admin] PATH_INFO: `/v3/projects/d16f17a1216d4ba3ba744cac8a7e86b2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:06.583171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16f17a1216d4ba3ba744cac8a7e86b2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:06.586158 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 994/1980] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:06.589481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:06.591108 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b7c3f-e3b9-471e-b511-222ba4b8a1c8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:06.603282 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b7c3f-e3b9-471e-b511-222ba4b8a1c8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:06.609074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee792e-df8f-4e91-bc27-b5c8b7139be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:06.609840 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee792e-df8f-4e91-bc27-b5c8b7139be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:06.610208 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee792e-df8f-4e91-bc27-b5c8b7139be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:06.610500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee792e-df8f-4e91-bc27-b5c8b7139be4 admin admin] PATH_INFO: `/v3/projects/5892cdb0a2824006adbd8d2d3799726e/users/af11c2e882e0486b8eee0098d98820c8/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:06.625896 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee792e-df8f-4e91-bc27-b5c8b7139be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5892cdb0a2824006adbd8d2d3799726e, user_id=af11c2e882e0486b8eee0098d98820c8, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:06.628937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee792e-df8f-4e91-bc27-b5c8b7139be4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:06.722087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 995/1981] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:06 2022] PUT /identity/v3/projects/5892cdb0a2824006adbd8d2d3799726e/users/af11c2e882e0486b8eee0098d98820c8/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:06.726190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee792e-df8f-4e91-bc27-b5c8b7139be4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:06.731786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16f17a1216d4ba3ba744cac8a7e86b2', 'request_id': 'req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:06.805782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee792e-df8f-4e91-bc27-b5c8b7139be4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:06.807673 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16f17a1216d4ba3ba744cac8a7e86b2', 'request_id': 'req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:06.819936 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16f17a1216d4ba3ba744cac8a7e86b2', 'request_id': 'req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:06.841176 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef admin admin] The token cache is being invalidate because project d16f17a1216d4ba3ba744cac8a7e86b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:06.841682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:06.842361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-31ea046e-cf14-4e79-9f49-7cd0bdee72ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:06.846989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 987/1982] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:06 2022] DELETE /identity/v3/projects/d16f17a1216d4ba3ba744cac8a7e86b2 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:06.852003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdde59-8a8f-4d20-ba20-2f05de1e02f9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:06.852402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdde59-8a8f-4d20-ba20-2f05de1e02f9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:06.852902 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdde59-8a8f-4d20-ba20-2f05de1e02f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:06.887175 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-9fbdde59-8a8f-4d20-ba20-2f05de1e02f9 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:06.888533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9fbdde59-8a8f-4d20-ba20-2f05de1e02f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:06.942532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00235f5-da4c-40df-af53-8f3894af6f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:06.943435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00235f5-da4c-40df-af53-8f3894af6f85 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:06.944482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00235f5-da4c-40df-af53-8f3894af6f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:06.944928 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00235f5-da4c-40df-af53-8f3894af6f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:06.946537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00235f5-da4c-40df-af53-8f3894af6f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:06.949806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00235f5-da4c-40df-af53-8f3894af6f85 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:06.973005 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 996/1983] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:06.977175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00235f5-da4c-40df-af53-8f3894af6f85 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:06.982165 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e00235f5-da4c-40df-af53-8f3894af6f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:06.997667 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 988/1984] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:07.000300 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00235f5-da4c-40df-af53-8f3894af6f85 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:07.005332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fade23-b44d-4703-a903-7c820bdc6651 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:07.005866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fade23-b44d-4703-a903-7c820bdc6651 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:07.006287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fade23-b44d-4703-a903-7c820bdc6651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:07.011689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac31fdd-fb0d-4da9-b928-a6a33f1d2563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:07.012656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac31fdd-fb0d-4da9-b928-a6a33f1d2563 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:07.013138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac31fdd-fb0d-4da9-b928-a6a33f1d2563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:07.013641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac31fdd-fb0d-4da9-b928-a6a33f1d2563 admin admin] PATH_INFO: `/v3/projects/5892cdb0a2824006adbd8d2d3799726e/users/af11c2e882e0486b8eee0098d98820c8/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:07.015879 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac31fdd-fb0d-4da9-b928-a6a33f1d2563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5892cdb0a2824006adbd8d2d3799726e, user_id=af11c2e882e0486b8eee0098d98820c8, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:07.018717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac31fdd-fb0d-4da9-b928-a6a33f1d2563 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:07.028194 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c9fade23-b44d-4703-a903-7c820bdc6651 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:07.029635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c9fade23-b44d-4703-a903-7c820bdc6651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:07.032391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 997/1985] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:06 2022] PUT /identity/v3/projects/5892cdb0a2824006adbd8d2d3799726e/users/af11c2e882e0486b8eee0098d98820c8/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:07.042429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e0077-e414-4c83-b72b-15fe56f294b9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:07.043117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e0077-e414-4c83-b72b-15fe56f294b9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:07.043117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e0077-e414-4c83-b72b-15fe56f294b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:07.076265 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fb3e0077-e414-4c83-b72b-15fe56f294b9 None None] MFA Rules not processed for user `af11c2e882e0486b8eee0098d98820c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:07.077495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fb3e0077-e414-4c83-b72b-15fe56f294b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:07.093715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 989/1986] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:07.097915 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fade23-b44d-4703-a903-7c820bdc6651 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:07.107990 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fade23-b44d-4703-a903-7c820bdc6651 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:07.113530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435535c-0c60-4261-9df2-662dc950f9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:07.114477 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435535c-0c60-4261-9df2-662dc950f9eb admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:07.114954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435535c-0c60-4261-9df2-662dc950f9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:07.115240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435535c-0c60-4261-9df2-662dc950f9eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:07.116018 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435535c-0c60-4261-9df2-662dc950f9eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:07.117680 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435535c-0c60-4261-9df2-662dc950f9eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:07.118118 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435535c-0c60-4261-9df2-662dc950f9eb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:07.134657 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 990/1987] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:44:07.136078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435535c-0c60-4261-9df2-662dc950f9eb admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:07.145911 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435535c-0c60-4261-9df2-662dc950f9eb admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:07.150742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820424d0-9e60-4bb5-beba-35d4b7090813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:07.151363 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820424d0-9e60-4bb5-beba-35d4b7090813 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:07.151643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820424d0-9e60-4bb5-beba-35d4b7090813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:07.151910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820424d0-9e60-4bb5-beba-35d4b7090813 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:07.152540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820424d0-9e60-4bb5-beba-35d4b7090813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:07.152836 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 998/1988] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:07.154510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820424d0-9e60-4bb5-beba-35d4b7090813 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:07.163997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e0077-e414-4c83-b72b-15fe56f294b9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:07.165738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fb3e0077-e414-4c83-b72b-15fe56f294b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:07.217722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:07.223357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e0077-e414-4c83-b72b-15fe56f294b9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:07.226859 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f218b82-137c-4974-ba55-ffd23bb86ea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:07.227502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f218b82-137c-4974-ba55-ffd23bb86ea2 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:07.227776 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f218b82-137c-4974-ba55-ffd23bb86ea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:07.228047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f218b82-137c-4974-ba55-ffd23bb86ea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:07.230763 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3f218b82-137c-4974-ba55-ffd23bb86ea2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:07.292693 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f218b82-137c-4974-ba55-ffd23bb86ea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:07.294156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f218b82-137c-4974-ba55-ffd23bb86ea2 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:07.303139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 999/1989] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:44:07.319451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 991/1990] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:07 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:07.320528 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f218b82-137c-4974-ba55-ffd23bb86ea2 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:07.331069 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f218b82-137c-4974-ba55-ffd23bb86ea2 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:07.396820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f38af2-ba49-4b40-9838-da4cd89eed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:07.397501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f38af2-ba49-4b40-9838-da4cd89eed9a admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:07.397777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f38af2-ba49-4b40-9838-da4cd89eed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:07.398049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f38af2-ba49-4b40-9838-da4cd89eed9a admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:07.403033 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f38af2-ba49-4b40-9838-da4cd89eed9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:07.403033 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f38af2-ba49-4b40-9838-da4cd89eed9a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:07.465399 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:07.506911 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820424d0-9e60-4bb5-beba-35d4b7090813 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:07.507469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1000/1991] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:07 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:07.517931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820424d0-9e60-4bb5-beba-35d4b7090813 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:07.522940 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2eb0d-9557-4c1c-acea-367c86de06f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:07.523555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2eb0d-9557-4c1c-acea-367c86de06f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:07.525216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2eb0d-9557-4c1c-acea-367c86de06f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:07.525216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2eb0d-9557-4c1c-acea-367c86de06f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:07.525216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2eb0d-9557-4c1c-acea-367c86de06f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:07.526944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2eb0d-9557-4c1c-acea-367c86de06f6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:07.542546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 992/1992] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:07.546597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f38af2-ba49-4b40-9838-da4cd89eed9a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:07.560011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f38af2-ba49-4b40-9838-da4cd89eed9a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:07.564759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618f55a-9a82-4109-b525-81578e44e1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:07.565406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618f55a-9a82-4109-b525-81578e44e1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:07.565685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618f55a-9a82-4109-b525-81578e44e1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:07.565961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618f55a-9a82-4109-b525-81578e44e1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:07.566607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618f55a-9a82-4109-b525-81578e44e1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:07.568204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618f55a-9a82-4109-b525-81578e44e1b2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:07.582965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1001/1993] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:07.583066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2eb0d-9557-4c1c-acea-367c86de06f6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:07.594484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2eb0d-9557-4c1c-acea-367c86de06f6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:07.599793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ec658-a9ee-4f75-aa7f-bacfa587bd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:07.600461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ec658-a9ee-4f75-aa7f-bacfa587bd6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:07.600738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ec658-a9ee-4f75-aa7f-bacfa587bd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:07.601189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ec658-a9ee-4f75-aa7f-bacfa587bd6d admin admin] PATH_INFO: `/v3/projects/b396ef8869f14d62b0ef6d9124d63e86/users/9d1f2b03bfd34aaba3286a0246ac6c5b/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:07.617436 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ec658-a9ee-4f75-aa7f-bacfa587bd6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b396ef8869f14d62b0ef6d9124d63e86, user_id=9d1f2b03bfd34aaba3286a0246ac6c5b, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:07.621023 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ec658-a9ee-4f75-aa7f-bacfa587bd6d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:07.732430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 993/1994] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:07 2022] PUT /identity/v3/projects/b396ef8869f14d62b0ef6d9124d63e86/users/9d1f2b03bfd34aaba3286a0246ac6c5b/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:07.747093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c656d-1ada-4b8a-bb8c-27d85ac07be7 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:07.748413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c656d-1ada-4b8a-bb8c-27d85ac07be7 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:07.748413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c656d-1ada-4b8a-bb8c-27d85ac07be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:07.784309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-366c656d-1ada-4b8a-bb8c-27d85ac07be7 None None] MFA Rules not processed for user `9d1f2b03bfd34aaba3286a0246ac6c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:07.785540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-366c656d-1ada-4b8a-bb8c-27d85ac07be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:07.856487 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1002/1995] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:07.861081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ec658-a9ee-4f75-aa7f-bacfa587bd6d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:07.923956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ec658-a9ee-4f75-aa7f-bacfa587bd6d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:07.928637 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfc1da-6f84-4a0c-8a6b-a83621a8172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:07.929255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfc1da-6f84-4a0c-8a6b-a83621a8172d admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:07.929537 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfc1da-6f84-4a0c-8a6b-a83621a8172d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:07.929804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfc1da-6f84-4a0c-8a6b-a83621a8172d admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:07.930438 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfc1da-6f84-4a0c-8a6b-a83621a8172d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:07.933017 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfc1da-6f84-4a0c-8a6b-a83621a8172d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:08.045033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 994/1996] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:07 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:08.047500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c656d-1ada-4b8a-bb8c-27d85ac07be7 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:08.059239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c656d-1ada-4b8a-bb8c-27d85ac07be7 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:08.163697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53b6d6-c3c6-4cb2-9b4f-edee7bf1fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:08.177146 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53b6d6-c3c6-4cb2-9b4f-edee7bf1fcbe admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:08.177146 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53b6d6-c3c6-4cb2-9b4f-edee7bf1fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:08.177146 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53b6d6-c3c6-4cb2-9b4f-edee7bf1fcbe admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:08.177146 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53b6d6-c3c6-4cb2-9b4f-edee7bf1fcbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:08.177146 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53b6d6-c3c6-4cb2-9b4f-edee7bf1fcbe admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:08.297150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1003/1997] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:08 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:08.298476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfc1da-6f84-4a0c-8a6b-a83621a8172d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:08.309467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfc1da-6f84-4a0c-8a6b-a83621a8172d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:08.316647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c9279-dcad-4c60-86dc-60c128073fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:08.317282 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c9279-dcad-4c60-86dc-60c128073fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:08.317557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c9279-dcad-4c60-86dc-60c128073fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:08.317822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c9279-dcad-4c60-86dc-60c128073fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:08.318467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c9279-dcad-4c60-86dc-60c128073fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:08.320133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c9279-dcad-4c60-86dc-60c128073fe8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:08.331836 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 995/1998] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:08.336298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53b6d6-c3c6-4cb2-9b4f-edee7bf1fcbe admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:08.352628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53b6d6-c3c6-4cb2-9b4f-edee7bf1fcbe admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:08.357704 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45536ba3-ec9b-4faf-8317-b4aa96e27544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:08.358555 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45536ba3-ec9b-4faf-8317-b4aa96e27544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:08.358915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45536ba3-ec9b-4faf-8317-b4aa96e27544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:08.359283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45536ba3-ec9b-4faf-8317-b4aa96e27544 admin admin] PATH_INFO: `/v3/projects/58a2b56bb501479a822105c50d56ba93/users/c910ed2fef154780bee44cd4014c2d6f/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:08.377318 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45536ba3-ec9b-4faf-8317-b4aa96e27544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a2b56bb501479a822105c50d56ba93, user_id=c910ed2fef154780bee44cd4014c2d6f, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:08.380033 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45536ba3-ec9b-4faf-8317-b4aa96e27544 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:08.393508 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c9279-dcad-4c60-86dc-60c128073fe8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:08.395211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8e2c9279-dcad-4c60-86dc-60c128073fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:08.408415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c9279-dcad-4c60-86dc-60c128073fe8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:08.413071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6447f-ee92-41cd-8b8c-080e1e3bd6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:08.413803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6447f-ee92-41cd-8b8c-080e1e3bd6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:08.414086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6447f-ee92-41cd-8b8c-080e1e3bd6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:08.414356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6447f-ee92-41cd-8b8c-080e1e3bd6d1 admin admin] PATH_INFO: `/v3/users/b827dcaac46d47558a6b211a6bb79bd3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:08.415767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6447f-ee92-41cd-8b8c-080e1e3bd6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b827dcaac46d47558a6b211a6bb79bd3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:08.418765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6447f-ee92-41cd-8b8c-080e1e3bd6d1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:08.460958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1004/1999] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:08 2022] PUT /identity/v3/projects/58a2b56bb501479a822105c50d56ba93/users/c910ed2fef154780bee44cd4014c2d6f/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:08.464880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45536ba3-ec9b-4faf-8317-b4aa96e27544 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:08.528933 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45536ba3-ec9b-4faf-8317-b4aa96e27544 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:08.534437 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd473a-1cb6-4568-b657-203f34937d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:08.535049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd473a-1cb6-4568-b657-203f34937d2d admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:08.535324 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd473a-1cb6-4568-b657-203f34937d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:08.535593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd473a-1cb6-4568-b657-203f34937d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:08.536235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd473a-1cb6-4568-b657-203f34937d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:08.537863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd473a-1cb6-4568-b657-203f34937d2d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:08.555897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1005/2000] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:08.555897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd473a-1cb6-4568-b657-203f34937d2d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:08.562335 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd473a-1cb6-4568-b657-203f34937d2d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:08.567087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f0659-cc3b-46b8-951c-ea7952416adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:08.567728 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f0659-cc3b-46b8-951c-ea7952416adf admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:08.568005 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f0659-cc3b-46b8-951c-ea7952416adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:08.568279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f0659-cc3b-46b8-951c-ea7952416adf admin admin] PATH_INFO: `/v3/projects/58a2b56bb501479a822105c50d56ba93/users/c910ed2fef154780bee44cd4014c2d6f/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:08.570360 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f0659-cc3b-46b8-951c-ea7952416adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a2b56bb501479a822105c50d56ba93, user_id=c910ed2fef154780bee44cd4014c2d6f, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:08.572827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f0659-cc3b-46b8-951c-ea7952416adf admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:08.584891 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1006/2001] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:08 2022] PUT /identity/v3/projects/58a2b56bb501479a822105c50d56ba93/users/c910ed2fef154780bee44cd4014c2d6f/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:08.592436 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6bd6447f-ee92-41cd-8b8c-080e1e3bd6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b827dcaac46d47558a6b211a6bb79bd3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:08.592436 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6bd6447f-ee92-41cd-8b8c-080e1e3bd6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b827dcaac46d47558a6b211a6bb79bd3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:08.596719 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be69a8-fd45-4149-9c8a-9fbdd0d247a8 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:08.597010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be69a8-fd45-4149-9c8a-9fbdd0d247a8 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:08.597327 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be69a8-fd45-4149-9c8a-9fbdd0d247a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:08.606059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6bd6447f-ee92-41cd-8b8c-080e1e3bd6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b827dcaac46d47558a6b211a6bb79bd3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:08.613132 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6bd6447f-ee92-41cd-8b8c-080e1e3bd6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b827dcaac46d47558a6b211a6bb79bd3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:08.614062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6bd6447f-ee92-41cd-8b8c-080e1e3bd6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b827dcaac46d47558a6b211a6bb79bd3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:08.628857 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-12be69a8-fd45-4149-9c8a-9fbdd0d247a8 None None] MFA Rules not processed for user `c910ed2fef154780bee44cd4014c2d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:08.630209 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-12be69a8-fd45-4149-9c8a-9fbdd0d247a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:08.706636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 996/2002] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:08 2022] DELETE /identity/v3/users/b827dcaac46d47558a6b211a6bb79bd3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:08.712209 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537003b8-2b96-44e0-b4fa-ca0771e51e4a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:08.712708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537003b8-2b96-44e0-b4fa-ca0771e51e4a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:08.713014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537003b8-2b96-44e0-b4fa-ca0771e51e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:08.713448 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1007/2003] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:08.727155 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be69a8-fd45-4149-9c8a-9fbdd0d247a8 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:08.728908 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-12be69a8-fd45-4149-9c8a-9fbdd0d247a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:08.734612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-537003b8-2b96-44e0-b4fa-ca0771e51e4a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:08.736027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-537003b8-2b96-44e0-b4fa-ca0771e51e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:08.792416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be69a8-fd45-4149-9c8a-9fbdd0d247a8 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:08.804827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:08.812553 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 997/2004] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:08.819832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537003b8-2b96-44e0-b4fa-ca0771e51e4a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:08.821668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-537003b8-2b96-44e0-b4fa-ca0771e51e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:08.850220 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74bb64-5285-42a0-aea7-283218a0fd92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:08.851102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74bb64-5285-42a0-aea7-283218a0fd92 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:08.851530 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74bb64-5285-42a0-aea7-283218a0fd92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:08.851947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74bb64-5285-42a0-aea7-283218a0fd92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:08.860131 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:08.887226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537003b8-2b96-44e0-b4fa-ca0771e51e4a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:08.894523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796da83-fc43-4d57-8aa6-b917db0ffc77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:08.895142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796da83-fc43-4d57-8aa6-b917db0ffc77 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:08.895419 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796da83-fc43-4d57-8aa6-b917db0ffc77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:08.898585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796da83-fc43-4d57-8aa6-b917db0ffc77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:08.906883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796da83-fc43-4d57-8aa6-b917db0ffc77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:08.908430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796da83-fc43-4d57-8aa6-b917db0ffc77 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:08.921114 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 998/2005] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:44:08.959173 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74bb64-5285-42a0-aea7-283218a0fd92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:08.961091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74bb64-5285-42a0-aea7-283218a0fd92 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:08.972770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1008/2006] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:44:09.469596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:09.692205 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796da83-fc43-4d57-8aa6-b917db0ffc77 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:09.693998 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0796da83-fc43-4d57-8aa6-b917db0ffc77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:09.707279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796da83-fc43-4d57-8aa6-b917db0ffc77 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:09.712212 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:09.712849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:09.713128 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:09.713443 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] PATH_INFO: `/v3/projects/efaab2b40d614e65b54381598e1c8d97` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:09.715632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efaab2b40d614e65b54381598e1c8d97)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:09.721077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:09.890030 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efaab2b40d614e65b54381598e1c8d97', 'request_id': 'req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:10.007850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efaab2b40d614e65b54381598e1c8d97', 'request_id': 'req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:10.026865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:10.027407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efaab2b40d614e65b54381598e1c8d97', 'request_id': 'req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:10.035920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] The token cache is being invalidate because project efaab2b40d614e65b54381598e1c8d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:10.036214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:10.036891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:10.038768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 999/2007] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:09 2022] DELETE /identity/v3/projects/efaab2b40d614e65b54381598e1c8d97 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:10.043952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74bb64-5285-42a0-aea7-283218a0fd92 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:10.070263 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74bb64-5285-42a0-aea7-283218a0fd92 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:10.150180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32474de3-7f8c-462a-ac3e-566755db40dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:10.152042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474de3-7f8c-462a-ac3e-566755db40dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:10.152707 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474de3-7f8c-462a-ac3e-566755db40dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:10.153324 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474de3-7f8c-462a-ac3e-566755db40dc admin admin] PATH_INFO: `/v3/users/b743b55c37614a888fe59c968ff5c81c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:10.154647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32474de3-7f8c-462a-ac3e-566755db40dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b743b55c37614a888fe59c968ff5c81c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:10.156876 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32474de3-7f8c-462a-ac3e-566755db40dc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:10.279097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:10.280594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:10.376688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6249dd-3d7c-49a7-9945-5bdf1e5f4ff1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:10.382316 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47672b6a-4e69-42d7-9369-d13c39a9c07f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c910ed2fef154780bee44cd4014c2d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58a2b56bb501479a822105c50d56ba93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:10.383405 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47672b6a-4e69-42d7-9369-d13c39a9c07f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:10.383772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47672b6a-4e69-42d7-9369-d13c39a9c07f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:10.384143 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47672b6a-4e69-42d7-9369-d13c39a9c07f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:10.385035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47672b6a-4e69-42d7-9369-d13c39a9c07f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:10.385992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47672b6a-4e69-42d7-9369-d13c39a9c07f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:10.388337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47672b6a-4e69-42d7-9369-d13c39a9c07f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:10.414057 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1000/2008] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:44:10.418706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47672b6a-4e69-42d7-9369-d13c39a9c07f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:10.429348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47672b6a-4e69-42d7-9369-d13c39a9c07f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:10.435141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf487fad-1efb-4b84-a611-efef08c5a559 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c910ed2fef154780bee44cd4014c2d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58a2b56bb501479a822105c50d56ba93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:10.435831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf487fad-1efb-4b84-a611-efef08c5a559 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:10.436177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf487fad-1efb-4b84-a611-efef08c5a559 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:10.436516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf487fad-1efb-4b84-a611-efef08c5a559 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:10.437242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf487fad-1efb-4b84-a611-efef08c5a559 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:10.439211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf487fad-1efb-4b84-a611-efef08c5a559 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:10.499850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-32474de3-7f8c-462a-ac3e-566755db40dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b743b55c37614a888fe59c968ff5c81c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:10.505302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:10.519001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-32474de3-7f8c-462a-ac3e-566755db40dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b743b55c37614a888fe59c968ff5c81c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:10.587798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1001/2009] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:10 2022] POST /identity/v3/projects => generated 354 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:10.589293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf487fad-1efb-4b84-a611-efef08c5a559 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:10.604759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-32474de3-7f8c-462a-ac3e-566755db40dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b743b55c37614a888fe59c968ff5c81c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:10.624951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-32474de3-7f8c-462a-ac3e-566755db40dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b743b55c37614a888fe59c968ff5c81c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:10.626962 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-32474de3-7f8c-462a-ac3e-566755db40dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b743b55c37614a888fe59c968ff5c81c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:10.645411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1009/2010] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:10 2022] DELETE /identity/v3/users/b743b55c37614a888fe59c968ff5c81c => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:10.742962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf487fad-1efb-4b84-a611-efef08c5a559 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:10.852686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a094a-e4fa-497e-95b0-c3582afed71f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c910ed2fef154780bee44cd4014c2d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58a2b56bb501479a822105c50d56ba93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:10.853674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a094a-e4fa-497e-95b0-c3582afed71f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:10.854800 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a094a-e4fa-497e-95b0-c3582afed71f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:10.856025 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a094a-e4fa-497e-95b0-c3582afed71f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:10.857326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a094a-e4fa-497e-95b0-c3582afed71f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:10.857794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a094a-e4fa-497e-95b0-c3582afed71f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:10.859752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a094a-e4fa-497e-95b0-c3582afed71f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:10.873107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1002/2011] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:44:10.950786 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32474de3-7f8c-462a-ac3e-566755db40dc admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:10.955603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-32474de3-7f8c-462a-ac3e-566755db40dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:10.973985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32474de3-7f8c-462a-ac3e-566755db40dc admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:10.981316 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c910ed2fef154780bee44cd4014c2d6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58a2b56bb501479a822105c50d56ba93', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:10.982695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:10.983197 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:10.983531 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] PATH_INFO: `/v3/projects/c72407bb921f4bfbbc42f4260e8a65c1` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:10.984878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c72407bb921f4bfbbc42f4260e8a65c1)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:10.987067 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:11.203773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72407bb921f4bfbbc42f4260e8a65c1', 'request_id': 'req-4c4c3696-e40c-4aaf-a201-99b6118f5138'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:11.234899 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:11.282186 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72407bb921f4bfbbc42f4260e8a65c1', 'request_id': 'req-4c4c3696-e40c-4aaf-a201-99b6118f5138'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:11.301591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72407bb921f4bfbbc42f4260e8a65c1', 'request_id': 'req-4c4c3696-e40c-4aaf-a201-99b6118f5138'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:11.321377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] The token cache is being invalidate because project c72407bb921f4bfbbc42f4260e8a65c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:11.321659 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:11.322348 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:11.323943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1010/2012] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:10 2022] DELETE /identity/v3/projects/c72407bb921f4bfbbc42f4260e8a65c1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:11.559277 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a094a-e4fa-497e-95b0-c3582afed71f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:11.561632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-130a094a-e4fa-497e-95b0-c3582afed71f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:11.659400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a094a-e4fa-497e-95b0-c3582afed71f tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:11.721880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:11.722768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:11.723053 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:11.723331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] PATH_INFO: `/v3/projects/179bbe58efec4d40bc4c44dfd6086f07` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:11.724458 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=179bbe58efec4d40bc4c44dfd6086f07)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:11.726465 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:11.770100 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:11.912116 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179bbe58efec4d40bc4c44dfd6086f07', 'request_id': 'req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:11.998209 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:11.998806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179bbe58efec4d40bc4c44dfd6086f07', 'request_id': 'req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.002363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:12.022475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179bbe58efec4d40bc4c44dfd6086f07', 'request_id': 'req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.044486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c3696-e40c-4aaf-a201-99b6118f5138 tempest-VolumeQuotaClassesTest-2117338960 tempest-VolumeQuotaClassesTest-2117338960-project-admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:12.051491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] The token cache is being invalidate because project 179bbe58efec4d40bc4c44dfd6086f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:12.052017 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.052936 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.055208 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1003/2013] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:11 2022] DELETE /identity/v3/projects/179bbe58efec4d40bc4c44dfd6086f07 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:12.067718 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:12.070108 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:12.131895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350837c-1a91-433e-ae19-22c8cefa2059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:12.132538 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350837c-1a91-433e-ae19-22c8cefa2059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:12.132814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350837c-1a91-433e-ae19-22c8cefa2059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:12.133168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350837c-1a91-433e-ae19-22c8cefa2059 admin admin] PATH_INFO: `/v3/users/0656c955c02a4e7abde7c5754d3665d6` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:12.134382 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350837c-1a91-433e-ae19-22c8cefa2059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0656c955c02a4e7abde7c5754d3665d6)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:12.136799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350837c-1a91-433e-ae19-22c8cefa2059 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:12.155150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec72ad-b5fc-411f-b456-dc03c41fe8b2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:12.160695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02896a6a-9f0f-4d2e-a9d8-abc3b951bd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:12.162116 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02896a6a-9f0f-4d2e-a9d8-abc3b951bd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:12.163069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02896a6a-9f0f-4d2e-a9d8-abc3b951bd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:12.163069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02896a6a-9f0f-4d2e-a9d8-abc3b951bd3e admin admin] PATH_INFO: `/v3/users/b1bc33174dae41839e036b156e65ce29` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:12.166069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02896a6a-9f0f-4d2e-a9d8-abc3b951bd3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1bc33174dae41839e036b156e65ce29)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:12.169658 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02896a6a-9f0f-4d2e-a9d8-abc3b951bd3e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:12.349349 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2350837c-1a91-433e-ae19-22c8cefa2059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0656c955c02a4e7abde7c5754d3665d6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.366941 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2350837c-1a91-433e-ae19-22c8cefa2059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0656c955c02a4e7abde7c5754d3665d6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.430038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-02896a6a-9f0f-4d2e-a9d8-abc3b951bd3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1bc33174dae41839e036b156e65ce29'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.430769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-02896a6a-9f0f-4d2e-a9d8-abc3b951bd3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1bc33174dae41839e036b156e65ce29'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.435587 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2350837c-1a91-433e-ae19-22c8cefa2059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0656c955c02a4e7abde7c5754d3665d6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.445091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2350837c-1a91-433e-ae19-22c8cefa2059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0656c955c02a4e7abde7c5754d3665d6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.445830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2350837c-1a91-433e-ae19-22c8cefa2059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0656c955c02a4e7abde7c5754d3665d6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.461284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1011/2014] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:11 2022] DELETE /identity/v3/users/0656c955c02a4e7abde7c5754d3665d6 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:12.461284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350837c-1a91-433e-ae19-22c8cefa2059 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:12.465691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:12.470078 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2350837c-1a91-433e-ae19-22c8cefa2059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:12.470251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-02896a6a-9f0f-4d2e-a9d8-abc3b951bd3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1bc33174dae41839e036b156e65ce29'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.478668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-02896a6a-9f0f-4d2e-a9d8-abc3b951bd3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1bc33174dae41839e036b156e65ce29'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.480201 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-02896a6a-9f0f-4d2e-a9d8-abc3b951bd3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1bc33174dae41839e036b156e65ce29'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.540639 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350837c-1a91-433e-ae19-22c8cefa2059 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:12.545936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c7dbd-ed6c-47cb-843e-6f2312641826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:12.546715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c7dbd-ed6c-47cb-843e-6f2312641826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:12.547005 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c7dbd-ed6c-47cb-843e-6f2312641826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:12.547283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c7dbd-ed6c-47cb-843e-6f2312641826 admin admin] PATH_INFO: `/v3/users/9d1f2b03bfd34aaba3286a0246ac6c5b` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:12.548433 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c7dbd-ed6c-47cb-843e-6f2312641826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1f2b03bfd34aaba3286a0246ac6c5b)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:12.550451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c7dbd-ed6c-47cb-843e-6f2312641826 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:12.570309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1004/2015] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:12 2022] DELETE /identity/v3/users/b1bc33174dae41839e036b156e65ce29 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:12.575877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177a26d-5899-4107-87c7-73d7a54c0609 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:12.576236 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177a26d-5899-4107-87c7-73d7a54c0609 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:12.576585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177a26d-5899-4107-87c7-73d7a54c0609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:12.604796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e177a26d-5899-4107-87c7-73d7a54c0609 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:12.606435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e177a26d-5899-4107-87c7-73d7a54c0609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:12.740349 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1005/2016] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:12.750714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177a26d-5899-4107-87c7-73d7a54c0609 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:12.752434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e177a26d-5899-4107-87c7-73d7a54c0609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:12.826301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177a26d-5899-4107-87c7-73d7a54c0609 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:12.830426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13276-90fb-4dc7-a4e4-d3368ed50a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:12.831221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13276-90fb-4dc7-a4e4-d3368ed50a27 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:12.831586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13276-90fb-4dc7-a4e4-d3368ed50a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:12.831923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13276-90fb-4dc7-a4e4-d3368ed50a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:12.849454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c13276-90fb-4dc7-a4e4-d3368ed50a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:12.851636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c13276-90fb-4dc7-a4e4-d3368ed50a27 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:12.877530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1006/2017] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:44:12.923951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8c1c7dbd-ed6c-47cb-843e-6f2312641826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1f2b03bfd34aaba3286a0246ac6c5b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.937368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8c1c7dbd-ed6c-47cb-843e-6f2312641826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1f2b03bfd34aaba3286a0246ac6c5b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:12.943561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:13.007324 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8c1c7dbd-ed6c-47cb-843e-6f2312641826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1f2b03bfd34aaba3286a0246ac6c5b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:13.016035 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8c1c7dbd-ed6c-47cb-843e-6f2312641826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1f2b03bfd34aaba3286a0246ac6c5b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:13.016760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-8c1c7dbd-ed6c-47cb-843e-6f2312641826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1f2b03bfd34aaba3286a0246ac6c5b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:13.023226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1012/2018] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:12 2022] DELETE /identity/v3/users/9d1f2b03bfd34aaba3286a0246ac6c5b => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:13.029073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0aeb-9c4e-45e8-b785-ec15c6d6a913 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:13.029392 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0aeb-9c4e-45e8-b785-ec15c6d6a913 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:13.029672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0aeb-9c4e-45e8-b785-ec15c6d6a913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:13.078949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8f1f0aeb-9c4e-45e8-b785-ec15c6d6a913 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:13.080353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8f1f0aeb-9c4e-45e8-b785-ec15c6d6a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:13.192526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1007/2019] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:13.203606 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c7dbd-ed6c-47cb-843e-6f2312641826 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:13.205720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8c1c7dbd-ed6c-47cb-843e-6f2312641826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:13.234568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f0aeb-9c4e-45e8-b785-ec15c6d6a913 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:13.236551 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8f1f0aeb-9c4e-45e8-b785-ec15c6d6a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:13.271534 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f0aeb-9c4e-45e8-b785-ec15c6d6a913 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:13.292142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:13.292142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:13.292142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:13.292142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4 admin admin] PATH_INFO: `/v3/projects/f968f47733de48299aab1889c2ab09be` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:13.292641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f968f47733de48299aab1889c2ab09be)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:13.292912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:13.341578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c7dbd-ed6c-47cb-843e-6f2312641826 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:13.348431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729ff93-26da-4f66-a9b3-bac8ca1b56e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:13.349135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729ff93-26da-4f66-a9b3-bac8ca1b56e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:13.349539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729ff93-26da-4f66-a9b3-bac8ca1b56e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:13.350109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729ff93-26da-4f66-a9b3-bac8ca1b56e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:13.376860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729ff93-26da-4f66-a9b3-bac8ca1b56e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:13.378553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729ff93-26da-4f66-a9b3-bac8ca1b56e7 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:13.396572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1013/2020] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:13.433486 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f968f47733de48299aab1889c2ab09be', 'request_id': 'req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:13.443537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729ff93-26da-4f66-a9b3-bac8ca1b56e7 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:13.444955 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4729ff93-26da-4f66-a9b3-bac8ca1b56e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:13.477660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729ff93-26da-4f66-a9b3-bac8ca1b56e7 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:13.531809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f968f47733de48299aab1889c2ab09be', 'request_id': 'req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:13.538564 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f968f47733de48299aab1889c2ab09be', 'request_id': 'req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:13.559414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4 admin admin] The token cache is being invalidate because project f968f47733de48299aab1889c2ab09be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:13.560123 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:13.562503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:13.563426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cb97249a-c1fc-40f8-ab03-ef57dd082ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:13.566753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1008/2021] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:13 2022] DELETE /identity/v3/projects/f968f47733de48299aab1889c2ab09be => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:13.572001 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490214d7-82c9-4b67-8b59-3011d7085bae None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:13.572732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490214d7-82c9-4b67-8b59-3011d7085bae None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:13.572732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490214d7-82c9-4b67-8b59-3011d7085bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:13.597555 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a7433-a6cc-493f-a5b1-cda285eed774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:13.598283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a7433-a6cc-493f-a5b1-cda285eed774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:13.598722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a7433-a6cc-493f-a5b1-cda285eed774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:13.599571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a7433-a6cc-493f-a5b1-cda285eed774 admin admin] PATH_INFO: `/v3/projects/816eb5fbd88949d3903b4ea6c9f7047c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:13.605142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a7433-a6cc-493f-a5b1-cda285eed774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816eb5fbd88949d3903b4ea6c9f7047c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:13.607624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a7433-a6cc-493f-a5b1-cda285eed774 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:13.614563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-490214d7-82c9-4b67-8b59-3011d7085bae None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:13.619566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-490214d7-82c9-4b67-8b59-3011d7085bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:13.640340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1009/2022] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:13.646429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f32915-f9ef-40c3-92b3-76fed4f5ac84 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:13.646822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f32915-f9ef-40c3-92b3-76fed4f5ac84 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:13.647101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f32915-f9ef-40c3-92b3-76fed4f5ac84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:13.682926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f1f32915-f9ef-40c3-92b3-76fed4f5ac84 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:13.684944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f1f32915-f9ef-40c3-92b3-76fed4f5ac84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:13.693636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1010/2023] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:13.697598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f32915-f9ef-40c3-92b3-76fed4f5ac84 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:13.709467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f32915-f9ef-40c3-92b3-76fed4f5ac84 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:13.715692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613dabf-f001-4aa5-9a8f-c3e5d84c045b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:13.716544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613dabf-f001-4aa5-9a8f-c3e5d84c045b admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:13.717027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613dabf-f001-4aa5-9a8f-c3e5d84c045b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:13.717522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613dabf-f001-4aa5-9a8f-c3e5d84c045b admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:13.718982 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613dabf-f001-4aa5-9a8f-c3e5d84c045b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:13.719475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613dabf-f001-4aa5-9a8f-c3e5d84c045b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:13.721962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613dabf-f001-4aa5-9a8f-c3e5d84c045b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:13.743714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1011/2024] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:44:13.748840 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613dabf-f001-4aa5-9a8f-c3e5d84c045b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:13.773543 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613dabf-f001-4aa5-9a8f-c3e5d84c045b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:13.782039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-854a7433-a6cc-493f-a5b1-cda285eed774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816eb5fbd88949d3903b4ea6c9f7047c', 'request_id': 'req-854a7433-a6cc-493f-a5b1-cda285eed774'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:13.858572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-854a7433-a6cc-493f-a5b1-cda285eed774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816eb5fbd88949d3903b4ea6c9f7047c', 'request_id': 'req-854a7433-a6cc-493f-a5b1-cda285eed774'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:13.867007 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-854a7433-a6cc-493f-a5b1-cda285eed774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816eb5fbd88949d3903b4ea6c9f7047c', 'request_id': 'req-854a7433-a6cc-493f-a5b1-cda285eed774'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:13.883925 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-854a7433-a6cc-493f-a5b1-cda285eed774 admin admin] The token cache is being invalidate because project 816eb5fbd88949d3903b4ea6c9f7047c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:13.884314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-854a7433-a6cc-493f-a5b1-cda285eed774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:13.886056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-854a7433-a6cc-493f-a5b1-cda285eed774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:13.892240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1014/2025] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:13 2022] DELETE /identity/v3/projects/816eb5fbd88949d3903b4ea6c9f7047c => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:13.895258 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74efb-8234-44c7-af3c-f99ab1f0400d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:13.895649 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74efb-8234-44c7-af3c-f99ab1f0400d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:13.896099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74efb-8234-44c7-af3c-f99ab1f0400d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:13.911815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712196c-2fdd-473b-aa10-d02be5a82cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:13.914433 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712196c-2fdd-473b-aa10-d02be5a82cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:13.916013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712196c-2fdd-473b-aa10-d02be5a82cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:13.917177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712196c-2fdd-473b-aa10-d02be5a82cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:13.918804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712196c-2fdd-473b-aa10-d02be5a82cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:13.922049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712196c-2fdd-473b-aa10-d02be5a82cd0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:13.956840 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3ff74efb-8234-44c7-af3c-f99ab1f0400d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:13.958368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3ff74efb-8234-44c7-af3c-f99ab1f0400d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:13.965108 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:13.973581 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1015/2026] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:13.986879 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231465d-fe00-44b5-8f55-712082329447 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:13.987083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231465d-fe00-44b5-8f55-712082329447 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:13.987285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231465d-fe00-44b5-8f55-712082329447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:14.021874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9231465d-fe00-44b5-8f55-712082329447 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:14.023468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9231465d-fe00-44b5-8f55-712082329447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:14.039568 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1016/2027] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:14.040975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231465d-fe00-44b5-8f55-712082329447 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:14.059574 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231465d-fe00-44b5-8f55-712082329447 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:14.065527 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0c9ba-8f8d-49be-bf62-884a9a970759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:14.066175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0c9ba-8f8d-49be-bf62-884a9a970759 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:14.066457 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0c9ba-8f8d-49be-bf62-884a9a970759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:14.066729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0c9ba-8f8d-49be-bf62-884a9a970759 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:14.067391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0c9ba-8f8d-49be-bf62-884a9a970759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:14.067692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0c9ba-8f8d-49be-bf62-884a9a970759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:14.069401 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0c9ba-8f8d-49be-bf62-884a9a970759 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:14.073348 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:14.090798 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1017/2028] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:44:14.091428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1012/2029] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:13 2022] POST /identity/v3/projects => generated 383 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:14.091862 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0c9ba-8f8d-49be-bf62-884a9a970759 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:14.092317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712196c-2fdd-473b-aa10-d02be5a82cd0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:14.093779 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-17d0c9ba-8f8d-49be-bf62-884a9a970759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:14.107934 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0c9ba-8f8d-49be-bf62-884a9a970759 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:14.161788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712196c-2fdd-473b-aa10-d02be5a82cd0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:14.167677 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8e3b4-f169-4546-ae29-d2372a2728c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:14.168420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8e3b4-f169-4546-ae29-d2372a2728c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:14.168728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8e3b4-f169-4546-ae29-d2372a2728c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:14.168952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8e3b4-f169-4546-ae29-d2372a2728c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:14.169601 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8e3b4-f169-4546-ae29-d2372a2728c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:14.171521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8e3b4-f169-4546-ae29-d2372a2728c8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:14.172843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf279ae-26f5-4ffc-a841-173d67a361b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:14.173506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf279ae-26f5-4ffc-a841-173d67a361b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:14.173797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf279ae-26f5-4ffc-a841-173d67a361b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:14.174077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf279ae-26f5-4ffc-a841-173d67a361b9 admin admin] PATH_INFO: `/v3/users/08d652c6d993483fa474bcd6cf59bc30` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:14.175235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf279ae-26f5-4ffc-a841-173d67a361b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d652c6d993483fa474bcd6cf59bc30)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:14.177189 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf279ae-26f5-4ffc-a841-173d67a361b9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:14.271036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1013/2030] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:14 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:14.272004 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8e3b4-f169-4546-ae29-d2372a2728c8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:14.273590 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-53e8e3b4-f169-4546-ae29-d2372a2728c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:14.339724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8e3b4-f169-4546-ae29-d2372a2728c8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:14.344464 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67e559-43e4-418f-bf57-edb4489a2455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:14.345107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67e559-43e4-418f-bf57-edb4489a2455 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:14.345483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67e559-43e4-418f-bf57-edb4489a2455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:14.345758 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67e559-43e4-418f-bf57-edb4489a2455 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:14.346395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67e559-43e4-418f-bf57-edb4489a2455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:14.348330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67e559-43e4-418f-bf57-edb4489a2455 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:14.374066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5bf279ae-26f5-4ffc-a841-173d67a361b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d652c6d993483fa474bcd6cf59bc30'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:14.386416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5bf279ae-26f5-4ffc-a841-173d67a361b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d652c6d993483fa474bcd6cf59bc30'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:14.440917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1014/2031] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:14 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:14.441855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67e559-43e4-418f-bf57-edb4489a2455 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:14.443507 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0a67e559-43e4-418f-bf57-edb4489a2455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:14.463183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5bf279ae-26f5-4ffc-a841-173d67a361b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d652c6d993483fa474bcd6cf59bc30'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:14.470660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5bf279ae-26f5-4ffc-a841-173d67a361b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d652c6d993483fa474bcd6cf59bc30'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:14.471381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5bf279ae-26f5-4ffc-a841-173d67a361b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d652c6d993483fa474bcd6cf59bc30'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:14.477384 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1018/2032] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:14 2022] DELETE /identity/v3/users/08d652c6d993483fa474bcd6cf59bc30 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:14.478303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf279ae-26f5-4ffc-a841-173d67a361b9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:14.480504 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5bf279ae-26f5-4ffc-a841-173d67a361b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:14.506847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67e559-43e4-418f-bf57-edb4489a2455 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:14.558430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf279ae-26f5-4ffc-a841-173d67a361b9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:14.564624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:14.565536 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:14.566038 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:14.566492 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] PATH_INFO: `/v3/projects/b396ef8869f14d62b0ef6d9124d63e86` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:14.568777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b396ef8869f14d62b0ef6d9124d63e86)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:14.572031 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:14.607901 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936322d6-0057-4718-90c6-71ca086bb5ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:14.610179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936322d6-0057-4718-90c6-71ca086bb5ec service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:14.610542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936322d6-0057-4718-90c6-71ca086bb5ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:14.610888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936322d6-0057-4718-90c6-71ca086bb5ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:14.612945 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-936322d6-0057-4718-90c6-71ca086bb5ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:14.688139 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936322d6-0057-4718-90c6-71ca086bb5ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:14.689719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936322d6-0057-4718-90c6-71ca086bb5ec service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:14.703392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b396ef8869f14d62b0ef6d9124d63e86', 'request_id': 'req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:14.703590 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1015/2033] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:14.704458 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936322d6-0057-4718-90c6-71ca086bb5ec service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:14.706239 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-936322d6-0057-4718-90c6-71ca086bb5ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:14.720105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936322d6-0057-4718-90c6-71ca086bb5ec service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:14.798869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f42a3d-e431-4503-a5b6-82f186d42e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:14.799492 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f42a3d-e431-4503-a5b6-82f186d42e01 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:14.799779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f42a3d-e431-4503-a5b6-82f186d42e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:14.801071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f42a3d-e431-4503-a5b6-82f186d42e01 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:14.801782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b396ef8869f14d62b0ef6d9124d63e86', 'request_id': 'req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:14.801966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f42a3d-e431-4503-a5b6-82f186d42e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:14.804268 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f42a3d-e431-4503-a5b6-82f186d42e01 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:14.811949 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b396ef8869f14d62b0ef6d9124d63e86', 'request_id': 'req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:14.832078 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] The token cache is being invalidate because project b396ef8869f14d62b0ef6d9124d63e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:14.832501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:14.833229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:14.834997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1019/2034] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:14 2022] DELETE /identity/v3/projects/b396ef8869f14d62b0ef6d9124d63e86 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:14.839559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:14.841078 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:14.855493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c1c7e-01ac-4dc0-975c-b9e6cc64194b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:14.862636 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430fddb-7cfb-44a6-9781-ea1b118e5e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:14.863386 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430fddb-7cfb-44a6-9781-ea1b118e5e55 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:14.863703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430fddb-7cfb-44a6-9781-ea1b118e5e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:14.863979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430fddb-7cfb-44a6-9781-ea1b118e5e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:14.864853 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430fddb-7cfb-44a6-9781-ea1b118e5e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:14.866299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430fddb-7cfb-44a6-9781-ea1b118e5e55 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:14.883197 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1020/2035] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:14.889136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430fddb-7cfb-44a6-9781-ea1b118e5e55 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:14.889136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a430fddb-7cfb-44a6-9781-ea1b118e5e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:14.900260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430fddb-7cfb-44a6-9781-ea1b118e5e55 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:14.905556 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:14.906317 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:14.906598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:14.906871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] PATH_INFO: `/v3/projects/c870fee6a7f0493e9c5270d8db3146ed` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:14.908164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c870fee6a7f0493e9c5270d8db3146ed)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:14.910267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:14.917388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1016/2036] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:14 2022] POST /identity/v3/users => generated 281 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:14.921356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f42a3d-e431-4503-a5b6-82f186d42e01 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:14.923288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c4f42a3d-e431-4503-a5b6-82f186d42e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:14.937101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f42a3d-e431-4503-a5b6-82f186d42e01 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:14.942656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72bdab-5877-434f-b765-58174002b4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:14.943402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72bdab-5877-434f-b765-58174002b4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:14.943684 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72bdab-5877-434f-b765-58174002b4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:14.943958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72bdab-5877-434f-b765-58174002b4fe admin admin] PATH_INFO: `/v3/users/c910ed2fef154780bee44cd4014c2d6f` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:14.945124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72bdab-5877-434f-b765-58174002b4fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c910ed2fef154780bee44cd4014c2d6f)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:14.947133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72bdab-5877-434f-b765-58174002b4fe admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:15.060362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c870fee6a7f0493e9c5270d8db3146ed', 'request_id': 'req-d06091d2-8439-4bf9-baa2-6c93438b19a6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:15.169107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c870fee6a7f0493e9c5270d8db3146ed', 'request_id': 'req-d06091d2-8439-4bf9-baa2-6c93438b19a6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:15.175070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c870fee6a7f0493e9c5270d8db3146ed', 'request_id': 'req-d06091d2-8439-4bf9-baa2-6c93438b19a6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:15.186474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] The token cache is being invalidate because project c870fee6a7f0493e9c5270d8db3146ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:15.186759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:15.187397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:15.188889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1021/2037] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:14 2022] DELETE /identity/v3/projects/c870fee6a7f0493e9c5270d8db3146ed => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:15.189764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:15.191019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:15.244760 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eb72bdab-5877-434f-b765-58174002b4fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c910ed2fef154780bee44cd4014c2d6f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:15.245697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eb72bdab-5877-434f-b765-58174002b4fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c910ed2fef154780bee44cd4014c2d6f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:15.259709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eb72bdab-5877-434f-b765-58174002b4fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c910ed2fef154780bee44cd4014c2d6f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:15.266703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06091d2-8439-4bf9-baa2-6c93438b19a6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:15.267660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eb72bdab-5877-434f-b765-58174002b4fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c910ed2fef154780bee44cd4014c2d6f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:15.268449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-eb72bdab-5877-434f-b765-58174002b4fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c910ed2fef154780bee44cd4014c2d6f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:15.275124 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5cad2-3e86-4c12-bdf4-e7214389b77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:15.281967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5cad2-3e86-4c12-bdf4-e7214389b77c admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:15.281967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5cad2-3e86-4c12-bdf4-e7214389b77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:15.281967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5cad2-3e86-4c12-bdf4-e7214389b77c admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:15.281967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5cad2-3e86-4c12-bdf4-e7214389b77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:15.281967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5cad2-3e86-4c12-bdf4-e7214389b77c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:15.290868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1022/2038] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:15.291694 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5cad2-3e86-4c12-bdf4-e7214389b77c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:15.293358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-aac5cad2-3e86-4c12-bdf4-e7214389b77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:15.305460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5cad2-3e86-4c12-bdf4-e7214389b77c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:15.310136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b995ab9-1991-47a0-9ff8-4eec7ea6ccaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:15.310637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995ab9-1991-47a0-9ff8-4eec7ea6ccaa admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:15.310919 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995ab9-1991-47a0-9ff8-4eec7ea6ccaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:15.311193 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995ab9-1991-47a0-9ff8-4eec7ea6ccaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:15.311818 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b995ab9-1991-47a0-9ff8-4eec7ea6ccaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:15.313406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b995ab9-1991-47a0-9ff8-4eec7ea6ccaa admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:15.323972 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1023/2039] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:15.325191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b219c1d-4f7e-407b-b30d-feb684a3aa88 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:15.325534 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b219c1d-4f7e-407b-b30d-feb684a3aa88 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:15.326184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b219c1d-4f7e-407b-b30d-feb684a3aa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:15.346107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7b219c1d-4f7e-407b-b30d-feb684a3aa88 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:15.347367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7b219c1d-4f7e-407b-b30d-feb684a3aa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:15.354922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1017/2040] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:14 2022] DELETE /identity/v3/users/c910ed2fef154780bee44cd4014c2d6f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:15.355388 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1024/2041] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:15.356179 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b219c1d-4f7e-407b-b30d-feb684a3aa88 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:15.359035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72bdab-5877-434f-b765-58174002b4fe admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:15.361250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eb72bdab-5877-434f-b765-58174002b4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:15.367503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b219c1d-4f7e-407b-b30d-feb684a3aa88 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:15.429715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c44707-1439-44d0-ae52-732442ef3a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:15.431040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44707-1439-44d0-ae52-732442ef3a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:15.431327 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44707-1439-44d0-ae52-732442ef3a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:15.431598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44707-1439-44d0-ae52-732442ef3a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:15.432344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c44707-1439-44d0-ae52-732442ef3a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:15.434176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c44707-1439-44d0-ae52-732442ef3a09 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:15.449058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1025/2042] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:15.449058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a37e7-67db-485b-8ef7-b89246c887d2 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:15.449058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a37e7-67db-485b-8ef7-b89246c887d2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:15.449058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a37e7-67db-485b-8ef7-b89246c887d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:15.471576 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-845a37e7-67db-485b-8ef7-b89246c887d2 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:15.472793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-845a37e7-67db-485b-8ef7-b89246c887d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:15.477040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72bdab-5877-434f-b765-58174002b4fe admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:15.486313 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5de4e7-3e3c-4857-b5a8-7ea74bc1bca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:15.487137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5de4e7-3e3c-4857-b5a8-7ea74bc1bca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:15.487427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5de4e7-3e3c-4857-b5a8-7ea74bc1bca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:15.487698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5de4e7-3e3c-4857-b5a8-7ea74bc1bca5 admin admin] PATH_INFO: `/v3/projects/316c8212805340078396833dbc21467d/users/34832b730ff4492da99c969f5e7f9852/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:15.488187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1026/2043] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:15.489065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a37e7-67db-485b-8ef7-b89246c887d2 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:15.499694 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a37e7-67db-485b-8ef7-b89246c887d2 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:15.505239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bdf32-1fe4-421b-a572-1437c44aabdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:15.506991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bdf32-1fe4-421b-a572-1437c44aabdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:15.506991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bdf32-1fe4-421b-a572-1437c44aabdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:15.506991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bdf32-1fe4-421b-a572-1437c44aabdf admin admin] PATH_INFO: `/v3/projects/89212c5e606c45d494125c06adb0deba/users/9435dad30c5a40368fc486e9ac10f7ce/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:15.508605 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5de4e7-3e3c-4857-b5a8-7ea74bc1bca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=316c8212805340078396833dbc21467d, user_id=34832b730ff4492da99c969f5e7f9852, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:15.511491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5de4e7-3e3c-4857-b5a8-7ea74bc1bca5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:15.523855 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95bdf32-1fe4-421b-a572-1437c44aabdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=89212c5e606c45d494125c06adb0deba, user_id=9435dad30c5a40368fc486e9ac10f7ce, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:15.527949 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95bdf32-1fe4-421b-a572-1437c44aabdf admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:15.621980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1018/2044] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:15 2022] PUT /identity/v3/projects/316c8212805340078396833dbc21467d/users/34832b730ff4492da99c969f5e7f9852/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:15.621980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5de4e7-3e3c-4857-b5a8-7ea74bc1bca5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:15.654742 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1027/2045] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:15 2022] PUT /identity/v3/projects/89212c5e606c45d494125c06adb0deba/users/9435dad30c5a40368fc486e9ac10f7ce/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:15.656193 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f06f1-ac3f-49ae-a8cf-b72e1db3ec5f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:15.656559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f06f1-ac3f-49ae-a8cf-b72e1db3ec5f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:15.656882 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f06f1-ac3f-49ae-a8cf-b72e1db3ec5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:15.707356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5de4e7-3e3c-4857-b5a8-7ea74bc1bca5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:15.720551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ae0f06f1-ac3f-49ae-a8cf-b72e1db3ec5f None None] MFA Rules not processed for user `34832b730ff4492da99c969f5e7f9852`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:15.723548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ae0f06f1-ac3f-49ae-a8cf-b72e1db3ec5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:15.768216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8d1db-2862-4a52-9b16-613b59642142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:15.768825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8d1db-2862-4a52-9b16-613b59642142 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:15.769108 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8d1db-2862-4a52-9b16-613b59642142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:15.769414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8d1db-2862-4a52-9b16-613b59642142 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:15.770065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8d1db-2862-4a52-9b16-613b59642142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:15.770371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8d1db-2862-4a52-9b16-613b59642142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:15.771969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8d1db-2862-4a52-9b16-613b59642142 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:15.790355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1019/2046] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:44:15.790355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0f0d-8278-4444-a279-72058ee1c1fc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:15.790355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0f0d-8278-4444-a279-72058ee1c1fc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:15.790355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0f0d-8278-4444-a279-72058ee1c1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:15.796077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:15.806606 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1028/2047] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:15.808136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f06f1-ac3f-49ae-a8cf-b72e1db3ec5f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:15.820239 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e22d0f0d-8278-4444-a279-72058ee1c1fc None None] MFA Rules not processed for user `9435dad30c5a40368fc486e9ac10f7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:15.820521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f06f1-ac3f-49ae-a8cf-b72e1db3ec5f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:15.820628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e22d0f0d-8278-4444-a279-72058ee1c1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:15.824270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84de77-8b93-4018-8ad9-09c553e4c390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:15.825078 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84de77-8b93-4018-8ad9-09c553e4c390 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:15.825960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84de77-8b93-4018-8ad9-09c553e4c390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:15.825960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84de77-8b93-4018-8ad9-09c553e4c390 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:15.826598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84de77-8b93-4018-8ad9-09c553e4c390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:15.828967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84de77-8b93-4018-8ad9-09c553e4c390 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:15.846789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:15.903588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1020/2048] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:15.904678 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d0f0d-8278-4444-a279-72058ee1c1fc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:15.915671 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d0f0d-8278-4444-a279-72058ee1c1fc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:15.921066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587e377-0670-49e4-95be-d67e9f8360ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:15.922022 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587e377-0670-49e4-95be-d67e9f8360ed admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:15.923793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587e377-0670-49e4-95be-d67e9f8360ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:15.923793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587e377-0670-49e4-95be-d67e9f8360ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:15.923793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587e377-0670-49e4-95be-d67e9f8360ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:15.924952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587e377-0670-49e4-95be-d67e9f8360ed admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:15.931980 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1029/2049] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:15 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:15.933715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84de77-8b93-4018-8ad9-09c553e4c390 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:15.937863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1a84de77-8b93-4018-8ad9-09c553e4c390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:16.016087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84de77-8b93-4018-8ad9-09c553e4c390 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:16.020954 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:16.021640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.021922 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.022196 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] PATH_INFO: `/v3/projects/58a2b56bb501479a822105c50d56ba93` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.023355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58a2b56bb501479a822105c50d56ba93)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:16.025316 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:16.046634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1021/2050] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:15 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:16.047356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587e377-0670-49e4-95be-d67e9f8360ed admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:16.123180 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587e377-0670-49e4-95be-d67e9f8360ed admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:16.132265 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fc0a2-0f0e-4906-ba5d-571aa451c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:16.133072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fc0a2-0f0e-4906-ba5d-571aa451c894 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.133380 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fc0a2-0f0e-4906-ba5d-571aa451c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.133651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fc0a2-0f0e-4906-ba5d-571aa451c894 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.134287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fc0a2-0f0e-4906-ba5d-571aa451c894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:16.136814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fc0a2-0f0e-4906-ba5d-571aa451c894 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:16.146083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58a2b56bb501479a822105c50d56ba93', 'request_id': 'req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:16.253032 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58a2b56bb501479a822105c50d56ba93', 'request_id': 'req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:16.261769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1022/2051] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:16 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:16.261955 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58a2b56bb501479a822105c50d56ba93', 'request_id': 'req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:16.262042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fc0a2-0f0e-4906-ba5d-571aa451c894 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:16.263510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ee1fc0a2-0f0e-4906-ba5d-571aa451c894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:16.270849 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] The token cache is being invalidate because project 58a2b56bb501479a822105c50d56ba93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:16.271137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:16.278168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:16.278168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1030/2052] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:15 2022] DELETE /identity/v3/projects/58a2b56bb501479a822105c50d56ba93 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:16.278168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:16.278168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:16.324455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fc0a2-0f0e-4906-ba5d-571aa451c894 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:16.343684 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444ae30-b22b-4a2a-bdb5-7aa9567ca1a7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:16.348256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391b694-7a22-42f5-837b-44c46aedb6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:16.348993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391b694-7a22-42f5-837b-44c46aedb6a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.349301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391b694-7a22-42f5-837b-44c46aedb6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.349578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391b694-7a22-42f5-837b-44c46aedb6a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.350213 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391b694-7a22-42f5-837b-44c46aedb6a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:16.352119 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391b694-7a22-42f5-837b-44c46aedb6a9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:16.373938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd1272-7c48-46e3-839c-758a0b0c188c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:16.374470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd1272-7c48-46e3-839c-758a0b0c188c service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.374777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd1272-7c48-46e3-839c-758a0b0c188c service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.375012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd1272-7c48-46e3-839c-758a0b0c188c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.376737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e9bd1272-7c48-46e3-839c-758a0b0c188c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:16.437051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd1272-7c48-46e3-839c-758a0b0c188c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:16.438984 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd1272-7c48-46e3-839c-758a0b0c188c service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:16.448617 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1031/2053] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:16 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:16.451157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1023/2054] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:16.453122 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391b694-7a22-42f5-837b-44c46aedb6a9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:16.454147 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8cdca-b5c2-4101-bb13-2ab58326c5cf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.454501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8cdca-b5c2-4101-bb13-2ab58326c5cf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.454837 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8cdca-b5c2-4101-bb13-2ab58326c5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.455314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f391b694-7a22-42f5-837b-44c46aedb6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:16.470716 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391b694-7a22-42f5-837b-44c46aedb6a9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:16.475500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64df546-1f15-460c-997f-ca3779e62b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:16.476107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64df546-1f15-460c-997f-ca3779e62b4f admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.476402 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64df546-1f15-460c-997f-ca3779e62b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.476658 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64df546-1f15-460c-997f-ca3779e62b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.476770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-65f8cdca-b5c2-4101-bb13-2ab58326c5cf None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:16.477339 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64df546-1f15-460c-997f-ca3779e62b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:16.478009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-65f8cdca-b5c2-4101-bb13-2ab58326c5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:16.478983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64df546-1f15-460c-997f-ca3779e62b4f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:16.486532 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1024/2055] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:16.487336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8cdca-b5c2-4101-bb13-2ab58326c5cf None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:16.498863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1032/2056] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:16.498863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64df546-1f15-460c-997f-ca3779e62b4f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:16.499183 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8cdca-b5c2-4101-bb13-2ab58326c5cf None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:16.499279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f64df546-1f15-460c-997f-ca3779e62b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:16.503519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d196f9-b6e3-4af3-9e79-e24bea23b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:16.504198 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d196f9-b6e3-4af3-9e79-e24bea23b10e admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.504474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d196f9-b6e3-4af3-9e79-e24bea23b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.504746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d196f9-b6e3-4af3-9e79-e24bea23b10e admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.505434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d196f9-b6e3-4af3-9e79-e24bea23b10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:16.507046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d196f9-b6e3-4af3-9e79-e24bea23b10e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:16.512309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64df546-1f15-460c-997f-ca3779e62b4f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:16.517032 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829c34b-ab80-45f7-a979-8b48f3ae46e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:16.517681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c34b-ab80-45f7-a979-8b48f3ae46e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.517972 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c34b-ab80-45f7-a979-8b48f3ae46e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.518234 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c34b-ab80-45f7-a979-8b48f3ae46e6 admin admin] PATH_INFO: `/v3/users/9435dad30c5a40368fc486e9ac10f7ce` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.518354 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1025/2057] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:16.519610 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d1f3f-db5a-419c-bf6b-d370bef5ca30 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.519947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d1f3f-db5a-419c-bf6b-d370bef5ca30 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.520222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d1f3f-db5a-419c-bf6b-d370bef5ca30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.522689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829c34b-ab80-45f7-a979-8b48f3ae46e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9435dad30c5a40368fc486e9ac10f7ce)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:16.524602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829c34b-ab80-45f7-a979-8b48f3ae46e6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:16.541846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3d7d1f3f-db5a-419c-bf6b-d370bef5ca30 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:16.541846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3d7d1f3f-db5a-419c-bf6b-d370bef5ca30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:16.552485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1026/2058] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:16.553190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d1f3f-db5a-419c-bf6b-d370bef5ca30 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:16.564964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d1f3f-db5a-419c-bf6b-d370bef5ca30 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:16.569969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10094cb5-edf4-40a0-bea1-b48e5c6b5915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:16.570910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10094cb5-edf4-40a0-bea1-b48e5c6b5915 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.571264 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10094cb5-edf4-40a0-bea1-b48e5c6b5915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.571534 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10094cb5-edf4-40a0-bea1-b48e5c6b5915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.572178 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10094cb5-edf4-40a0-bea1-b48e5c6b5915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:16.574355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10094cb5-edf4-40a0-bea1-b48e5c6b5915 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:16.584829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1027/2059] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:16.585638 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10094cb5-edf4-40a0-bea1-b48e5c6b5915 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:16.597993 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10094cb5-edf4-40a0-bea1-b48e5c6b5915 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:16.603018 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b08e9-6ee3-4f02-bc9b-f6aee27f2b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:16.603658 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b08e9-6ee3-4f02-bc9b-f6aee27f2b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.603960 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b08e9-6ee3-4f02-bc9b-f6aee27f2b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.604263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b08e9-6ee3-4f02-bc9b-f6aee27f2b46 admin admin] PATH_INFO: `/v3/projects/da240f8e65004d18b0873b7e048253fd/users/8fe080b967334be9b998ca5edad9c7ca/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.620425 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b08e9-6ee3-4f02-bc9b-f6aee27f2b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da240f8e65004d18b0873b7e048253fd, user_id=8fe080b967334be9b998ca5edad9c7ca, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:16.623206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b08e9-6ee3-4f02-bc9b-f6aee27f2b46 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:16.716949 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5829c34b-ab80-45f7-a979-8b48f3ae46e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9435dad30c5a40368fc486e9ac10f7ce'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:16.730502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5829c34b-ab80-45f7-a979-8b48f3ae46e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9435dad30c5a40368fc486e9ac10f7ce'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:16.761372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1028/2060] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:16 2022] PUT /identity/v3/projects/da240f8e65004d18b0873b7e048253fd/users/8fe080b967334be9b998ca5edad9c7ca/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:16.762303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b08e9-6ee3-4f02-bc9b-f6aee27f2b46 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:16.818656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5829c34b-ab80-45f7-a979-8b48f3ae46e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9435dad30c5a40368fc486e9ac10f7ce'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:16.824604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b08e9-6ee3-4f02-bc9b-f6aee27f2b46 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:16.826810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5829c34b-ab80-45f7-a979-8b48f3ae46e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9435dad30c5a40368fc486e9ac10f7ce'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:16.827633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5829c34b-ab80-45f7-a979-8b48f3ae46e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9435dad30c5a40368fc486e9ac10f7ce'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:16.829637 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca781956-1428-4f23-bb5c-11aae9250b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:16.830251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca781956-1428-4f23-bb5c-11aae9250b16 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.830535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca781956-1428-4f23-bb5c-11aae9250b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.830844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca781956-1428-4f23-bb5c-11aae9250b16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.831497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca781956-1428-4f23-bb5c-11aae9250b16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:16.831802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca781956-1428-4f23-bb5c-11aae9250b16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:16.833432 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca781956-1428-4f23-bb5c-11aae9250b16 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:16.833975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1033/2061] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:16 2022] DELETE /identity/v3/users/9435dad30c5a40368fc486e9ac10f7ce => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:16.834972 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829c34b-ab80-45f7-a979-8b48f3ae46e6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:16.836292 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5829c34b-ab80-45f7-a979-8b48f3ae46e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:16.846146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1029/2062] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:44:16.847522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca781956-1428-4f23-bb5c-11aae9250b16 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:16.849227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ca781956-1428-4f23-bb5c-11aae9250b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:16.863525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca781956-1428-4f23-bb5c-11aae9250b16 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:16.907755 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829c34b-ab80-45f7-a979-8b48f3ae46e6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:16.915686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99479b83-eb1e-41f0-9ec4-518667b1b8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:16.917708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99479b83-eb1e-41f0-9ec4-518667b1b8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.917923 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99479b83-eb1e-41f0-9ec4-518667b1b8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.918366 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99479b83-eb1e-41f0-9ec4-518667b1b8f1 admin admin] PATH_INFO: `/v3/projects/0ae08e291863440f88582fdbde3c0237/users/5b584800b7f0409bb1d3069718397c2e/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.936277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99479b83-eb1e-41f0-9ec4-518667b1b8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae08e291863440f88582fdbde3c0237, user_id=5b584800b7f0409bb1d3069718397c2e, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:16.936509 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395f23e-d166-4161-879c-01932df7462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:16.937058 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f23e-d166-4161-879c-01932df7462a admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.937154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f23e-d166-4161-879c-01932df7462a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.937536 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f23e-d166-4161-879c-01932df7462a admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.938180 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395f23e-d166-4161-879c-01932df7462a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:16.939607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99479b83-eb1e-41f0-9ec4-518667b1b8f1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:16.939726 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395f23e-d166-4161-879c-01932df7462a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:16.949996 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1030/2063] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:16.951415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37868bab-ab7a-485d-a3eb-7339fa313b7e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:16.951697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37868bab-ab7a-485d-a3eb-7339fa313b7e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:16.951961 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37868bab-ab7a-485d-a3eb-7339fa313b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:16.970407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-37868bab-ab7a-485d-a3eb-7339fa313b7e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:16.978734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-37868bab-ab7a-485d-a3eb-7339fa313b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:16.979859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1031/2064] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:16.980623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37868bab-ab7a-485d-a3eb-7339fa313b7e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:16.981884 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-37868bab-ab7a-485d-a3eb-7339fa313b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:16.993520 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37868bab-ab7a-485d-a3eb-7339fa313b7e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:16.999352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311453c-bac4-4b19-adc2-d345d07fbf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:16.999972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311453c-bac4-4b19-adc2-d345d07fbf04 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.000247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311453c-bac4-4b19-adc2-d345d07fbf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.000514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311453c-bac4-4b19-adc2-d345d07fbf04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.001178 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311453c-bac4-4b19-adc2-d345d07fbf04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:17.003173 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311453c-bac4-4b19-adc2-d345d07fbf04 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:17.014197 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1034/2065] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:16 2022] PUT /identity/v3/projects/0ae08e291863440f88582fdbde3c0237/users/5b584800b7f0409bb1d3069718397c2e/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:17.015686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99479b83-eb1e-41f0-9ec4-518667b1b8f1 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:17.080549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99479b83-eb1e-41f0-9ec4-518667b1b8f1 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:17.085346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d8eab-b148-47f4-b6a5-d6a6e1e7195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:17.086077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8eab-b148-47f4-b6a5-d6a6e1e7195f admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.086370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8eab-b148-47f4-b6a5-d6a6e1e7195f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.086643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8eab-b148-47f4-b6a5-d6a6e1e7195f admin admin] PATH_INFO: `/v3/projects/da240f8e65004d18b0873b7e048253fd/users/8fe080b967334be9b998ca5edad9c7ca/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.089233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d8eab-b148-47f4-b6a5-d6a6e1e7195f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da240f8e65004d18b0873b7e048253fd, user_id=8fe080b967334be9b998ca5edad9c7ca, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:17.094288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d8eab-b148-47f4-b6a5-d6a6e1e7195f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:17.096882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1032/2066] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:16 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:17.097771 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311453c-bac4-4b19-adc2-d345d07fbf04 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:17.100958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c311453c-bac4-4b19-adc2-d345d07fbf04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:17.105634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1035/2067] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:17 2022] PUT /identity/v3/projects/da240f8e65004d18b0873b7e048253fd/users/8fe080b967334be9b998ca5edad9c7ca/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:17.107006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bd2b9-55f5-46e9-b369-7ce4967176a6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.107288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bd2b9-55f5-46e9-b369-7ce4967176a6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.107560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bd2b9-55f5-46e9-b369-7ce4967176a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.126949 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c92bd2b9-55f5-46e9-b369-7ce4967176a6 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:17.128148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c92bd2b9-55f5-46e9-b369-7ce4967176a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:17.176778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311453c-bac4-4b19-adc2-d345d07fbf04 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:17.196440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1036/2068] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:17.197174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bd2b9-55f5-46e9-b369-7ce4967176a6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:17.208293 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bd2b9-55f5-46e9-b369-7ce4967176a6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:17.214648 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9073b9-e0bb-4f7c-9321-08ff08c89392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:17.215338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9073b9-e0bb-4f7c-9321-08ff08c89392 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.215630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9073b9-e0bb-4f7c-9321-08ff08c89392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.225133 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9073b9-e0bb-4f7c-9321-08ff08c89392 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.225133 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9073b9-e0bb-4f7c-9321-08ff08c89392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:17.225133 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9073b9-e0bb-4f7c-9321-08ff08c89392 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:17.238286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5fb04-4c41-4754-90d0-d82030ea2baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:17.239157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5fb04-4c41-4754-90d0-d82030ea2baa service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.239434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5fb04-4c41-4754-90d0-d82030ea2baa service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.239762 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5fb04-4c41-4754-90d0-d82030ea2baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.251388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5fb04-4c41-4754-90d0-d82030ea2baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:17.252810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5fb04-4c41-4754-90d0-d82030ea2baa service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:17.263541 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1033/2069] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:17.265084 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a6e1c-725e-4ab5-9886-fdacaa49c78c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.265399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a6e1c-725e-4ab5-9886-fdacaa49c78c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.269667 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a6e1c-725e-4ab5-9886-fdacaa49c78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.278328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:17.309855 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1037/2070] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:17 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:17.309855 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9073b9-e0bb-4f7c-9321-08ff08c89392 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:17.311458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:17.319526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c68a6e1c-725e-4ab5-9886-fdacaa49c78c None None] MFA Rules not processed for user `8fe080b967334be9b998ca5edad9c7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:17.322025 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c68a6e1c-725e-4ab5-9886-fdacaa49c78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:17.328455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9073b9-e0bb-4f7c-9321-08ff08c89392 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:17.335142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1b070-55d5-4808-817c-6be7ff154f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:17.335911 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1b070-55d5-4808-817c-6be7ff154f47 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.336560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1b070-55d5-4808-817c-6be7ff154f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.336839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1b070-55d5-4808-817c-6be7ff154f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.353395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1b070-55d5-4808-817c-6be7ff154f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:17.355202 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1b070-55d5-4808-817c-6be7ff154f47 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:17.369472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1038/2071] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:17.372373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1b070-55d5-4808-817c-6be7ff154f47 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:17.386460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1b070-55d5-4808-817c-6be7ff154f47 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:17.394242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee912b6-232f-464a-8e5d-52703bc8f4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:17.394870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee912b6-232f-464a-8e5d-52703bc8f4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.395194 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee912b6-232f-464a-8e5d-52703bc8f4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.395531 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee912b6-232f-464a-8e5d-52703bc8f4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.396353 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee912b6-232f-464a-8e5d-52703bc8f4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:17.398048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee912b6-232f-464a-8e5d-52703bc8f4b7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:17.415822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1039/2072] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:17.417540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee912b6-232f-464a-8e5d-52703bc8f4b7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:17.428938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee912b6-232f-464a-8e5d-52703bc8f4b7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:17.432954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1034/2073] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:17.449926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debd2d1-22a0-418d-8ec2-f29103a068d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:17.449926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debd2d1-22a0-418d-8ec2-f29103a068d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.449926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debd2d1-22a0-418d-8ec2-f29103a068d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.449926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debd2d1-22a0-418d-8ec2-f29103a068d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.450603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debd2d1-22a0-418d-8ec2-f29103a068d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:17.450603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debd2d1-22a0-418d-8ec2-f29103a068d6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:17.455241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a6e1c-725e-4ab5-9886-fdacaa49c78c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:17.456772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c68a6e1c-725e-4ab5-9886-fdacaa49c78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:17.462974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1040/2074] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:17.471740 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debd2d1-22a0-418d-8ec2-f29103a068d6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:17.482272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debd2d1-22a0-418d-8ec2-f29103a068d6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:17.487617 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54a876-756a-45ab-9bb9-bacd692ef75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:17.488656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54a876-756a-45ab-9bb9-bacd692ef75f admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.488656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54a876-756a-45ab-9bb9-bacd692ef75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.488855 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54a876-756a-45ab-9bb9-bacd692ef75f admin admin] PATH_INFO: `/v3/projects/13e76535e4da498bad352f35cdbd446d/users/86bb7373d075431b94cb4c238065a178/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.504998 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54a876-756a-45ab-9bb9-bacd692ef75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e76535e4da498bad352f35cdbd446d, user_id=86bb7373d075431b94cb4c238065a178, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:17.507726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54a876-756a-45ab-9bb9-bacd692ef75f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:17.532241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a6e1c-725e-4ab5-9886-fdacaa49c78c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:17.536814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094638a-4e21-438a-8b8a-8bc3758cd879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:17.537462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094638a-4e21-438a-8b8a-8bc3758cd879 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.537795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094638a-4e21-438a-8b8a-8bc3758cd879 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.538077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094638a-4e21-438a-8b8a-8bc3758cd879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.549058 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094638a-4e21-438a-8b8a-8bc3758cd879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:17.550600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094638a-4e21-438a-8b8a-8bc3758cd879 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:17.560839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1035/2075] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:17.617487 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1041/2076] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:17 2022] PUT /identity/v3/projects/13e76535e4da498bad352f35cdbd446d/users/86bb7373d075431b94cb4c238065a178/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:17.628498 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3eedaa-c1d7-4585-be0e-f1b17481851b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.629046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3eedaa-c1d7-4585-be0e-f1b17481851b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.629838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3eedaa-c1d7-4585-be0e-f1b17481851b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.663104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0b3eedaa-c1d7-4585-be0e-f1b17481851b None None] MFA Rules not processed for user `86bb7373d075431b94cb4c238065a178`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:17.664327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0b3eedaa-c1d7-4585-be0e-f1b17481851b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:17.744467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1036/2077] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:17.748726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54a876-756a-45ab-9bb9-bacd692ef75f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:17.748860 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3eedaa-c1d7-4585-be0e-f1b17481851b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:17.809494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54a876-756a-45ab-9bb9-bacd692ef75f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:17.813430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b129a-5b13-46f5-95bb-90c3cc5e7f44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:17.814054 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b129a-5b13-46f5-95bb-90c3cc5e7f44 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.814336 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b129a-5b13-46f5-95bb-90c3cc5e7f44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.814608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b129a-5b13-46f5-95bb-90c3cc5e7f44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.816483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f18b129a-5b13-46f5-95bb-90c3cc5e7f44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:17.817663 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3eedaa-c1d7-4585-be0e-f1b17481851b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:17.824226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4b4c6-eed5-46aa-9bbc-31ca1008a579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:17.824828 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4b4c6-eed5-46aa-9bbc-31ca1008a579 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.826753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4b4c6-eed5-46aa-9bbc-31ca1008a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.826753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4b4c6-eed5-46aa-9bbc-31ca1008a579 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.826753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4b4c6-eed5-46aa-9bbc-31ca1008a579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:17.831679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4b4c6-eed5-46aa-9bbc-31ca1008a579 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:17.911772 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b129a-5b13-46f5-95bb-90c3cc5e7f44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:17.913544 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b129a-5b13-46f5-95bb-90c3cc5e7f44 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:17.924161 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1042/2078] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:17.924986 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b129a-5b13-46f5-95bb-90c3cc5e7f44 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:17.926431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f18b129a-5b13-46f5-95bb-90c3cc5e7f44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:17.940302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b129a-5b13-46f5-95bb-90c3cc5e7f44 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:17.944871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91a361-890f-47df-b624-5cb7392a077c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:17.945523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91a361-890f-47df-b624-5cb7392a077c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:17.945804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91a361-890f-47df-b624-5cb7392a077c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:17.946074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91a361-890f-47df-b624-5cb7392a077c admin admin] PATH_INFO: `/v3/projects/89212c5e606c45d494125c06adb0deba` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:17.947464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91a361-890f-47df-b624-5cb7392a077c admin admin] RBAC: Authorizing `identity:delete_project(project_id=89212c5e606c45d494125c06adb0deba)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:17.956188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91a361-890f-47df-b624-5cb7392a077c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:17.969907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1037/2079] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:17 2022] POST /identity/v3/projects => generated 393 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:17.973802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4b4c6-eed5-46aa-9bbc-31ca1008a579 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:18.045073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4b4c6-eed5-46aa-9bbc-31ca1008a579 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:18.049826 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeeba5-eb33-4e1b-98f3-05586d6b755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:18.050446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeeba5-eb33-4e1b-98f3-05586d6b755c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:18.050732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeeba5-eb33-4e1b-98f3-05586d6b755c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:18.051033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeeba5-eb33-4e1b-98f3-05586d6b755c admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:18.051702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedeeba5-eb33-4e1b-98f3-05586d6b755c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:18.053687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedeeba5-eb33-4e1b-98f3-05586d6b755c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:18.097508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0d91a361-890f-47df-b624-5cb7392a077c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89212c5e606c45d494125c06adb0deba', 'request_id': 'req-0d91a361-890f-47df-b624-5cb7392a077c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:18.184559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0d91a361-890f-47df-b624-5cb7392a077c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89212c5e606c45d494125c06adb0deba', 'request_id': 'req-0d91a361-890f-47df-b624-5cb7392a077c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:18.194096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0d91a361-890f-47df-b624-5cb7392a077c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89212c5e606c45d494125c06adb0deba', 'request_id': 'req-0d91a361-890f-47df-b624-5cb7392a077c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:18.194243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1038/2080] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:17 2022] POST /identity/v3/users => generated 303 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:18.197147 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeeba5-eb33-4e1b-98f3-05586d6b755c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:18.217228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeeba5-eb33-4e1b-98f3-05586d6b755c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:18.234764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0d91a361-890f-47df-b624-5cb7392a077c admin admin] The token cache is being invalidate because project 89212c5e606c45d494125c06adb0deba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:18.235060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0d91a361-890f-47df-b624-5cb7392a077c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:18.237937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0d91a361-890f-47df-b624-5cb7392a077c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:18.241068 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1043/2081] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:17 2022] DELETE /identity/v3/projects/89212c5e606c45d494125c06adb0deba => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:18.246766 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d708979-c2c8-442d-a0a6-5487d4a27b17 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:18.247003 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d708979-c2c8-442d-a0a6-5487d4a27b17 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:18.247147 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d708979-c2c8-442d-a0a6-5487d4a27b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:18.273899 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-7d708979-c2c8-442d-a0a6-5487d4a27b17 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:18.275204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7d708979-c2c8-442d-a0a6-5487d4a27b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:18.313585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1854fa-699d-47f9-baa7-cdbd494eb79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:18.314378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1854fa-699d-47f9-baa7-cdbd494eb79b admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:18.315114 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1854fa-699d-47f9-baa7-cdbd494eb79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:18.315407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1854fa-699d-47f9-baa7-cdbd494eb79b admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:18.316476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1854fa-699d-47f9-baa7-cdbd494eb79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:18.319097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1854fa-699d-47f9-baa7-cdbd494eb79b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:18.335302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1039/2082] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:18.339956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1854fa-699d-47f9-baa7-cdbd494eb79b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:18.341894 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bf1854fa-699d-47f9-baa7-cdbd494eb79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:18.355451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1854fa-699d-47f9-baa7-cdbd494eb79b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:18.358128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1044/2083] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:18.367668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e54b62-ffa9-4be0-9187-36cee7fffaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:18.368190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9382b7-ff0c-47a4-8555-0e066ce1bbcd None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:18.368336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e54b62-ffa9-4be0-9187-36cee7fffaad admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:18.368612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e54b62-ffa9-4be0-9187-36cee7fffaad admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:18.368888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e54b62-ffa9-4be0-9187-36cee7fffaad admin admin] PATH_INFO: `/v3/projects/741d2223122648a1a02528c649c1a24e/users/2c5f873cbe1e4875903d854610249888/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:18.369030 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9382b7-ff0c-47a4-8555-0e066ce1bbcd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:18.369450 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9382b7-ff0c-47a4-8555-0e066ce1bbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:18.386950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e54b62-ffa9-4be0-9187-36cee7fffaad admin admin] RBAC: Authorizing `identity:create_grant(project_id=741d2223122648a1a02528c649c1a24e, user_id=2c5f873cbe1e4875903d854610249888, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:18.389742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e54b62-ffa9-4be0-9187-36cee7fffaad admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:18.393546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6d9382b7-ff0c-47a4-8555-0e066ce1bbcd None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:18.394771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6d9382b7-ff0c-47a4-8555-0e066ce1bbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:18.403477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1045/2084] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:18.407661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9382b7-ff0c-47a4-8555-0e066ce1bbcd None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:18.417998 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9382b7-ff0c-47a4-8555-0e066ce1bbcd None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:18.422824 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9201d-ab4e-4a2b-be36-623b7e99f048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:18.423419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9201d-ab4e-4a2b-be36-623b7e99f048 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:18.423695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9201d-ab4e-4a2b-be36-623b7e99f048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:18.423965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9201d-ab4e-4a2b-be36-623b7e99f048 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:18.424614 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9201d-ab4e-4a2b-be36-623b7e99f048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:18.424913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9201d-ab4e-4a2b-be36-623b7e99f048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:18.426547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9201d-ab4e-4a2b-be36-623b7e99f048 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:18.439182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1046/2085] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:44:18.443224 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9201d-ab4e-4a2b-be36-623b7e99f048 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:18.455244 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9201d-ab4e-4a2b-be36-623b7e99f048 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:18.462136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5027f-ce46-4f3b-b676-3577e0412d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:18.463016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5027f-ce46-4f3b-b676-3577e0412d6c admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:18.463421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5027f-ce46-4f3b-b676-3577e0412d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:18.463758 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5027f-ce46-4f3b-b676-3577e0412d6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:18.465179 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5027f-ce46-4f3b-b676-3577e0412d6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:18.468010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5027f-ce46-4f3b-b676-3577e0412d6c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:18.472417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:18.501261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1040/2086] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:18 2022] PUT /identity/v3/projects/741d2223122648a1a02528c649c1a24e/users/2c5f873cbe1e4875903d854610249888/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:18.504237 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e54b62-ffa9-4be0-9187-36cee7fffaad admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:18.550995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:18.584232 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e54b62-ffa9-4be0-9187-36cee7fffaad admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:18.586959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1047/2087] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:18 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:18.590037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78564f-358f-4c4d-a110-555b4b9db9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:18.590951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78564f-358f-4c4d-a110-555b4b9db9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:18.591229 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78564f-358f-4c4d-a110-555b4b9db9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:18.591333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5027f-ce46-4f3b-b676-3577e0412d6c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:18.591496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78564f-358f-4c4d-a110-555b4b9db9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:18.592203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78564f-358f-4c4d-a110-555b4b9db9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:18.593920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78564f-358f-4c4d-a110-555b4b9db9a9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:18.605841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1041/2088] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:18.610250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78564f-358f-4c4d-a110-555b4b9db9a9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:18.624176 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78564f-358f-4c4d-a110-555b4b9db9a9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:18.710069 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5027f-ce46-4f3b-b676-3577e0412d6c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:18.711186 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c178985-6098-427e-83d0-29c44465f1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:18.711897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c178985-6098-427e-83d0-29c44465f1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:18.715585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c178985-6098-427e-83d0-29c44465f1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:18.715585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c178985-6098-427e-83d0-29c44465f1b3 admin admin] PATH_INFO: `/v3/projects/741d2223122648a1a02528c649c1a24e/users/2c5f873cbe1e4875903d854610249888/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:18.715585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c178985-6098-427e-83d0-29c44465f1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=741d2223122648a1a02528c649c1a24e, user_id=2c5f873cbe1e4875903d854610249888, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:18.718366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c178985-6098-427e-83d0-29c44465f1b3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:18.726034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc49a25-b93f-4705-a075-f4a294a9a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:18.726971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49a25-b93f-4705-a075-f4a294a9a850 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:18.727355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49a25-b93f-4705-a075-f4a294a9a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:18.727716 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49a25-b93f-4705-a075-f4a294a9a850 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:18.728470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc49a25-b93f-4705-a075-f4a294a9a850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:18.730935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc49a25-b93f-4705-a075-f4a294a9a850 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:18.731203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1042/2089] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:18 2022] PUT /identity/v3/projects/741d2223122648a1a02528c649c1a24e/users/2c5f873cbe1e4875903d854610249888/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:18.732117 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c178985-6098-427e-83d0-29c44465f1b3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:18.733728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4c178985-6098-427e-83d0-29c44465f1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:18.800182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c178985-6098-427e-83d0-29c44465f1b3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:18.805693 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6bbcd-5434-4364-a8dd-3664dfdfa14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:18.806497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6bbcd-5434-4364-a8dd-3664dfdfa14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:18.806867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6bbcd-5434-4364-a8dd-3664dfdfa14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:18.807685 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6bbcd-5434-4364-a8dd-3664dfdfa14d admin admin] PATH_INFO: `/v3/users/34832b730ff4492da99c969f5e7f9852` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:18.808871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6bbcd-5434-4364-a8dd-3664dfdfa14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=34832b730ff4492da99c969f5e7f9852)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:18.810838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6bbcd-5434-4364-a8dd-3664dfdfa14d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:18.852656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1048/2090] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:18 2022] POST /identity/v3/users => generated 285 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:18.854271 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64e71-101b-44ee-b495-38562e1fee3c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:18.854500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64e71-101b-44ee-b495-38562e1fee3c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:18.854745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64e71-101b-44ee-b495-38562e1fee3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:18.882845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f0b64e71-101b-44ee-b495-38562e1fee3c None None] MFA Rules not processed for user `2c5f873cbe1e4875903d854610249888`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:18.884089 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f0b64e71-101b-44ee-b495-38562e1fee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:18.962039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1049/2091] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:18.966535 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b64e71-101b-44ee-b495-38562e1fee3c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:18.976721 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b64e71-101b-44ee-b495-38562e1fee3c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:18.982632 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8fe50-1455-485c-9ca3-ffa0afc8f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:18.987229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8fe50-1455-485c-9ca3-ffa0afc8f28f admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:18.987229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8fe50-1455-485c-9ca3-ffa0afc8f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:18.987229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8fe50-1455-485c-9ca3-ffa0afc8f28f admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:18.987229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8fe50-1455-485c-9ca3-ffa0afc8f28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:18.987229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8fe50-1455-485c-9ca3-ffa0afc8f28f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:18.998500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1050/2092] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:18.999396 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8fe50-1455-485c-9ca3-ffa0afc8f28f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:19.002272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-49b8fe50-1455-485c-9ca3-ffa0afc8f28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:19.037311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffd6bbcd-5434-4364-a8dd-3664dfdfa14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34832b730ff4492da99c969f5e7f9852'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:19.037825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffd6bbcd-5434-4364-a8dd-3664dfdfa14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34832b730ff4492da99c969f5e7f9852'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:19.078544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffd6bbcd-5434-4364-a8dd-3664dfdfa14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34832b730ff4492da99c969f5e7f9852'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:19.079627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8fe50-1455-485c-9ca3-ffa0afc8f28f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:19.085898 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba7eb8-ff7d-4915-847b-2b0c1d238fe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:19.086624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7eb8-ff7d-4915-847b-2b0c1d238fe8 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:19.087888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7eb8-ff7d-4915-847b-2b0c1d238fe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:19.088417 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7eb8-ff7d-4915-847b-2b0c1d238fe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:19.089106 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffd6bbcd-5434-4364-a8dd-3664dfdfa14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34832b730ff4492da99c969f5e7f9852'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:19.090061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffd6bbcd-5434-4364-a8dd-3664dfdfa14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34832b730ff4492da99c969f5e7f9852'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:19.094006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1dba7eb8-ff7d-4915-847b-2b0c1d238fe8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:19.124959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba7eb8-ff7d-4915-847b-2b0c1d238fe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:19.124959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba7eb8-ff7d-4915-847b-2b0c1d238fe8 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:19.126018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1051/2093] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:19.126834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba7eb8-ff7d-4915-847b-2b0c1d238fe8 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:19.128181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1dba7eb8-ff7d-4915-847b-2b0c1d238fe8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:19.148385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba7eb8-ff7d-4915-847b-2b0c1d238fe8 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:19.154540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6eb9c-faa0-4428-a6ae-8e8aef11a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:19.155166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6eb9c-faa0-4428-a6ae-8e8aef11a0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:19.155484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6eb9c-faa0-4428-a6ae-8e8aef11a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:19.155682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6eb9c-faa0-4428-a6ae-8e8aef11a0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:19.157312 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6eb9c-faa0-4428-a6ae-8e8aef11a0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:19.159009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6eb9c-faa0-4428-a6ae-8e8aef11a0f2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:19.184249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1052/2094] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:19.184976 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6eb9c-faa0-4428-a6ae-8e8aef11a0f2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:19.186675 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c8c6eb9c-faa0-4428-a6ae-8e8aef11a0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:19.200265 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6eb9c-faa0-4428-a6ae-8e8aef11a0f2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:19.204472 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1043/2095] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:18 2022] DELETE /identity/v3/users/34832b730ff4492da99c969f5e7f9852 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:19.204472 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6bbcd-5434-4364-a8dd-3664dfdfa14d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:19.267521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e812f-d89e-40ee-bb5a-98dad8c22929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:19.268135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e812f-d89e-40ee-bb5a-98dad8c22929 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:19.268414 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e812f-d89e-40ee-bb5a-98dad8c22929 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:19.268685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e812f-d89e-40ee-bb5a-98dad8c22929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:19.271461 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-792e812f-d89e-40ee-bb5a-98dad8c22929 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:19.293585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6bbcd-5434-4364-a8dd-3664dfdfa14d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:19.300260 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa427f89-48cf-4c3b-96d3-1354e99e68d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:19.301813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427f89-48cf-4c3b-96d3-1354e99e68d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:19.302302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427f89-48cf-4c3b-96d3-1354e99e68d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:19.302754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427f89-48cf-4c3b-96d3-1354e99e68d6 admin admin] PATH_INFO: `/v3/projects/c77495abf139449b9d259723b0795040/users/6f6d5713d7a740a9b6ea91238cb182aa/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:19.325151 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa427f89-48cf-4c3b-96d3-1354e99e68d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77495abf139449b9d259723b0795040, user_id=6f6d5713d7a740a9b6ea91238cb182aa, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:19.329088 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa427f89-48cf-4c3b-96d3-1354e99e68d6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:19.347567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e812f-d89e-40ee-bb5a-98dad8c22929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:19.349309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e812f-d89e-40ee-bb5a-98dad8c22929 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:19.369502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1053/2096] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:19.373468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067e27f-429a-4cad-bac7-d3bee882487f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:19.375463 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067e27f-429a-4cad-bac7-d3bee882487f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:19.375463 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067e27f-429a-4cad-bac7-d3bee882487f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:19.403657 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1044/2097] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:19 2022] PUT /identity/v3/projects/c77495abf139449b9d259723b0795040/users/6f6d5713d7a740a9b6ea91238cb182aa/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:19.414862 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249a9a-8686-447f-9d26-497886b481a7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:19.415258 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3067e27f-429a-4cad-bac7-d3bee882487f None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:19.415809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249a9a-8686-447f-9d26-497886b481a7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:19.416347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3067e27f-429a-4cad-bac7-d3bee882487f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:19.417574 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249a9a-8686-447f-9d26-497886b481a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:19.448886 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-38249a9a-8686-447f-9d26-497886b481a7 None None] MFA Rules not processed for user `6f6d5713d7a740a9b6ea91238cb182aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:19.450949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-38249a9a-8686-447f-9d26-497886b481a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:19.489049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1054/2098] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:19.500837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067e27f-429a-4cad-bac7-d3bee882487f None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:19.502537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3067e27f-429a-4cad-bac7-d3bee882487f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:19.532959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:19.568404 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1045/2099] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:19.584692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067e27f-429a-4cad-bac7-d3bee882487f None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:19.590692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38249a9a-8686-447f-9d26-497886b481a7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:19.596302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-38249a9a-8686-447f-9d26-497886b481a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:19.596419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c997b1-c10e-46a6-9d12-2a4fe5c46323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:19.596419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c997b1-c10e-46a6-9d12-2a4fe5c46323 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:19.596419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c997b1-c10e-46a6-9d12-2a4fe5c46323 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:19.596419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c997b1-c10e-46a6-9d12-2a4fe5c46323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:19.630826 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c997b1-c10e-46a6-9d12-2a4fe5c46323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:19.630826 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c997b1-c10e-46a6-9d12-2a4fe5c46323 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:19.657430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1055/2100] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:44:19.719634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38249a9a-8686-447f-9d26-497886b481a7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:19.725733 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b6cf2-de05-4c69-b6e4-e8f0a61c05fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526760ad8a04bf486d1e7e74e9ffbe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:19.726634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b6cf2-de05-4c69-b6e4-e8f0a61c05fa service glance] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:19.727061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b6cf2-de05-4c69-b6e4-e8f0a61c05fa service glance] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:19.727638 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b6cf2-de05-4c69-b6e4-e8f0a61c05fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:19.747630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b6cf2-de05-4c69-b6e4-e8f0a61c05fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:19.751290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b6cf2-de05-4c69-b6e4-e8f0a61c05fa service glance] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:19.766358 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1046/2101] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:20.025750 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:20.358709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c997b1-c10e-46a6-9d12-2a4fe5c46323 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:20.365250 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-73c997b1-c10e-46a6-9d12-2a4fe5c46323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:20.388466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c997b1-c10e-46a6-9d12-2a4fe5c46323 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:20.398660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:20.399340 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:20.399798 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:20.400199 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] PATH_INFO: `/v3/projects/316c8212805340078396833dbc21467d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:20.401772 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=316c8212805340078396833dbc21467d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:20.404413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:20.518570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316c8212805340078396833dbc21467d', 'request_id': 'req-c851fb35-78a3-467a-85f4-e107aaad68e5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:20.641307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316c8212805340078396833dbc21467d', 'request_id': 'req-c851fb35-78a3-467a-85f4-e107aaad68e5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:20.647597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316c8212805340078396833dbc21467d', 'request_id': 'req-c851fb35-78a3-467a-85f4-e107aaad68e5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:20.661629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] The token cache is being invalidate because project 316c8212805340078396833dbc21467d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:20.661925 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:20.662804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:20.665243 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1056/2102] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:20 2022] DELETE /identity/v3/projects/316c8212805340078396833dbc21467d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:20.670574 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b6cf2-de05-4c69-b6e4-e8f0a61c05fa service glance] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:20.686265 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b6cf2-de05-4c69-b6e4-e8f0a61c05fa service glance] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:20.777838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec915f-cc6a-46d8-bfd7-854cdc9359cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:20.777838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec915f-cc6a-46d8-bfd7-854cdc9359cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:20.777838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec915f-cc6a-46d8-bfd7-854cdc9359cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:20.777838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec915f-cc6a-46d8-bfd7-854cdc9359cc admin admin] PATH_INFO: `/v3/users/8fe080b967334be9b998ca5edad9c7ca` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:20.778431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec915f-cc6a-46d8-bfd7-854cdc9359cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe080b967334be9b998ca5edad9c7ca)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:20.779120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec915f-cc6a-46d8-bfd7-854cdc9359cc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:20.922251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:20.967629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-16ec915f-cc6a-46d8-bfd7-854cdc9359cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe080b967334be9b998ca5edad9c7ca'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:20.968322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-16ec915f-cc6a-46d8-bfd7-854cdc9359cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe080b967334be9b998ca5edad9c7ca'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:20.982963 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-16ec915f-cc6a-46d8-bfd7-854cdc9359cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe080b967334be9b998ca5edad9c7ca'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:20.990977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-16ec915f-cc6a-46d8-bfd7-854cdc9359cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe080b967334be9b998ca5edad9c7ca'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:20.992623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-16ec915f-cc6a-46d8-bfd7-854cdc9359cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe080b967334be9b998ca5edad9c7ca'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:21.083125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1047/2103] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:20 2022] DELETE /identity/v3/users/8fe080b967334be9b998ca5edad9c7ca => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:21.334266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:21.336123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:21.359520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851fb35-78a3-467a-85f4-e107aaad68e5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:21.521045 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a004c-4aa4-4187-b1a3-1924b122c771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:21.521770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a004c-4aa4-4187-b1a3-1924b122c771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:21.522091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a004c-4aa4-4187-b1a3-1924b122c771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:21.522365 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a004c-4aa4-4187-b1a3-1924b122c771 admin admin] PATH_INFO: `/v3/users/753a71dbb2af495cb9b760521487c01b` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:21.524644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a004c-4aa4-4187-b1a3-1924b122c771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=753a71dbb2af495cb9b760521487c01b)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:21.527252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a004c-4aa4-4187-b1a3-1924b122c771 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:21.690906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:21.773651 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4b3a004c-4aa4-4187-b1a3-1924b122c771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '753a71dbb2af495cb9b760521487c01b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:21.790383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4b3a004c-4aa4-4187-b1a3-1924b122c771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '753a71dbb2af495cb9b760521487c01b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:21.796451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec915f-cc6a-46d8-bfd7-854cdc9359cc admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:21.796451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-16ec915f-cc6a-46d8-bfd7-854cdc9359cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:21.829526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec915f-cc6a-46d8-bfd7-854cdc9359cc admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:21.858670 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4b3a004c-4aa4-4187-b1a3-1924b122c771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '753a71dbb2af495cb9b760521487c01b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:21.859272 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3afb02-f7a4-478a-9c61-29675602c239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:21.860096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3afb02-f7a4-478a-9c61-29675602c239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:21.860704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3afb02-f7a4-478a-9c61-29675602c239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:21.861320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3afb02-f7a4-478a-9c61-29675602c239 admin admin] PATH_INFO: `/v3/projects/da240f8e65004d18b0873b7e048253fd` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:21.864379 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3afb02-f7a4-478a-9c61-29675602c239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da240f8e65004d18b0873b7e048253fd)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:21.868821 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4b3a004c-4aa4-4187-b1a3-1924b122c771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '753a71dbb2af495cb9b760521487c01b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:21.870211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3afb02-f7a4-478a-9c61-29675602c239 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:21.870695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4b3a004c-4aa4-4187-b1a3-1924b122c771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '753a71dbb2af495cb9b760521487c01b'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:21.884300 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1057/2104] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:21 2022] DELETE /identity/v3/users/753a71dbb2af495cb9b760521487c01b => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:21.889223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf75c9-69c2-43fd-9ad5-34795b135d57 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:21.889789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf75c9-69c2-43fd-9ad5-34795b135d57 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:21.890296 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf75c9-69c2-43fd-9ad5-34795b135d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:21.932942 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-95cf75c9-69c2-43fd-9ad5-34795b135d57 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:21.940379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-95cf75c9-69c2-43fd-9ad5-34795b135d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:21.985008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd3afb02-f7a4-478a-9c61-29675602c239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da240f8e65004d18b0873b7e048253fd', 'request_id': 'req-fd3afb02-f7a4-478a-9c61-29675602c239'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:22.039095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1058/2105] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:22.048116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf75c9-69c2-43fd-9ad5-34795b135d57 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:22.049573 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-95cf75c9-69c2-43fd-9ad5-34795b135d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:22.059377 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd3afb02-f7a4-478a-9c61-29675602c239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da240f8e65004d18b0873b7e048253fd', 'request_id': 'req-fd3afb02-f7a4-478a-9c61-29675602c239'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:22.075398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd3afb02-f7a4-478a-9c61-29675602c239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da240f8e65004d18b0873b7e048253fd', 'request_id': 'req-fd3afb02-f7a4-478a-9c61-29675602c239'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:22.097269 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd3afb02-f7a4-478a-9c61-29675602c239 admin admin] The token cache is being invalidate because project da240f8e65004d18b0873b7e048253fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:22.097929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd3afb02-f7a4-478a-9c61-29675602c239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:22.101898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd3afb02-f7a4-478a-9c61-29675602c239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:22.108017 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1048/2106] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:21 2022] DELETE /identity/v3/projects/da240f8e65004d18b0873b7e048253fd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:22.113566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0b752-1dcf-47b3-8b63-32ae78d62bd5 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:22.115231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0b752-1dcf-47b3-8b63-32ae78d62bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:22.115674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0b752-1dcf-47b3-8b63-32ae78d62bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:22.137844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-03d0b752-1dcf-47b3-8b63-32ae78d62bd5 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:22.139176 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-03d0b752-1dcf-47b3-8b63-32ae78d62bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:22.152515 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf75c9-69c2-43fd-9ad5-34795b135d57 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:22.208538 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:22.219103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74036f-b57f-4018-97d7-f345f0ca3191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:22.219724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74036f-b57f-4018-97d7-f345f0ca3191 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:22.220189 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74036f-b57f-4018-97d7-f345f0ca3191 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:22.220347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1049/2107] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:22.220446 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74036f-b57f-4018-97d7-f345f0ca3191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:22.222842 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8b74036f-b57f-4018-97d7-f345f0ca3191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:22.235759 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509cf44-5cd2-42de-b99e-dbe33d5e6557 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:22.235759 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509cf44-5cd2-42de-b99e-dbe33d5e6557 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:22.235759 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509cf44-5cd2-42de-b99e-dbe33d5e6557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:22.247591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74036f-b57f-4018-97d7-f345f0ca3191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:22.249586 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74036f-b57f-4018-97d7-f345f0ca3191 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:22.253645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3509cf44-5cd2-42de-b99e-dbe33d5e6557 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:22.254871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3509cf44-5cd2-42de-b99e-dbe33d5e6557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:22.260971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1059/2108] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:44:22.263839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1050/2109] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:22.268198 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74036f-b57f-4018-97d7-f345f0ca3191 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:22.278751 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74036f-b57f-4018-97d7-f345f0ca3191 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:22.283734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb657ae-bedb-43e7-8562-f45bf98b86a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:22.284336 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb657ae-bedb-43e7-8562-f45bf98b86a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:22.284616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb657ae-bedb-43e7-8562-f45bf98b86a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:22.284884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb657ae-bedb-43e7-8562-f45bf98b86a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:22.285603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb657ae-bedb-43e7-8562-f45bf98b86a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:22.285909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb657ae-bedb-43e7-8562-f45bf98b86a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:22.287660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb657ae-bedb-43e7-8562-f45bf98b86a6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:22.300839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1060/2110] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:44:22.306238 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509cf44-5cd2-42de-b99e-dbe33d5e6557 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:22.322169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509cf44-5cd2-42de-b99e-dbe33d5e6557 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:22.331878 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c8ff8-f2b2-4801-a79a-d2495f5895cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:22.333320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c8ff8-f2b2-4801-a79a-d2495f5895cd admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:22.337936 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c8ff8-f2b2-4801-a79a-d2495f5895cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:22.339246 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c8ff8-f2b2-4801-a79a-d2495f5895cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:22.340446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c8ff8-f2b2-4801-a79a-d2495f5895cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:22.343557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c8ff8-f2b2-4801-a79a-d2495f5895cd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:22.489468 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1051/2111] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:22 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:22.493797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb657ae-bedb-43e7-8562-f45bf98b86a6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:22.511767 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb657ae-bedb-43e7-8562-f45bf98b86a6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:22.604460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b08878-07bb-4a1b-a831-8087bed584fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:22.606382 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b08878-07bb-4a1b-a831-8087bed584fc admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:22.606967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b08878-07bb-4a1b-a831-8087bed584fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:22.607654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b08878-07bb-4a1b-a831-8087bed584fc admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:22.608799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b08878-07bb-4a1b-a831-8087bed584fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:22.616792 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b08878-07bb-4a1b-a831-8087bed584fc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:22.784486 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c8ff8-f2b2-4801-a79a-d2495f5895cd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:22.784718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1061/2112] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:22 2022] POST /identity/v3/users => generated 288 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:22.803337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c8ff8-f2b2-4801-a79a-d2495f5895cd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:22.823779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258c4ae-e9e6-42ca-9408-ffda670d52be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:22.824522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258c4ae-e9e6-42ca-9408-ffda670d52be admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:22.824989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258c4ae-e9e6-42ca-9408-ffda670d52be admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:22.825801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258c4ae-e9e6-42ca-9408-ffda670d52be admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:22.827964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258c4ae-e9e6-42ca-9408-ffda670d52be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:22.832856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258c4ae-e9e6-42ca-9408-ffda670d52be admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:22.846132 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1052/2113] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:22.849945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b08878-07bb-4a1b-a831-8087bed584fc admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:22.867457 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b08878-07bb-4a1b-a831-8087bed584fc admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:22.879454 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140af236-44ef-4bc1-b01c-e2df8796e6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:22.880079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af236-44ef-4bc1-b01c-e2df8796e6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:22.880556 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af236-44ef-4bc1-b01c-e2df8796e6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:22.880814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af236-44ef-4bc1-b01c-e2df8796e6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:22.881499 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140af236-44ef-4bc1-b01c-e2df8796e6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:22.883106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140af236-44ef-4bc1-b01c-e2df8796e6d0 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:22.930226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1062/2114] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:22.936293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258c4ae-e9e6-42ca-9408-ffda670d52be admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:22.950899 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258c4ae-e9e6-42ca-9408-ffda670d52be admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:22.965061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7eacf-3502-4b18-8174-cc4cf4420594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:22.965991 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7eacf-3502-4b18-8174-cc4cf4420594 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:22.966448 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7eacf-3502-4b18-8174-cc4cf4420594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:22.966914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7eacf-3502-4b18-8174-cc4cf4420594 admin admin] PATH_INFO: `/v3/projects/f470230901fd4b82b2526987f64d6152/users/4c1db30757dd46e49859ace746348725/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:22.983667 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7eacf-3502-4b18-8174-cc4cf4420594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f470230901fd4b82b2526987f64d6152, user_id=4c1db30757dd46e49859ace746348725, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:22.987214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7eacf-3502-4b18-8174-cc4cf4420594 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:23.063988 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1053/2115] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:22 2022] PUT /identity/v3/projects/f470230901fd4b82b2526987f64d6152/users/4c1db30757dd46e49859ace746348725/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:23.079258 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6868aff-2248-44b3-bb53-ed396feb6808 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:23.082329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6868aff-2248-44b3-bb53-ed396feb6808 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:23.082806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6868aff-2248-44b3-bb53-ed396feb6808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:23.122070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f6868aff-2248-44b3-bb53-ed396feb6808 None None] MFA Rules not processed for user `4c1db30757dd46e49859ace746348725`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:23.123903 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f6868aff-2248-44b3-bb53-ed396feb6808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:23.158866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7eacf-3502-4b18-8174-cc4cf4420594 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:23.162659 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-68d7eacf-3502-4b18-8174-cc4cf4420594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:23.254475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1063/2116] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:23.259013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6868aff-2248-44b3-bb53-ed396feb6808 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:23.264454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7eacf-3502-4b18-8174-cc4cf4420594 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:23.267359 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:23.277182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6868aff-2248-44b3-bb53-ed396feb6808 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:23.277541 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:23.278276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:23.278655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:23.279123 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] PATH_INFO: `/v3/projects/b4f07ecc049f4951a3e24639671f36a2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:23.282184 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f07ecc049f4951a3e24639671f36a2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:23.283591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cb858-d41a-46dd-94f9-8248f7c57bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:23.284523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:23.285320 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cb858-d41a-46dd-94f9-8248f7c57bcc admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:23.285466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cb858-d41a-46dd-94f9-8248f7c57bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:23.285726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cb858-d41a-46dd-94f9-8248f7c57bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:23.286623 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cb858-d41a-46dd-94f9-8248f7c57bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:23.288877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cb858-d41a-46dd-94f9-8248f7c57bcc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:23.417047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1064/2117] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:23 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:23.421436 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cb858-d41a-46dd-94f9-8248f7c57bcc admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:23.434782 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f07ecc049f4951a3e24639671f36a2', 'request_id': 'req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:23.511305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f07ecc049f4951a3e24639671f36a2', 'request_id': 'req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:23.520753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f07ecc049f4951a3e24639671f36a2', 'request_id': 'req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:23.532028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cb858-d41a-46dd-94f9-8248f7c57bcc admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:23.535926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] The token cache is being invalidate because project b4f07ecc049f4951a3e24639671f36a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:23.535926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:23.536577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:23.538822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1054/2118] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:23 2022] DELETE /identity/v3/projects/b4f07ecc049f4951a3e24639671f36a2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:23.541159 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca54894-7dba-492d-ad04-deb638ef3a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:23.542612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca54894-7dba-492d-ad04-deb638ef3a4c admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:23.542987 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca54894-7dba-492d-ad04-deb638ef3a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:23.544258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:23.544649 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca54894-7dba-492d-ad04-deb638ef3a4c admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:23.545512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca54894-7dba-492d-ad04-deb638ef3a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:23.546304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:23.547887 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca54894-7dba-492d-ad04-deb638ef3a4c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:23.636006 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedddcc3-0b90-4556-b0fd-88ec9891dcdc admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:23.641086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a911f8-1436-4d8d-b7cc-8b4e2f67b306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:23.641793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a911f8-1436-4d8d-b7cc-8b4e2f67b306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:23.642073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a911f8-1436-4d8d-b7cc-8b4e2f67b306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:23.642347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a911f8-1436-4d8d-b7cc-8b4e2f67b306 admin admin] PATH_INFO: `/v3/users/af11c2e882e0486b8eee0098d98820c8` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:23.643494 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a911f8-1436-4d8d-b7cc-8b4e2f67b306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af11c2e882e0486b8eee0098d98820c8)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:23.645519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a911f8-1436-4d8d-b7cc-8b4e2f67b306 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:23.691880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1065/2119] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:23 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:23.695619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca54894-7dba-492d-ad04-deb638ef3a4c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:23.697348 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fca54894-7dba-492d-ad04-deb638ef3a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:23.709414 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca54894-7dba-492d-ad04-deb638ef3a4c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:23.714590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c986a2-1440-47de-8d5c-40c01641fe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:23.715202 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c986a2-1440-47de-8d5c-40c01641fe07 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:23.715518 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c986a2-1440-47de-8d5c-40c01641fe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:23.715781 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c986a2-1440-47de-8d5c-40c01641fe07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:23.716935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c986a2-1440-47de-8d5c-40c01641fe07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:23.718619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c986a2-1440-47de-8d5c-40c01641fe07 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:23.731231 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1066/2120] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:23.738788 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c986a2-1440-47de-8d5c-40c01641fe07 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:23.750174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c986a2-1440-47de-8d5c-40c01641fe07 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:23.755773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab73e2-e1a1-436e-a75e-197357bef0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:23.756610 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab73e2-e1a1-436e-a75e-197357bef0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:23.757495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab73e2-e1a1-436e-a75e-197357bef0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:23.757925 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab73e2-e1a1-436e-a75e-197357bef0f8 admin admin] PATH_INFO: `/v3/projects/f651e0fc2a204adbb947547933ae2c91/users/cb007441f6f9492ebb890bd891ba7c66/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:23.798796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab73e2-e1a1-436e-a75e-197357bef0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f651e0fc2a204adbb947547933ae2c91, user_id=cb007441f6f9492ebb890bd891ba7c66, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:23.798796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab73e2-e1a1-436e-a75e-197357bef0f8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:23.884584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-75a911f8-1436-4d8d-b7cc-8b4e2f67b306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af11c2e882e0486b8eee0098d98820c8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:23.886060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-75a911f8-1436-4d8d-b7cc-8b4e2f67b306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af11c2e882e0486b8eee0098d98820c8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:23.900157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-75a911f8-1436-4d8d-b7cc-8b4e2f67b306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af11c2e882e0486b8eee0098d98820c8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:23.909769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-75a911f8-1436-4d8d-b7cc-8b4e2f67b306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af11c2e882e0486b8eee0098d98820c8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:23.910711 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-75a911f8-1436-4d8d-b7cc-8b4e2f67b306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af11c2e882e0486b8eee0098d98820c8'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:23.941031 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1067/2121] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:23 2022] PUT /identity/v3/projects/f651e0fc2a204adbb947547933ae2c91/users/cb007441f6f9492ebb890bd891ba7c66/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:23.942269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab73e2-e1a1-436e-a75e-197357bef0f8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:23.945543 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-89ab73e2-e1a1-436e-a75e-197357bef0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:24.020352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1055/2122] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:23 2022] DELETE /identity/v3/users/af11c2e882e0486b8eee0098d98820c8 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:24.084380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab73e2-e1a1-436e-a75e-197357bef0f8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:24.181849 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09cbf1-39e1-4a5c-98c8-abe5f2d3c89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:24.182570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09cbf1-39e1-4a5c-98c8-abe5f2d3c89e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:24.182932 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09cbf1-39e1-4a5c-98c8-abe5f2d3c89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:24.183208 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09cbf1-39e1-4a5c-98c8-abe5f2d3c89e admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:24.184766 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09cbf1-39e1-4a5c-98c8-abe5f2d3c89e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:24.187397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09cbf1-39e1-4a5c-98c8-abe5f2d3c89e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:24.207091 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a911f8-1436-4d8d-b7cc-8b4e2f67b306 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:24.221833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a911f8-1436-4d8d-b7cc-8b4e2f67b306 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:24.222516 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1068/2123] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:24.228332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5acda-a165-4e39-bfa4-92eb00b3b650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:24.229856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5acda-a165-4e39-bfa4-92eb00b3b650 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:24.230261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5acda-a165-4e39-bfa4-92eb00b3b650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:24.230632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5acda-a165-4e39-bfa4-92eb00b3b650 admin admin] PATH_INFO: `/v3/projects/f651e0fc2a204adbb947547933ae2c91/users/cb007441f6f9492ebb890bd891ba7c66/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:24.232728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5acda-a165-4e39-bfa4-92eb00b3b650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f651e0fc2a204adbb947547933ae2c91, user_id=cb007441f6f9492ebb890bd891ba7c66, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:24.236220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5acda-a165-4e39-bfa4-92eb00b3b650 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:24.251474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1056/2124] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:24 2022] PUT /identity/v3/projects/f651e0fc2a204adbb947547933ae2c91/users/cb007441f6f9492ebb890bd891ba7c66/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:24.268638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ad796-5d96-4f4e-85c5-97b45a31fc50 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:24.269269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ad796-5d96-4f4e-85c5-97b45a31fc50 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:24.269753 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ad796-5d96-4f4e-85c5-97b45a31fc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:24.355600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2a6ad796-5d96-4f4e-85c5-97b45a31fc50 None None] MFA Rules not processed for user `cb007441f6f9492ebb890bd891ba7c66`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:24.357234 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2a6ad796-5d96-4f4e-85c5-97b45a31fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:24.475833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1069/2125] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:24.490009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5acda-a165-4e39-bfa4-92eb00b3b650 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:24.492672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-60f5acda-a165-4e39-bfa4-92eb00b3b650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:24.586774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5acda-a165-4e39-bfa4-92eb00b3b650 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:24.592033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f776b-84cf-4382-8cfe-9742d1aec08e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:24.592979 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f776b-84cf-4382-8cfe-9742d1aec08e service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:24.593400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f776b-84cf-4382-8cfe-9742d1aec08e service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:24.593799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f776b-84cf-4382-8cfe-9742d1aec08e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:24.596554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:24.598780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-076f776b-84cf-4382-8cfe-9742d1aec08e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:24.699423 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f776b-84cf-4382-8cfe-9742d1aec08e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:24.700880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f776b-84cf-4382-8cfe-9742d1aec08e service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:24.722705 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ad796-5d96-4f4e-85c5-97b45a31fc50 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:24.729009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2a6ad796-5d96-4f4e-85c5-97b45a31fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:24.734185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1057/2126] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:24.890241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ad796-5d96-4f4e-85c5-97b45a31fc50 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:24.905168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4a8d8-6b75-467a-905a-29e83e0531c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:24.910056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4a8d8-6b75-467a-905a-29e83e0531c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:24.910056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4a8d8-6b75-467a-905a-29e83e0531c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:24.910056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4a8d8-6b75-467a-905a-29e83e0531c0 admin admin] PATH_INFO: `/v3/projects/5892cdb0a2824006adbd8d2d3799726e` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:24.910056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4a8d8-6b75-467a-905a-29e83e0531c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5892cdb0a2824006adbd8d2d3799726e)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:24.913062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4a8d8-6b75-467a-905a-29e83e0531c0 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:24.986634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:25.105406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d2f4a8d8-6b75-467a-905a-29e83e0531c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5892cdb0a2824006adbd8d2d3799726e', 'request_id': 'req-d2f4a8d8-6b75-467a-905a-29e83e0531c0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:25.225181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d2f4a8d8-6b75-467a-905a-29e83e0531c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5892cdb0a2824006adbd8d2d3799726e', 'request_id': 'req-d2f4a8d8-6b75-467a-905a-29e83e0531c0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:25.232473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d2f4a8d8-6b75-467a-905a-29e83e0531c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5892cdb0a2824006adbd8d2d3799726e', 'request_id': 'req-d2f4a8d8-6b75-467a-905a-29e83e0531c0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:25.254880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d2f4a8d8-6b75-467a-905a-29e83e0531c0 admin admin] The token cache is being invalidate because project 5892cdb0a2824006adbd8d2d3799726e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:25.255368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d2f4a8d8-6b75-467a-905a-29e83e0531c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:25.256496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d2f4a8d8-6b75-467a-905a-29e83e0531c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:25.266686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1070/2127] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:24 2022] DELETE /identity/v3/projects/5892cdb0a2824006adbd8d2d3799726e => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:25.266878 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcf539-b4ba-4e04-abbf-63e3c3d87e61 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:25.266878 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcf539-b4ba-4e04-abbf-63e3c3d87e61 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:25.267581 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcf539-b4ba-4e04-abbf-63e3c3d87e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:25.303132 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-21fcf539-b4ba-4e04-abbf-63e3c3d87e61 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:25.304501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-21fcf539-b4ba-4e04-abbf-63e3c3d87e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:25.364646 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa16f7c-2d84-4dad-b6ff-607d17cbce07 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:25.364965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa16f7c-2d84-4dad-b6ff-607d17cbce07 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:25.365375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa16f7c-2d84-4dad-b6ff-607d17cbce07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:25.410581 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6fa16f7c-2d84-4dad-b6ff-607d17cbce07 None None] MFA Rules not processed for user `5b584800b7f0409bb1d3069718397c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:25.412166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6fa16f7c-2d84-4dad-b6ff-607d17cbce07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:25.414202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1058/2128] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:25.423429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b833ee9-2032-421d-b4d2-cea398f21b06 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:25.425540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b833ee9-2032-421d-b4d2-cea398f21b06 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:25.425852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b833ee9-2032-421d-b4d2-cea398f21b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:25.451342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7b833ee9-2032-421d-b4d2-cea398f21b06 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:25.452644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7b833ee9-2032-421d-b4d2-cea398f21b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:25.474010 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1059/2129] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:25.477872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b833ee9-2032-421d-b4d2-cea398f21b06 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:25.489000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b833ee9-2032-421d-b4d2-cea398f21b06 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:25.494251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dacbc-8609-4816-aa07-106c83cfe623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:25.495796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dacbc-8609-4816-aa07-106c83cfe623 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:25.496238 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dacbc-8609-4816-aa07-106c83cfe623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:25.496867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dacbc-8609-4816-aa07-106c83cfe623 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:25.497791 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dacbc-8609-4816-aa07-106c83cfe623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:25.498240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dacbc-8609-4816-aa07-106c83cfe623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:25.500181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dacbc-8609-4816-aa07-106c83cfe623 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:25.512191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1071/2130] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:25.513822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1060/2131] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:44:25.519076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa16f7c-2d84-4dad-b6ff-607d17cbce07 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:25.524953 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dacbc-8609-4816-aa07-106c83cfe623 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:25.527572 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-765dacbc-8609-4816-aa07-106c83cfe623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:25.530902 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa16f7c-2d84-4dad-b6ff-607d17cbce07 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:25.536427 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601b8e5-9cb3-4208-904d-f1bfd315c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:25.537071 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601b8e5-9cb3-4208-904d-f1bfd315c0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:25.537435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601b8e5-9cb3-4208-904d-f1bfd315c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:25.537712 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601b8e5-9cb3-4208-904d-f1bfd315c0d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:25.539252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601b8e5-9cb3-4208-904d-f1bfd315c0d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:25.542210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601b8e5-9cb3-4208-904d-f1bfd315c0d6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:25.653014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1072/2132] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:25 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:25.654274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601b8e5-9cb3-4208-904d-f1bfd315c0d6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:25.692602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dacbc-8609-4816-aa07-106c83cfe623 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:25.785488 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601b8e5-9cb3-4208-904d-f1bfd315c0d6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:25.793292 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b01073-3357-47d5-a436-ab19a5d7829a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:25.794014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b01073-3357-47d5-a436-ab19a5d7829a admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:25.794384 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b01073-3357-47d5-a436-ab19a5d7829a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:25.794596 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b01073-3357-47d5-a436-ab19a5d7829a admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:25.795237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b01073-3357-47d5-a436-ab19a5d7829a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:25.796098 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b76ce-f8da-4262-b399-eec3442f42f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:25.796787 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b76ce-f8da-4262-b399-eec3442f42f1 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:25.797069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b76ce-f8da-4262-b399-eec3442f42f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:25.797399 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b01073-3357-47d5-a436-ab19a5d7829a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:25.797509 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b76ce-f8da-4262-b399-eec3442f42f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:25.861628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b76ce-f8da-4262-b399-eec3442f42f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:25.863459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b76ce-f8da-4262-b399-eec3442f42f1 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:25.874347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1061/2133] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:25.907847 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1073/2134] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:25 2022] POST /identity/v3/users => generated 287 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:25.909293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b76ce-f8da-4262-b399-eec3442f42f1 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:25.939827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b76ce-f8da-4262-b399-eec3442f42f1 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:25.941914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b76bb-2c16-45ce-9746-4c050de18844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:25.942523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b76bb-2c16-45ce-9746-4c050de18844 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:25.942803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b76bb-2c16-45ce-9746-4c050de18844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:25.943097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b76bb-2c16-45ce-9746-4c050de18844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:25.943765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b76bb-2c16-45ce-9746-4c050de18844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:25.945381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b76bb-2c16-45ce-9746-4c050de18844 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:25.959202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1062/2135] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:25.966231 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b01073-3357-47d5-a436-ab19a5d7829a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:25.981598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b01073-3357-47d5-a436-ab19a5d7829a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:25.986857 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a301793-858e-4239-862a-e2f28543ddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:25.987686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a301793-858e-4239-862a-e2f28543ddca admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:25.988117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a301793-858e-4239-862a-e2f28543ddca admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:25.988407 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a301793-858e-4239-862a-e2f28543ddca admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:25.989069 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a301793-858e-4239-862a-e2f28543ddca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:25.991136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a301793-858e-4239-862a-e2f28543ddca admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:26.004788 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1074/2136] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:26.007707 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b76bb-2c16-45ce-9746-4c050de18844 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:26.029871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b76bb-2c16-45ce-9746-4c050de18844 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:26.043295 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6054a2-8e2c-4bee-9982-e3dd2caafced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:26.045164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6054a2-8e2c-4bee-9982-e3dd2caafced admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:26.046247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6054a2-8e2c-4bee-9982-e3dd2caafced admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:26.046735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6054a2-8e2c-4bee-9982-e3dd2caafced admin admin] PATH_INFO: `/v3/projects/2285f4d7bd174616aa0b9f7de08ca7f9/users/e91b32ab25854882af7bc313fdd342b2/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:26.074091 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6054a2-8e2c-4bee-9982-e3dd2caafced admin admin] RBAC: Authorizing `identity:create_grant(project_id=2285f4d7bd174616aa0b9f7de08ca7f9, user_id=e91b32ab25854882af7bc313fdd342b2, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:26.077829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6054a2-8e2c-4bee-9982-e3dd2caafced admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:26.253475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1063/2137] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:26 2022] PUT /identity/v3/projects/2285f4d7bd174616aa0b9f7de08ca7f9/users/e91b32ab25854882af7bc313fdd342b2/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:26.258525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817659a9-22c5-40cb-aa02-3d22b0b42bbe None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:26.258802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817659a9-22c5-40cb-aa02-3d22b0b42bbe None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:26.259082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817659a9-22c5-40cb-aa02-3d22b0b42bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:26.279136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-817659a9-22c5-40cb-aa02-3d22b0b42bbe None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:26.280340 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-817659a9-22c5-40cb-aa02-3d22b0b42bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:26.363074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1075/2138] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:26.370374 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6054a2-8e2c-4bee-9982-e3dd2caafced admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:26.371962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fe6054a2-8e2c-4bee-9982-e3dd2caafced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:26.578130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817659a9-22c5-40cb-aa02-3d22b0b42bbe None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:26.579901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-817659a9-22c5-40cb-aa02-3d22b0b42bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:26.584659 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6054a2-8e2c-4bee-9982-e3dd2caafced admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:26.588573 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed583a68-7e12-4b8b-81b2-16392605587e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:26.589462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed583a68-7e12-4b8b-81b2-16392605587e service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:26.589816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed583a68-7e12-4b8b-81b2-16392605587e service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:26.590218 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed583a68-7e12-4b8b-81b2-16392605587e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:26.599682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817659a9-22c5-40cb-aa02-3d22b0b42bbe None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:26.601551 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed583a68-7e12-4b8b-81b2-16392605587e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:26.604896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed583a68-7e12-4b8b-81b2-16392605587e service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:26.605724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb54b40-9966-4dfe-b20e-7ea1ea536127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:26.606358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb54b40-9966-4dfe-b20e-7ea1ea536127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:26.606884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb54b40-9966-4dfe-b20e-7ea1ea536127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:26.607151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb54b40-9966-4dfe-b20e-7ea1ea536127 admin admin] PATH_INFO: `/v3/users/86bb7373d075431b94cb4c238065a178` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:26.608320 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb54b40-9966-4dfe-b20e-7ea1ea536127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86bb7373d075431b94cb4c238065a178)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:26.610425 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb54b40-9966-4dfe-b20e-7ea1ea536127 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:26.615506 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1064/2139] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:26.840085 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4fb54b40-9966-4dfe-b20e-7ea1ea536127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86bb7373d075431b94cb4c238065a178'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:26.855153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4fb54b40-9966-4dfe-b20e-7ea1ea536127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86bb7373d075431b94cb4c238065a178'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:26.939782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4fb54b40-9966-4dfe-b20e-7ea1ea536127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86bb7373d075431b94cb4c238065a178'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:26.948354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4fb54b40-9966-4dfe-b20e-7ea1ea536127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86bb7373d075431b94cb4c238065a178'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:26.950129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4fb54b40-9966-4dfe-b20e-7ea1ea536127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86bb7373d075431b94cb4c238065a178'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:26.974551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1076/2140] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:26 2022] DELETE /identity/v3/users/86bb7373d075431b94cb4c238065a178 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:26.980761 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4be16-3ef2-42bb-92f9-372a6d210b91 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:26.981188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4be16-3ef2-42bb-92f9-372a6d210b91 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:26.981486 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4be16-3ef2-42bb-92f9-372a6d210b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:27.005960 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-61f4be16-3ef2-42bb-92f9-372a6d210b91 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:27.007237 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-61f4be16-3ef2-42bb-92f9-372a6d210b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:27.122647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1065/2141] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:27.138693 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb54b40-9966-4dfe-b20e-7ea1ea536127 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:27.140942 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4fb54b40-9966-4dfe-b20e-7ea1ea536127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:27.262628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb54b40-9966-4dfe-b20e-7ea1ea536127 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:27.266672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415300b-ea18-42b8-abde-c772ac09f44e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:27.267426 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415300b-ea18-42b8-abde-c772ac09f44e service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:27.267798 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415300b-ea18-42b8-abde-c772ac09f44e service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:27.268142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415300b-ea18-42b8-abde-c772ac09f44e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:27.279871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415300b-ea18-42b8-abde-c772ac09f44e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:27.281572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415300b-ea18-42b8-abde-c772ac09f44e service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:27.296227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1077/2142] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:28.139048 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:28.333145 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:28.767955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4be16-3ef2-42bb-92f9-372a6d210b91 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:28.769516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-61f4be16-3ef2-42bb-92f9-372a6d210b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:28.782157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4be16-3ef2-42bb-92f9-372a6d210b91 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:28.791670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:28.793780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:28.794061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:28.794345 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61 admin admin] PATH_INFO: `/v3/projects/13e76535e4da498bad352f35cdbd446d` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:28.795526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e76535e4da498bad352f35cdbd446d)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:28.798052 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:29.025865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415300b-ea18-42b8-abde-c772ac09f44e service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:29.031570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4415300b-ea18-42b8-abde-c772ac09f44e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:29.057255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e76535e4da498bad352f35cdbd446d', 'request_id': 'req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.063903 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415300b-ea18-42b8-abde-c772ac09f44e service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:29.147444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e76535e4da498bad352f35cdbd446d', 'request_id': 'req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.159184 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e76535e4da498bad352f35cdbd446d', 'request_id': 'req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.191011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61 admin admin] The token cache is being invalidate because project 13e76535e4da498bad352f35cdbd446d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:29.191995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.193433 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fba5a4ed-3240-4239-ac5d-b1ca359e9c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.202090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1066/2143] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:28 2022] DELETE /identity/v3/projects/13e76535e4da498bad352f35cdbd446d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:29.204045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c93381-f701-4e4e-a8be-48d6a2b26a27 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:29.204531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c93381-f701-4e4e-a8be-48d6a2b26a27 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:29.205512 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c93381-f701-4e4e-a8be-48d6a2b26a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:29.249609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03abd4c-0da5-4dbe-bc3c-fb32f82671d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:29.250134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abd4c-0da5-4dbe-bc3c-fb32f82671d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:29.250417 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abd4c-0da5-4dbe-bc3c-fb32f82671d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:29.250690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abd4c-0da5-4dbe-bc3c-fb32f82671d1 admin admin] PATH_INFO: `/v3/users/4c1db30757dd46e49859ace746348725` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:29.251922 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03abd4c-0da5-4dbe-bc3c-fb32f82671d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1db30757dd46e49859ace746348725)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:29.254272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03abd4c-0da5-4dbe-bc3c-fb32f82671d1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:29.263011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-48c93381-f701-4e4e-a8be-48d6a2b26a27 None None] MFA Rules not processed for user `e91b32ab25854882af7bc313fdd342b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:29.264513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-48c93381-f701-4e4e-a8be-48d6a2b26a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:29.422941 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1067/2144] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:29.423688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c93381-f701-4e4e-a8be-48d6a2b26a27 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:29.434712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-48c93381-f701-4e4e-a8be-48d6a2b26a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:29.453739 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c93381-f701-4e4e-a8be-48d6a2b26a27 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:29.458377 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560ae9c-19bb-4912-ba78-49bef776540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:29.463107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560ae9c-19bb-4912-ba78-49bef776540c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:29.463107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560ae9c-19bb-4912-ba78-49bef776540c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:29.463107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560ae9c-19bb-4912-ba78-49bef776540c admin admin] PATH_INFO: `/v3/users/2c5f873cbe1e4875903d854610249888` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:29.463107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560ae9c-19bb-4912-ba78-49bef776540c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5f873cbe1e4875903d854610249888)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:29.463107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560ae9c-19bb-4912-ba78-49bef776540c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:29.503392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b03abd4c-0da5-4dbe-bc3c-fb32f82671d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1db30757dd46e49859ace746348725'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.519774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b03abd4c-0da5-4dbe-bc3c-fb32f82671d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1db30757dd46e49859ace746348725'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.623941 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b03abd4c-0da5-4dbe-bc3c-fb32f82671d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1db30757dd46e49859ace746348725'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.632368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b03abd4c-0da5-4dbe-bc3c-fb32f82671d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1db30757dd46e49859ace746348725'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.632958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b03abd4c-0da5-4dbe-bc3c-fb32f82671d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1db30757dd46e49859ace746348725'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.643053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1078/2145] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:29 2022] DELETE /identity/v3/users/4c1db30757dd46e49859ace746348725 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:29.643970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03abd4c-0da5-4dbe-bc3c-fb32f82671d1 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:29.645441 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b03abd4c-0da5-4dbe-bc3c-fb32f82671d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:29.739902 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d560ae9c-19bb-4912-ba78-49bef776540c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5f873cbe1e4875903d854610249888'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.740578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d560ae9c-19bb-4912-ba78-49bef776540c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5f873cbe1e4875903d854610249888'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.767398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d560ae9c-19bb-4912-ba78-49bef776540c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5f873cbe1e4875903d854610249888'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.776641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03abd4c-0da5-4dbe-bc3c-fb32f82671d1 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:29.784564 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d560ae9c-19bb-4912-ba78-49bef776540c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5f873cbe1e4875903d854610249888'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.786321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d560ae9c-19bb-4912-ba78-49bef776540c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5f873cbe1e4875903d854610249888'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:29.787077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a8c01-8918-4c37-b8b7-bcafd43a8e8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:29.789651 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a8c01-8918-4c37-b8b7-bcafd43a8e8a service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:29.794702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a8c01-8918-4c37-b8b7-bcafd43a8e8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:29.794702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a8c01-8918-4c37-b8b7-bcafd43a8e8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:29.796753 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fe5a8c01-8918-4c37-b8b7-bcafd43a8e8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:29.893668 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a8c01-8918-4c37-b8b7-bcafd43a8e8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:29.895143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a8c01-8918-4c37-b8b7-bcafd43a8e8a service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:29.908272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1079/2146] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:29.909760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad34fa7-7ddb-42b7-b3a6-17f71e802633 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:29.910175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad34fa7-7ddb-42b7-b3a6-17f71e802633 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:29.910517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad34fa7-7ddb-42b7-b3a6-17f71e802633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:29.941790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1068/2147] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:29 2022] DELETE /identity/v3/users/2c5f873cbe1e4875903d854610249888 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:29.944977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-5ad34fa7-7ddb-42b7-b3a6-17f71e802633 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:29.946225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5ad34fa7-7ddb-42b7-b3a6-17f71e802633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:29.987532 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0764b-2fae-42b3-a1f6-8d0a8f0156ac None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:29.988418 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0764b-2fae-42b3-a1f6-8d0a8f0156ac None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:29.989146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0764b-2fae-42b3-a1f6-8d0a8f0156ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:30.044635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-41b0764b-2fae-42b3-a1f6-8d0a8f0156ac None None] MFA Rules not processed for user `5b584800b7f0409bb1d3069718397c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:30.046164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-41b0764b-2fae-42b3-a1f6-8d0a8f0156ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:30.064112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1080/2148] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:30.086921 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad34fa7-7ddb-42b7-b3a6-17f71e802633 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:30.091909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5ad34fa7-7ddb-42b7-b3a6-17f71e802633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:30.160344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1069/2149] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:30.211927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad34fa7-7ddb-42b7-b3a6-17f71e802633 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:30.216240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f102e7a-1c58-438e-81f4-3a72363d0d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:30.221333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f102e7a-1c58-438e-81f4-3a72363d0d84 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:30.221333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f102e7a-1c58-438e-81f4-3a72363d0d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:30.221333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f102e7a-1c58-438e-81f4-3a72363d0d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:30.228156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f102e7a-1c58-438e-81f4-3a72363d0d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:30.230668 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f102e7a-1c58-438e-81f4-3a72363d0d84 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:30.247217 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1081/2150] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:44:30.505438 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:30.633833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:30.697694 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0764b-2fae-42b3-a1f6-8d0a8f0156ac None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:30.700446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-41b0764b-2fae-42b3-a1f6-8d0a8f0156ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:30.715786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0764b-2fae-42b3-a1f6-8d0a8f0156ac None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:30.722144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a63fb-56cf-45b1-9f29-b1c184d2a0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:30.722144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a63fb-56cf-45b1-9f29-b1c184d2a0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:30.722619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a63fb-56cf-45b1-9f29-b1c184d2a0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:30.722954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a63fb-56cf-45b1-9f29-b1c184d2a0be admin admin] PATH_INFO: `/v3/projects/741d2223122648a1a02528c649c1a24e` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:30.724399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a63fb-56cf-45b1-9f29-b1c184d2a0be admin admin] RBAC: Authorizing `identity:delete_project(project_id=741d2223122648a1a02528c649c1a24e)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:30.726562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a63fb-56cf-45b1-9f29-b1c184d2a0be admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:30.868364 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-431a63fb-56cf-45b1-9f29-b1c184d2a0be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '741d2223122648a1a02528c649c1a24e', 'request_id': 'req-431a63fb-56cf-45b1-9f29-b1c184d2a0be'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:30.927786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-431a63fb-56cf-45b1-9f29-b1c184d2a0be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '741d2223122648a1a02528c649c1a24e', 'request_id': 'req-431a63fb-56cf-45b1-9f29-b1c184d2a0be'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:30.949500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-431a63fb-56cf-45b1-9f29-b1c184d2a0be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '741d2223122648a1a02528c649c1a24e', 'request_id': 'req-431a63fb-56cf-45b1-9f29-b1c184d2a0be'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:30.973840 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-431a63fb-56cf-45b1-9f29-b1c184d2a0be admin admin] The token cache is being invalidate because project 741d2223122648a1a02528c649c1a24e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:30.974152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-431a63fb-56cf-45b1-9f29-b1c184d2a0be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:30.974953 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-431a63fb-56cf-45b1-9f29-b1c184d2a0be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:30.976761 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1070/2151] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:30 2022] DELETE /identity/v3/projects/741d2223122648a1a02528c649c1a24e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:30.981874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a5510-e125-4941-bc29-f29cebe4a001 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:30.982600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a5510-e125-4941-bc29-f29cebe4a001 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:30.983034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a5510-e125-4941-bc29-f29cebe4a001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:31.008929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c96a5510-e125-4941-bc29-f29cebe4a001 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:31.011292 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c96a5510-e125-4941-bc29-f29cebe4a001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:31.106485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1082/2152] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:31.114481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b523eae-3afa-4962-8534-27fe1c04bd7d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:31.114789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b523eae-3afa-4962-8534-27fe1c04bd7d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:31.115103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b523eae-3afa-4962-8534-27fe1c04bd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:31.130767 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a5510-e125-4941-bc29-f29cebe4a001 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:31.139868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c96a5510-e125-4941-bc29-f29cebe4a001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:31.163280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a5510-e125-4941-bc29-f29cebe4a001 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:31.170949 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:31.172375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:31.172375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:31.172375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] PATH_INFO: `/v3/projects/f470230901fd4b82b2526987f64d6152` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:31.183363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f470230901fd4b82b2526987f64d6152)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:31.186940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:31.222394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3b523eae-3afa-4962-8534-27fe1c04bd7d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:31.230411 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3b523eae-3afa-4962-8534-27fe1c04bd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:31.240735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1071/2153] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:31.246248 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b523eae-3afa-4962-8534-27fe1c04bd7d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:31.258029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b523eae-3afa-4962-8534-27fe1c04bd7d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:31.263342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ef0d0-4419-4f70-bf54-ea4e69c56651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:31.267549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ef0d0-4419-4f70-bf54-ea4e69c56651 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:31.267549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ef0d0-4419-4f70-bf54-ea4e69c56651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:31.267549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ef0d0-4419-4f70-bf54-ea4e69c56651 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:31.267549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ef0d0-4419-4f70-bf54-ea4e69c56651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:31.267549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ef0d0-4419-4f70-bf54-ea4e69c56651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:31.267549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ef0d0-4419-4f70-bf54-ea4e69c56651 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:31.279520 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1072/2154] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:44:31.283830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ef0d0-4419-4f70-bf54-ea4e69c56651 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:31.296324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ef0d0-4419-4f70-bf54-ea4e69c56651 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:31.309707 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f470230901fd4b82b2526987f64d6152', 'request_id': 'req-fbc0f493-22d0-4b59-910f-9945bd45033e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:31.355393 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c04c29-bf3e-4855-aace-ccc056971453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:31.355993 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c04c29-bf3e-4855-aace-ccc056971453 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:31.356268 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c04c29-bf3e-4855-aace-ccc056971453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:31.356535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c04c29-bf3e-4855-aace-ccc056971453 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:31.357153 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c04c29-bf3e-4855-aace-ccc056971453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:31.359059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c04c29-bf3e-4855-aace-ccc056971453 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:31.434411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f470230901fd4b82b2526987f64d6152', 'request_id': 'req-fbc0f493-22d0-4b59-910f-9945bd45033e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:31.445391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f470230901fd4b82b2526987f64d6152', 'request_id': 'req-fbc0f493-22d0-4b59-910f-9945bd45033e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:31.476429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1073/2155] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:31 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:31.477383 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c04c29-bf3e-4855-aace-ccc056971453 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:31.478778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] The token cache is being invalidate because project f470230901fd4b82b2526987f64d6152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:31.479131 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:31.482519 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:31.484192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1083/2156] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:31 2022] DELETE /identity/v3/projects/f470230901fd4b82b2526987f64d6152 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:31.489877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:31.490886 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:31.505274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0f493-22d0-4b59-910f-9945bd45033e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:31.607952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c04c29-bf3e-4855-aace-ccc056971453 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:31.614482 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c23709-4874-4494-9d5a-c8b5d01d8719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:31.615390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c23709-4874-4494-9d5a-c8b5d01d8719 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:31.615674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c23709-4874-4494-9d5a-c8b5d01d8719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:31.615978 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb9cfb-5ce7-4303-b955-6ecb1876167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:31.616117 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c23709-4874-4494-9d5a-c8b5d01d8719 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:31.616613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb9cfb-5ce7-4303-b955-6ecb1876167f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:31.616895 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c23709-4874-4494-9d5a-c8b5d01d8719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:31.617022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb9cfb-5ce7-4303-b955-6ecb1876167f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:31.617314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb9cfb-5ce7-4303-b955-6ecb1876167f admin admin] PATH_INFO: `/v3/users/cb007441f6f9492ebb890bd891ba7c66` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:31.618457 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb9cfb-5ce7-4303-b955-6ecb1876167f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb007441f6f9492ebb890bd891ba7c66)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:31.618866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c23709-4874-4494-9d5a-c8b5d01d8719 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:31.621364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb9cfb-5ce7-4303-b955-6ecb1876167f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:31.735007 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1074/2157] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:31 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:31.738384 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c23709-4874-4494-9d5a-c8b5d01d8719 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:31.740129 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c0c23709-4874-4494-9d5a-c8b5d01d8719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:31.754315 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c23709-4874-4494-9d5a-c8b5d01d8719 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:31.759467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4901df9-391b-403f-a4b6-275e4e4bbb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:31.760096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4901df9-391b-403f-a4b6-275e4e4bbb6a admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:31.763908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4901df9-391b-403f-a4b6-275e4e4bbb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:31.763908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4901df9-391b-403f-a4b6-275e4e4bbb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:31.763908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4901df9-391b-403f-a4b6-275e4e4bbb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:31.763908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4901df9-391b-403f-a4b6-275e4e4bbb6a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:31.774883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1075/2158] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:31.779320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4901df9-391b-403f-a4b6-275e4e4bbb6a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:31.790434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4901df9-391b-403f-a4b6-275e4e4bbb6a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:31.796224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1afdf1-99ed-4885-a727-ac3732956979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:31.796843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1afdf1-99ed-4885-a727-ac3732956979 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:31.801567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1afdf1-99ed-4885-a727-ac3732956979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:31.801567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1afdf1-99ed-4885-a727-ac3732956979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:31.801567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1afdf1-99ed-4885-a727-ac3732956979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:31.801567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1afdf1-99ed-4885-a727-ac3732956979 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:31.814915 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1076/2159] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:31.816025 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1afdf1-99ed-4885-a727-ac3732956979 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:31.826883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1afdf1-99ed-4885-a727-ac3732956979 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:31.831641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfbf43-87ce-4985-90c6-af74d660daa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:31.832290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfbf43-87ce-4985-90c6-af74d660daa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:31.832566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfbf43-87ce-4985-90c6-af74d660daa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:31.832844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfbf43-87ce-4985-90c6-af74d660daa4 admin admin] PATH_INFO: `/v3/projects/0b3aec59cc264dcdbe4e86f908869d39/users/d8ed5f5ba8264787a7acfeb56a8d2b9c/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:31.853403 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfbf43-87ce-4985-90c6-af74d660daa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3aec59cc264dcdbe4e86f908869d39, user_id=d8ed5f5ba8264787a7acfeb56a8d2b9c, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:31.857802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfbf43-87ce-4985-90c6-af74d660daa4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:31.866735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-17cb9cfb-5ce7-4303-b955-6ecb1876167f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb007441f6f9492ebb890bd891ba7c66'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:31.882984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-17cb9cfb-5ce7-4303-b955-6ecb1876167f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb007441f6f9492ebb890bd891ba7c66'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:31.904397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:31.980028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1077/2160] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:31 2022] PUT /identity/v3/projects/0b3aec59cc264dcdbe4e86f908869d39/users/d8ed5f5ba8264787a7acfeb56a8d2b9c/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:31.981502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecab43-15ce-4106-9976-9c138002d551 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:31.981785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecab43-15ce-4106-9976-9c138002d551 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:31.984625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecab43-15ce-4106-9976-9c138002d551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:32.006242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-71ecab43-15ce-4106-9976-9c138002d551 None None] MFA Rules not processed for user `e91b32ab25854882af7bc313fdd342b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:32.007399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-71ecab43-15ce-4106-9976-9c138002d551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:32.019529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-17cb9cfb-5ce7-4303-b955-6ecb1876167f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb007441f6f9492ebb890bd891ba7c66'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:32.029014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-17cb9cfb-5ce7-4303-b955-6ecb1876167f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb007441f6f9492ebb890bd891ba7c66'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:32.029783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-17cb9cfb-5ce7-4303-b955-6ecb1876167f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb007441f6f9492ebb890bd891ba7c66'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:32.036695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1084/2161] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:31 2022] DELETE /identity/v3/users/cb007441f6f9492ebb890bd891ba7c66 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:32.038157 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9eb9a-a865-4485-a813-fea5d6b427f0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:32.038443 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9eb9a-a865-4485-a813-fea5d6b427f0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:32.038720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9eb9a-a865-4485-a813-fea5d6b427f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:32.084743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1078/2162] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:32.084950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b7c9eb9a-a865-4485-a813-fea5d6b427f0 None None] MFA Rules not processed for user `d8ed5f5ba8264787a7acfeb56a8d2b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:32.084950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b7c9eb9a-a865-4485-a813-fea5d6b427f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:32.174133 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1085/2163] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:32.175274 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecab43-15ce-4106-9976-9c138002d551 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:32.176710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-71ecab43-15ce-4106-9976-9c138002d551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:32.263069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecab43-15ce-4106-9976-9c138002d551 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:32.329030 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e0e3e-a7b5-41e6-9411-4f55eb3ba361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:32.330369 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e0e3e-a7b5-41e6-9411-4f55eb3ba361 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:32.331187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e0e3e-a7b5-41e6-9411-4f55eb3ba361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:32.331963 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e0e3e-a7b5-41e6-9411-4f55eb3ba361 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:32.335210 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e0e3e-a7b5-41e6-9411-4f55eb3ba361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:32.338617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e0e3e-a7b5-41e6-9411-4f55eb3ba361 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:32.461133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1079/2164] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:32 2022] POST /identity/v3/projects => generated 381 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:32.462367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9eb9a-a865-4485-a813-fea5d6b427f0 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:32.474550 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9eb9a-a865-4485-a813-fea5d6b427f0 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:32.582820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e95c6-d88b-4edc-8d7e-30f7289dcae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:32.583444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e95c6-d88b-4edc-8d7e-30f7289dcae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:32.583720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e95c6-d88b-4edc-8d7e-30f7289dcae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:32.583984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e95c6-d88b-4edc-8d7e-30f7289dcae6 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:32.590511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e95c6-d88b-4edc-8d7e-30f7289dcae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:32.595166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e95c6-d88b-4edc-8d7e-30f7289dcae6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:32.716048 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1086/2165] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:32 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:32.720535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e0e3e-a7b5-41e6-9411-4f55eb3ba361 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:32.737520 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e0e3e-a7b5-41e6-9411-4f55eb3ba361 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:32.738269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:32.751408 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23207920-8445-4b85-ad41-ed3e68827db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:32.752081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207920-8445-4b85-ad41-ed3e68827db9 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:32.753066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207920-8445-4b85-ad41-ed3e68827db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:32.753535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207920-8445-4b85-ad41-ed3e68827db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:32.754377 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23207920-8445-4b85-ad41-ed3e68827db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:32.756690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23207920-8445-4b85-ad41-ed3e68827db9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:32.774073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1080/2166] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:32.779619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e95c6-d88b-4edc-8d7e-30f7289dcae6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:32.794219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e95c6-d88b-4edc-8d7e-30f7289dcae6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:32.799669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13937f-ceb1-4e5e-8795-f87a4133b91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:32.800338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13937f-ceb1-4e5e-8795-f87a4133b91e admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:32.800631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13937f-ceb1-4e5e-8795-f87a4133b91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:32.800908 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13937f-ceb1-4e5e-8795-f87a4133b91e admin admin] PATH_INFO: `/v3/projects/d902a3a9f6b74f63bce22e7fc7f1f169/users/84df6f3d581d41988e5d3b29f5466789/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:32.824948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13937f-ceb1-4e5e-8795-f87a4133b91e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d902a3a9f6b74f63bce22e7fc7f1f169, user_id=84df6f3d581d41988e5d3b29f5466789, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:32.828022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13937f-ceb1-4e5e-8795-f87a4133b91e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:32.848340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23207920-8445-4b85-ad41-ed3e68827db9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:32.850424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-23207920-8445-4b85-ad41-ed3e68827db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:32.864792 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23207920-8445-4b85-ad41-ed3e68827db9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:32.871067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d20222-7fed-49e3-9c01-3e6b935945b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:32.871887 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d20222-7fed-49e3-9c01-3e6b935945b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:32.872309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d20222-7fed-49e3-9c01-3e6b935945b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:32.872700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d20222-7fed-49e3-9c01-3e6b935945b9 admin admin] PATH_INFO: `/v3/projects/f651e0fc2a204adbb947547933ae2c91` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:32.874314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d20222-7fed-49e3-9c01-3e6b935945b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f651e0fc2a204adbb947547933ae2c91)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:32.876362 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d20222-7fed-49e3-9c01-3e6b935945b9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:32.946310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1087/2167] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:32 2022] PUT /identity/v3/projects/d902a3a9f6b74f63bce22e7fc7f1f169/users/84df6f3d581d41988e5d3b29f5466789/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:32.952251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13937f-ceb1-4e5e-8795-f87a4133b91e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:33.022531 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13937f-ceb1-4e5e-8795-f87a4133b91e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:33.027493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81f0b1-3822-40e7-901c-1c80f94ac33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:33.028046 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81f0b1-3822-40e7-901c-1c80f94ac33a admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:33.028330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81f0b1-3822-40e7-901c-1c80f94ac33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:33.028605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81f0b1-3822-40e7-901c-1c80f94ac33a admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:33.029299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81f0b1-3822-40e7-901c-1c80f94ac33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:33.030887 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81f0b1-3822-40e7-901c-1c80f94ac33a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:33.044710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1088/2168] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:33.048821 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81f0b1-3822-40e7-901c-1c80f94ac33a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:33.056338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-82d20222-7fed-49e3-9c01-3e6b935945b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f651e0fc2a204adbb947547933ae2c91', 'request_id': 'req-82d20222-7fed-49e3-9c01-3e6b935945b9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:33.064226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81f0b1-3822-40e7-901c-1c80f94ac33a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:33.146349 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019794c-90cb-4190-b2cc-3576a4f301ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:33.147083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019794c-90cb-4190-b2cc-3576a4f301ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:33.147433 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019794c-90cb-4190-b2cc-3576a4f301ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:33.147774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019794c-90cb-4190-b2cc-3576a4f301ca admin admin] PATH_INFO: `/v3/projects/d902a3a9f6b74f63bce22e7fc7f1f169/users/84df6f3d581d41988e5d3b29f5466789/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:33.150026 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019794c-90cb-4190-b2cc-3576a4f301ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d902a3a9f6b74f63bce22e7fc7f1f169, user_id=84df6f3d581d41988e5d3b29f5466789, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:33.152996 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019794c-90cb-4190-b2cc-3576a4f301ca admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:33.169035 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1089/2169] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:33 2022] PUT /identity/v3/projects/d902a3a9f6b74f63bce22e7fc7f1f169/users/84df6f3d581d41988e5d3b29f5466789/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:33.179387 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-82d20222-7fed-49e3-9c01-3e6b935945b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f651e0fc2a204adbb947547933ae2c91', 'request_id': 'req-82d20222-7fed-49e3-9c01-3e6b935945b9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:33.183273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7f0b-11de-440c-b51a-1d9a8c505f93 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:33.183273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7f0b-11de-440c-b51a-1d9a8c505f93 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:33.183273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7f0b-11de-440c-b51a-1d9a8c505f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:33.189673 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-82d20222-7fed-49e3-9c01-3e6b935945b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f651e0fc2a204adbb947547933ae2c91', 'request_id': 'req-82d20222-7fed-49e3-9c01-3e6b935945b9'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:33.204073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-82d20222-7fed-49e3-9c01-3e6b935945b9 admin admin] The token cache is being invalidate because project f651e0fc2a204adbb947547933ae2c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:33.204475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-82d20222-7fed-49e3-9c01-3e6b935945b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:33.205887 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-82d20222-7fed-49e3-9c01-3e6b935945b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:33.206937 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1081/2170] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:32 2022] DELETE /identity/v3/projects/f651e0fc2a204adbb947547933ae2c91 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:33.213162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efae01c-0fec-4063-85b9-193735405955 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:33.214487 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efae01c-0fec-4063-85b9-193735405955 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:33.214932 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efae01c-0fec-4063-85b9-193735405955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:33.225252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-030c7f0b-11de-440c-b51a-1d9a8c505f93 None None] MFA Rules not processed for user `84df6f3d581d41988e5d3b29f5466789`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:33.226937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-030c7f0b-11de-440c-b51a-1d9a8c505f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:33.237489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7efae01c-0fec-4063-85b9-193735405955 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:33.238691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7efae01c-0fec-4063-85b9-193735405955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:33.309567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1090/2171] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:33.318959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1082/2172] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:33.320769 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c7f0b-11de-440c-b51a-1d9a8c505f93 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:33.322230 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-030c7f0b-11de-440c-b51a-1d9a8c505f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:33.335393 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f3551-9dcf-47db-b517-09bd0e42fe4a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:33.335672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f3551-9dcf-47db-b517-09bd0e42fe4a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:33.335960 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f3551-9dcf-47db-b517-09bd0e42fe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:33.356724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-989f3551-9dcf-47db-b517-09bd0e42fe4a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:33.357989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-989f3551-9dcf-47db-b517-09bd0e42fe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:33.366223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1083/2173] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:33.370575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f3551-9dcf-47db-b517-09bd0e42fe4a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:33.380891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f3551-9dcf-47db-b517-09bd0e42fe4a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:33.383914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c7f0b-11de-440c-b51a-1d9a8c505f93 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:33.386274 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdcaee-20b1-4dbf-a583-5dbd9d813d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:33.386897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdcaee-20b1-4dbf-a583-5dbd9d813d92 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:33.387182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdcaee-20b1-4dbf-a583-5dbd9d813d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:33.387462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdcaee-20b1-4dbf-a583-5dbd9d813d92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:33.388118 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdcaee-20b1-4dbf-a583-5dbd9d813d92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:33.388423 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdcaee-20b1-4dbf-a583-5dbd9d813d92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:33.389067 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602410d-3ac6-45cf-b1d3-19a12866be04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:33.389702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602410d-3ac6-45cf-b1d3-19a12866be04 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:33.389983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602410d-3ac6-45cf-b1d3-19a12866be04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:33.390090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdcaee-20b1-4dbf-a583-5dbd9d813d92 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:33.390262 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602410d-3ac6-45cf-b1d3-19a12866be04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:33.399879 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602410d-3ac6-45cf-b1d3-19a12866be04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:33.401865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602410d-3ac6-45cf-b1d3-19a12866be04 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:33.405902 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1084/2174] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:44:33.410753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdcaee-20b1-4dbf-a583-5dbd9d813d92 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:33.417615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1091/2175] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:33.422064 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdcaee-20b1-4dbf-a583-5dbd9d813d92 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:33.429305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596b876-fec9-449d-a43f-f1effcd5015a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:33.430213 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596b876-fec9-449d-a43f-f1effcd5015a admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:33.430739 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596b876-fec9-449d-a43f-f1effcd5015a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:33.431216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596b876-fec9-449d-a43f-f1effcd5015a admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:33.432138 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596b876-fec9-449d-a43f-f1effcd5015a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:33.434319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596b876-fec9-449d-a43f-f1effcd5015a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:33.542726 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1085/2176] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:33 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:33.543726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602410d-3ac6-45cf-b1d3-19a12866be04 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:33.569173 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602410d-3ac6-45cf-b1d3-19a12866be04 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:33.681640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef7483-a370-4a45-8829-5a7c12aa7eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:33.682443 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef7483-a370-4a45-8829-5a7c12aa7eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:33.682742 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef7483-a370-4a45-8829-5a7c12aa7eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:33.682964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef7483-a370-4a45-8829-5a7c12aa7eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:33.683709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef7483-a370-4a45-8829-5a7c12aa7eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:33.685720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef7483-a370-4a45-8829-5a7c12aa7eb1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:33.812810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1092/2177] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:33 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:33.816758 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596b876-fec9-449d-a43f-f1effcd5015a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:33.845023 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596b876-fec9-449d-a43f-f1effcd5015a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:33.860619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41a567-f627-49b5-8b87-26cf62981351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:33.861278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41a567-f627-49b5-8b87-26cf62981351 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:33.861753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41a567-f627-49b5-8b87-26cf62981351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:33.862040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41a567-f627-49b5-8b87-26cf62981351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:33.862767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41a567-f627-49b5-8b87-26cf62981351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:33.864703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41a567-f627-49b5-8b87-26cf62981351 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:33.883644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef7483-a370-4a45-8829-5a7c12aa7eb1 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:33.889891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1086/2178] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:33.895739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef7483-a370-4a45-8829-5a7c12aa7eb1 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:33.902177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d22db-5e19-49bd-bc2f-416109cae22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:33.902829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d22db-5e19-49bd-bc2f-416109cae22b admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:33.903109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d22db-5e19-49bd-bc2f-416109cae22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:33.903607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d22db-5e19-49bd-bc2f-416109cae22b admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:33.904242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d22db-5e19-49bd-bc2f-416109cae22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:33.906150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d22db-5e19-49bd-bc2f-416109cae22b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:33.931783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1093/2179] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:33.936183 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41a567-f627-49b5-8b87-26cf62981351 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:33.956629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41a567-f627-49b5-8b87-26cf62981351 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:33.956629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91b91f-5cb8-4ebe-9737-590ad7ef2809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:33.956629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91b91f-5cb8-4ebe-9737-590ad7ef2809 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:33.956629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91b91f-5cb8-4ebe-9737-590ad7ef2809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:33.958132 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91b91f-5cb8-4ebe-9737-590ad7ef2809 admin admin] PATH_INFO: `/v3/projects/aec08fc7b49f4d9eaa1a0e74faac5385/users/76dc2980604e459b82a4bdc9f3d1c6d2/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:33.977306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91b91f-5cb8-4ebe-9737-590ad7ef2809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec08fc7b49f4d9eaa1a0e74faac5385, user_id=76dc2980604e459b82a4bdc9f3d1c6d2, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:33.977541 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91b91f-5cb8-4ebe-9737-590ad7ef2809 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:34.047643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1087/2180] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:33 2022] PUT /identity/v3/projects/aec08fc7b49f4d9eaa1a0e74faac5385/users/76dc2980604e459b82a4bdc9f3d1c6d2/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:34.059608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49321c40-2d62-4c5f-a1e7-8d80afd84b9c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:34.061125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49321c40-2d62-4c5f-a1e7-8d80afd84b9c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:34.061506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49321c40-2d62-4c5f-a1e7-8d80afd84b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:34.087329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:34.108638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-49321c40-2d62-4c5f-a1e7-8d80afd84b9c None None] MFA Rules not processed for user `76dc2980604e459b82a4bdc9f3d1c6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:34.109876 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-49321c40-2d62-4c5f-a1e7-8d80afd84b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:34.170341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91b91f-5cb8-4ebe-9737-590ad7ef2809 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:34.172413 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7c91b91f-5cb8-4ebe-9737-590ad7ef2809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:34.202489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1094/2181] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:34.212792 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49321c40-2d62-4c5f-a1e7-8d80afd84b9c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:34.217690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-49321c40-2d62-4c5f-a1e7-8d80afd84b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:34.278820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91b91f-5cb8-4ebe-9737-590ad7ef2809 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:34.291018 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134708e-32b0-49ae-bbce-78ef1e86a9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:34.291818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134708e-32b0-49ae-bbce-78ef1e86a9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:34.292307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134708e-32b0-49ae-bbce-78ef1e86a9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:34.292588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134708e-32b0-49ae-bbce-78ef1e86a9e2 admin admin] PATH_INFO: `/v3/users/d8ed5f5ba8264787a7acfeb56a8d2b9c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:34.294547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134708e-32b0-49ae-bbce-78ef1e86a9e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ed5f5ba8264787a7acfeb56a8d2b9c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:34.297565 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134708e-32b0-49ae-bbce-78ef1e86a9e2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:34.305812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49321c40-2d62-4c5f-a1e7-8d80afd84b9c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:34.315495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96792c58-2fca-40a6-aecf-1d5b1893c77f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:34.315495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96792c58-2fca-40a6-aecf-1d5b1893c77f service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:34.315495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96792c58-2fca-40a6-aecf-1d5b1893c77f service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:34.315495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96792c58-2fca-40a6-aecf-1d5b1893c77f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:34.330040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96792c58-2fca-40a6-aecf-1d5b1893c77f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:34.332468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96792c58-2fca-40a6-aecf-1d5b1893c77f service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:34.344050 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1095/2182] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:34.612353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a134708e-32b0-49ae-bbce-78ef1e86a9e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ed5f5ba8264787a7acfeb56a8d2b9c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:34.613383 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a134708e-32b0-49ae-bbce-78ef1e86a9e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ed5f5ba8264787a7acfeb56a8d2b9c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:34.648983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a134708e-32b0-49ae-bbce-78ef1e86a9e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ed5f5ba8264787a7acfeb56a8d2b9c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:34.663992 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a134708e-32b0-49ae-bbce-78ef1e86a9e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ed5f5ba8264787a7acfeb56a8d2b9c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:34.666027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a134708e-32b0-49ae-bbce-78ef1e86a9e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ed5f5ba8264787a7acfeb56a8d2b9c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:34.775343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1088/2183] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:34 2022] DELETE /identity/v3/users/d8ed5f5ba8264787a7acfeb56a8d2b9c => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:34.780756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bf04a-5531-45a9-bb51-063c35d306ee None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:34.781042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bf04a-5531-45a9-bb51-063c35d306ee None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:34.781376 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bf04a-5531-45a9-bb51-063c35d306ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:34.849788 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ff1bf04a-5531-45a9-bb51-063c35d306ee None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:34.863553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ff1bf04a-5531-45a9-bb51-063c35d306ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:34.977483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1096/2184] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:34.990627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:34.997264 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134708e-32b0-49ae-bbce-78ef1e86a9e2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:34.999030 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a134708e-32b0-49ae-bbce-78ef1e86a9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:35.119777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134708e-32b0-49ae-bbce-78ef1e86a9e2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:35.130918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378264f8-d186-4a96-852c-37c07deb629e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:35.134865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378264f8-d186-4a96-852c-37c07deb629e service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:35.135166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378264f8-d186-4a96-852c-37c07deb629e service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:35.135449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378264f8-d186-4a96-852c-37c07deb629e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:35.152831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378264f8-d186-4a96-852c-37c07deb629e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:35.154339 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378264f8-d186-4a96-852c-37c07deb629e service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:35.177696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1089/2185] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:35.941521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bf04a-5531-45a9-bb51-063c35d306ee None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:35.943352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ff1bf04a-5531-45a9-bb51-063c35d306ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:35.962833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bf04a-5531-45a9-bb51-063c35d306ee None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:35.968118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99656f-469c-4faf-ab90-7eaeb6327107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:35.968760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99656f-469c-4faf-ab90-7eaeb6327107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:35.969043 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99656f-469c-4faf-ab90-7eaeb6327107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:35.969365 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99656f-469c-4faf-ab90-7eaeb6327107 admin admin] PATH_INFO: `/v3/projects/0b3aec59cc264dcdbe4e86f908869d39` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:35.970550 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99656f-469c-4faf-ab90-7eaeb6327107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3aec59cc264dcdbe4e86f908869d39)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:35.972603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99656f-469c-4faf-ab90-7eaeb6327107 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:36.094467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-cc99656f-469c-4faf-ab90-7eaeb6327107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3aec59cc264dcdbe4e86f908869d39', 'request_id': 'req-cc99656f-469c-4faf-ab90-7eaeb6327107'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:36.194825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-cc99656f-469c-4faf-ab90-7eaeb6327107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3aec59cc264dcdbe4e86f908869d39', 'request_id': 'req-cc99656f-469c-4faf-ab90-7eaeb6327107'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:36.202070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-cc99656f-469c-4faf-ab90-7eaeb6327107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3aec59cc264dcdbe4e86f908869d39', 'request_id': 'req-cc99656f-469c-4faf-ab90-7eaeb6327107'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:36.217034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-cc99656f-469c-4faf-ab90-7eaeb6327107 admin admin] The token cache is being invalidate because project 0b3aec59cc264dcdbe4e86f908869d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:36.217424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-cc99656f-469c-4faf-ab90-7eaeb6327107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:36.224499 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-cc99656f-469c-4faf-ab90-7eaeb6327107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:36.224499 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1097/2186] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:35 2022] DELETE /identity/v3/projects/0b3aec59cc264dcdbe4e86f908869d39 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:36.224894 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378264f8-d186-4a96-852c-37c07deb629e service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:36.236852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378264f8-d186-4a96-852c-37c07deb629e service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:36.277562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:36.339349 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0b249-f1c9-4a8c-9196-5b237ba3459e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:36.340042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0b249-f1c9-4a8c-9196-5b237ba3459e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:36.340342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0b249-f1c9-4a8c-9196-5b237ba3459e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:36.340610 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0b249-f1c9-4a8c-9196-5b237ba3459e admin admin] PATH_INFO: `/v3/users/84df6f3d581d41988e5d3b29f5466789` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:36.341968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0b249-f1c9-4a8c-9196-5b237ba3459e admin admin] RBAC: Authorizing `identity:delete_user(user_id=84df6f3d581d41988e5d3b29f5466789)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:36.344131 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0b249-f1c9-4a8c-9196-5b237ba3459e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:36.446407 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58ec3b-6c47-467f-9483-6bc8d7e3d774 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:36.455234 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58ec3b-6c47-467f-9483-6bc8d7e3d774 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:36.455234 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58ec3b-6c47-467f-9483-6bc8d7e3d774 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:36.455234 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1098/2187] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 31 04:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:44:36.493086 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ff28f-895f-4859-b164-4cf561e0e54d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:36.493407 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ff28f-895f-4859-b164-4cf561e0e54d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:36.493869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ff28f-895f-4859-b164-4cf561e0e54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:36.530499 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a77ff28f-895f-4859-b164-4cf561e0e54d None None] MFA Rules not processed for user `a4ad954bbb7749ee8861e8da98619006`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:36.531782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a77ff28f-895f-4859-b164-4cf561e0e54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:36.604405 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffb0b249-f1c9-4a8c-9196-5b237ba3459e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84df6f3d581d41988e5d3b29f5466789'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:36.605666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffb0b249-f1c9-4a8c-9196-5b237ba3459e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84df6f3d581d41988e5d3b29f5466789'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:36.628063 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffb0b249-f1c9-4a8c-9196-5b237ba3459e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84df6f3d581d41988e5d3b29f5466789'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:36.638994 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1099/2188] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 31 04:44:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:36.643003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffb0b249-f1c9-4a8c-9196-5b237ba3459e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84df6f3d581d41988e5d3b29f5466789'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:36.646117 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ffb0b249-f1c9-4a8c-9196-5b237ba3459e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84df6f3d581d41988e5d3b29f5466789'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:36.654955 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ff28f-895f-4859-b164-4cf561e0e54d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:36.656462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a77ff28f-895f-4859-b164-4cf561e0e54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:36.672082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ff28f-895f-4859-b164-4cf561e0e54d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:36.677719 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b36dd-a842-4ccc-b53d-3785e4f0e5b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ad954bbb7749ee8861e8da98619006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:36.678367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b36dd-a842-4ccc-b53d-3785e4f0e5b4 service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:36.678616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b36dd-a842-4ccc-b53d-3785e4f0e5b4 service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:36.678889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b36dd-a842-4ccc-b53d-3785e4f0e5b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:36.692151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b36dd-a842-4ccc-b53d-3785e4f0e5b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:36.692151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b36dd-a842-4ccc-b53d-3785e4f0e5b4 service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:36.702749 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1100/2189] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:44:36.739559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1090/2190] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:36 2022] DELETE /identity/v3/users/84df6f3d581d41988e5d3b29f5466789 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:36.840504 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b36dd-a842-4ccc-b53d-3785e4f0e5b4 service placement] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:36.844405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f16b36dd-a842-4ccc-b53d-3785e4f0e5b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:36.887557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b36dd-a842-4ccc-b53d-3785e4f0e5b4 service placement] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:36.982303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9d176-c023-40dc-9c9f-a1b5ec4cd559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:36.982965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9d176-c023-40dc-9c9f-a1b5ec4cd559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:36.983254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9d176-c023-40dc-9c9f-a1b5ec4cd559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:36.983804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9d176-c023-40dc-9c9f-a1b5ec4cd559 admin admin] PATH_INFO: `/v3/users/ab4a337783e649a599f4933b16db6027` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:36.985138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9d176-c023-40dc-9c9f-a1b5ec4cd559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4a337783e649a599f4933b16db6027)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:36.987690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9d176-c023-40dc-9c9f-a1b5ec4cd559 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:37.108790 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:37.154868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-19e9d176-c023-40dc-9c9f-a1b5ec4cd559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4a337783e649a599f4933b16db6027'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.174212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-19e9d176-c023-40dc-9c9f-a1b5ec4cd559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4a337783e649a599f4933b16db6027'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.204895 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0b249-f1c9-4a8c-9196-5b237ba3459e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:37.206772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ffb0b249-f1c9-4a8c-9196-5b237ba3459e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:37.223550 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0b249-f1c9-4a8c-9196-5b237ba3459e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:37.238223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a8cd7-c7ec-4393-afeb-13178dedd3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:37.238223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a8cd7-c7ec-4393-afeb-13178dedd3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:37.238223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a8cd7-c7ec-4393-afeb-13178dedd3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:37.238223 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a8cd7-c7ec-4393-afeb-13178dedd3d5 admin admin] PATH_INFO: `/v3/projects/d902a3a9f6b74f63bce22e7fc7f1f169` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:37.239344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a8cd7-c7ec-4393-afeb-13178dedd3d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d902a3a9f6b74f63bce22e7fc7f1f169)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:37.239344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a8cd7-c7ec-4393-afeb-13178dedd3d5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:37.286720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-19e9d176-c023-40dc-9c9f-a1b5ec4cd559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4a337783e649a599f4933b16db6027'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.296254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-19e9d176-c023-40dc-9c9f-a1b5ec4cd559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4a337783e649a599f4933b16db6027'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.297081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-19e9d176-c023-40dc-9c9f-a1b5ec4cd559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4a337783e649a599f4933b16db6027'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.303401 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1101/2191] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:36 2022] DELETE /identity/v3/users/ab4a337783e649a599f4933b16db6027 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:37.376243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-024a8cd7-c7ec-4393-afeb-13178dedd3d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd902a3a9f6b74f63bce22e7fc7f1f169', 'request_id': 'req-024a8cd7-c7ec-4393-afeb-13178dedd3d5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.429491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-024a8cd7-c7ec-4393-afeb-13178dedd3d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd902a3a9f6b74f63bce22e7fc7f1f169', 'request_id': 'req-024a8cd7-c7ec-4393-afeb-13178dedd3d5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.438372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-024a8cd7-c7ec-4393-afeb-13178dedd3d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd902a3a9f6b74f63bce22e7fc7f1f169', 'request_id': 'req-024a8cd7-c7ec-4393-afeb-13178dedd3d5'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.450462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-024a8cd7-c7ec-4393-afeb-13178dedd3d5 admin admin] The token cache is being invalidate because project d902a3a9f6b74f63bce22e7fc7f1f169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:37.450814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-024a8cd7-c7ec-4393-afeb-13178dedd3d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.468478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-024a8cd7-c7ec-4393-afeb-13178dedd3d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.470425 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1091/2192] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:37 2022] DELETE /identity/v3/projects/d902a3a9f6b74f63bce22e7fc7f1f169 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:37.476281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17d309-38b3-4003-b3b3-6fe8be8ebdfa None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:37.476642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17d309-38b3-4003-b3b3-6fe8be8ebdfa None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:37.476989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17d309-38b3-4003-b3b3-6fe8be8ebdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:37.502118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-df17d309-38b3-4003-b3b3-6fe8be8ebdfa None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:37.503431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-df17d309-38b3-4003-b3b3-6fe8be8ebdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:37.576379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1102/2193] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:37.578793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5762894-7e56-483e-af39-3beb42c1f539 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:37.579079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5762894-7e56-483e-af39-3beb42c1f539 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:37.579368 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5762894-7e56-483e-af39-3beb42c1f539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:37.586701 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17d309-38b3-4003-b3b3-6fe8be8ebdfa None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:37.588679 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-df17d309-38b3-4003-b3b3-6fe8be8ebdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:37.616724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b5762894-7e56-483e-af39-3beb42c1f539 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:37.616724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b5762894-7e56-483e-af39-3beb42c1f539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:37.617245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17d309-38b3-4003-b3b3-6fe8be8ebdfa None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:37.623281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:37.623945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:37.624287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:37.624554 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] PATH_INFO: `/v3/projects/2831d8d49afb495ea86c2ea1dc63b8c2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:37.625888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2831d8d49afb495ea86c2ea1dc63b8c2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:37.627823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:37.638954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1092/2194] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:37.643704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5762894-7e56-483e-af39-3beb42c1f539 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:37.661888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5762894-7e56-483e-af39-3beb42c1f539 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:37.674189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e64d0d-7b4d-490e-9a42-92a2400700e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:37.674189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e64d0d-7b4d-490e-9a42-92a2400700e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:37.674724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e64d0d-7b4d-490e-9a42-92a2400700e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:37.675046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e64d0d-7b4d-490e-9a42-92a2400700e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:37.675815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e64d0d-7b4d-490e-9a42-92a2400700e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:37.676212 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e64d0d-7b4d-490e-9a42-92a2400700e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:37.678169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e64d0d-7b4d-490e-9a42-92a2400700e1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:37.700764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1093/2195] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:44:37.705563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e64d0d-7b4d-490e-9a42-92a2400700e1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:37.715771 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e64d0d-7b4d-490e-9a42-92a2400700e1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:37.728038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38e21e-3ab9-4560-844d-3ca6695ecf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:37.728832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38e21e-3ab9-4560-844d-3ca6695ecf13 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:37.729172 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38e21e-3ab9-4560-844d-3ca6695ecf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:37.729530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38e21e-3ab9-4560-844d-3ca6695ecf13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:37.730802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38e21e-3ab9-4560-844d-3ca6695ecf13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:37.732812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38e21e-3ab9-4560-844d-3ca6695ecf13 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:37.782372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2831d8d49afb495ea86c2ea1dc63b8c2', 'request_id': 'req-2299576a-84f2-4bd0-9703-180aa4556bd7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.853704 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2831d8d49afb495ea86c2ea1dc63b8c2', 'request_id': 'req-2299576a-84f2-4bd0-9703-180aa4556bd7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.858542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1094/2196] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:37 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:37.862559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38e21e-3ab9-4560-844d-3ca6695ecf13 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:37.866454 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2831d8d49afb495ea86c2ea1dc63b8c2', 'request_id': 'req-2299576a-84f2-4bd0-9703-180aa4556bd7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.880057 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] The token cache is being invalidate because project 2831d8d49afb495ea86c2ea1dc63b8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:37.880365 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.881077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:37.884000 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1103/2197] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:37 2022] DELETE /identity/v3/projects/2831d8d49afb495ea86c2ea1dc63b8c2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:37.888070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:37.895103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:37.995173 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:38.001905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38e21e-3ab9-4560-844d-3ca6695ecf13 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:38.007428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b17b4e-307e-4df8-bb6a-902e90af9572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:38.008791 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b17b4e-307e-4df8-bb6a-902e90af9572 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:38.009382 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b17b4e-307e-4df8-bb6a-902e90af9572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:38.009855 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b17b4e-307e-4df8-bb6a-902e90af9572 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:38.014310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b17b4e-307e-4df8-bb6a-902e90af9572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:38.014310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b17b4e-307e-4df8-bb6a-902e90af9572 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:38.020711 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299576a-84f2-4bd0-9703-180aa4556bd7 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:38.029238 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479901f-0777-4295-852f-f5873d529a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:38.030344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479901f-0777-4295-852f-f5873d529a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:38.031075 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479901f-0777-4295-852f-f5873d529a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:38.033045 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479901f-0777-4295-852f-f5873d529a83 admin admin] PATH_INFO: `/v3/users/631c72a61aad4d19a7899fac6fc533cb` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:38.034502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479901f-0777-4295-852f-f5873d529a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=631c72a61aad4d19a7899fac6fc533cb)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:38.037262 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479901f-0777-4295-852f-f5873d529a83 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:38.116380 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1095/2198] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:37 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:38.120067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b17b4e-307e-4df8-bb6a-902e90af9572 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:38.122963 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b4b17b4e-307e-4df8-bb6a-902e90af9572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:38.138390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b17b4e-307e-4df8-bb6a-902e90af9572 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:38.143524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d89654-7bad-447e-a3ed-9ac80da104b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:38.144140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d89654-7bad-447e-a3ed-9ac80da104b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:38.144421 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d89654-7bad-447e-a3ed-9ac80da104b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:38.144691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d89654-7bad-447e-a3ed-9ac80da104b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:38.145371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d89654-7bad-447e-a3ed-9ac80da104b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:38.147034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d89654-7bad-447e-a3ed-9ac80da104b5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:38.159090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1096/2199] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:38.162953 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d89654-7bad-447e-a3ed-9ac80da104b5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:38.174248 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d89654-7bad-447e-a3ed-9ac80da104b5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:38.180717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71bbe8-ad0c-4575-a8b7-56e9c4d92958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:38.180717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71bbe8-ad0c-4575-a8b7-56e9c4d92958 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:38.180717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71bbe8-ad0c-4575-a8b7-56e9c4d92958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:38.180717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71bbe8-ad0c-4575-a8b7-56e9c4d92958 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:38.181105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71bbe8-ad0c-4575-a8b7-56e9c4d92958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:38.182454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71bbe8-ad0c-4575-a8b7-56e9c4d92958 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:38.194452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1097/2200] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:38.199259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71bbe8-ad0c-4575-a8b7-56e9c4d92958 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:38.213394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71bbe8-ad0c-4575-a8b7-56e9c4d92958 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:38.219062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c930a9-41ce-4b4b-866f-f7ea896e9a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:38.219791 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c930a9-41ce-4b4b-866f-f7ea896e9a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:38.220014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c930a9-41ce-4b4b-866f-f7ea896e9a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:38.220283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c930a9-41ce-4b4b-866f-f7ea896e9a13 admin admin] PATH_INFO: `/v3/projects/9e06a49a60854115bbc8a32c18945349/users/99d57de1523246db88b5add71ccf7528/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:38.235857 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c930a9-41ce-4b4b-866f-f7ea896e9a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e06a49a60854115bbc8a32c18945349, user_id=99d57de1523246db88b5add71ccf7528, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:38.238633 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c930a9-41ce-4b4b-866f-f7ea896e9a13 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:38.318378 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9479901f-0777-4295-852f-f5873d529a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631c72a61aad4d19a7899fac6fc533cb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:38.332161 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9479901f-0777-4295-852f-f5873d529a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631c72a61aad4d19a7899fac6fc533cb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:38.344864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1098/2201] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:38 2022] PUT /identity/v3/projects/9e06a49a60854115bbc8a32c18945349/users/99d57de1523246db88b5add71ccf7528/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:38.357061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19d7bb-8564-4841-9c8f-c7fe63ab9315 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:38.357524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19d7bb-8564-4841-9c8f-c7fe63ab9315 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:38.358067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19d7bb-8564-4841-9c8f-c7fe63ab9315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:38.383893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9479901f-0777-4295-852f-f5873d529a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631c72a61aad4d19a7899fac6fc533cb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:38.387796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-fd19d7bb-8564-4841-9c8f-c7fe63ab9315 None None] MFA Rules not processed for user `99d57de1523246db88b5add71ccf7528`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:38.389086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fd19d7bb-8564-4841-9c8f-c7fe63ab9315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:38.394789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9479901f-0777-4295-852f-f5873d529a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631c72a61aad4d19a7899fac6fc533cb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:38.395546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9479901f-0777-4295-852f-f5873d529a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631c72a61aad4d19a7899fac6fc533cb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:38.404042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1104/2202] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:37 2022] DELETE /identity/v3/users/631c72a61aad4d19a7899fac6fc533cb => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:38.470496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1099/2203] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:38.482983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479901f-0777-4295-852f-f5873d529a83 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:38.484615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9479901f-0777-4295-852f-f5873d529a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:38.489365 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:38.571777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479901f-0777-4295-852f-f5873d529a83 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:38.581291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2814205-8e92-41cd-bdeb-4cae28142613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:38.581291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2814205-8e92-41cd-bdeb-4cae28142613 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:38.581291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2814205-8e92-41cd-bdeb-4cae28142613 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:38.581291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2814205-8e92-41cd-bdeb-4cae28142613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:38.653523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2814205-8e92-41cd-bdeb-4cae28142613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:38.655126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2814205-8e92-41cd-bdeb-4cae28142613 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:38.667063 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19d7bb-8564-4841-9c8f-c7fe63ab9315 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:38.669189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fd19d7bb-8564-4841-9c8f-c7fe63ab9315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:38.670278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1105/2204] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:38.717128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2814205-8e92-41cd-bdeb-4cae28142613 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:38.718744 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f2814205-8e92-41cd-bdeb-4cae28142613 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:38.759584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19d7bb-8564-4841-9c8f-c7fe63ab9315 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:38.808559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2814205-8e92-41cd-bdeb-4cae28142613 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:38.813913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc5e8d-60de-4d9a-b7e9-3e721f249eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:38.814541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc5e8d-60de-4d9a-b7e9-3e721f249eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:38.814818 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc5e8d-60de-4d9a-b7e9-3e721f249eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:38.815087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc5e8d-60de-4d9a-b7e9-3e721f249eed admin admin] PATH_INFO: `/v3/users/99d57de1523246db88b5add71ccf7528` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:38.816411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc5e8d-60de-4d9a-b7e9-3e721f249eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d57de1523246db88b5add71ccf7528)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:38.818468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc5e8d-60de-4d9a-b7e9-3e721f249eed admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:38.828311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352e360-f997-48e4-a927-971f2137aa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:38.830725 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352e360-f997-48e4-a927-971f2137aa5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:38.831446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352e360-f997-48e4-a927-971f2137aa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:38.831969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352e360-f997-48e4-a927-971f2137aa5c admin admin] PATH_INFO: `/v3/projects/634b2d716fbf422fb907c42767ce47bd` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:38.833444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352e360-f997-48e4-a927-971f2137aa5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=634b2d716fbf422fb907c42767ce47bd)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:38.835622 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352e360-f997-48e4-a927-971f2137aa5c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:38.849155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:39.059835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d9cc5e8d-60de-4d9a-b7e9-3e721f249eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d57de1523246db88b5add71ccf7528'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:39.063285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2352e360-f997-48e4-a927-971f2137aa5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634b2d716fbf422fb907c42767ce47bd', 'request_id': 'req-2352e360-f997-48e4-a927-971f2137aa5c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:39.087421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d9cc5e8d-60de-4d9a-b7e9-3e721f249eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d57de1523246db88b5add71ccf7528'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:39.133082 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2352e360-f997-48e4-a927-971f2137aa5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634b2d716fbf422fb907c42767ce47bd', 'request_id': 'req-2352e360-f997-48e4-a927-971f2137aa5c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:39.141906 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2352e360-f997-48e4-a927-971f2137aa5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634b2d716fbf422fb907c42767ce47bd', 'request_id': 'req-2352e360-f997-48e4-a927-971f2137aa5c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:39.160706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2352e360-f997-48e4-a927-971f2137aa5c admin admin] The token cache is being invalidate because project 634b2d716fbf422fb907c42767ce47bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:39.160983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2352e360-f997-48e4-a927-971f2137aa5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:39.161758 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2352e360-f997-48e4-a927-971f2137aa5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:39.163480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1100/2205] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:38 2022] DELETE /identity/v3/projects/634b2d716fbf422fb907c42767ce47bd => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:39.169553 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c274-9d61-407b-b46d-42617f56049e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:39.170163 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c274-9d61-407b-b46d-42617f56049e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:39.170632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c274-9d61-407b-b46d-42617f56049e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:39.192005 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-b406c274-9d61-407b-b46d-42617f56049e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:39.193954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b406c274-9d61-407b-b46d-42617f56049e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:39.246690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d9cc5e8d-60de-4d9a-b7e9-3e721f249eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d57de1523246db88b5add71ccf7528'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:39.256756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d9cc5e8d-60de-4d9a-b7e9-3e721f249eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d57de1523246db88b5add71ccf7528'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:39.257699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d9cc5e8d-60de-4d9a-b7e9-3e721f249eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d57de1523246db88b5add71ccf7528'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:39.259711 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1101/2206] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:39.267213 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1106/2207] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:38 2022] DELETE /identity/v3/users/99d57de1523246db88b5add71ccf7528 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:39.268552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc280a-caf8-4ecb-95b5-5df5bb3f6cc0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:39.268847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc280a-caf8-4ecb-95b5-5df5bb3f6cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:39.291986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc280a-caf8-4ecb-95b5-5df5bb3f6cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:39.291986 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-06dc280a-caf8-4ecb-95b5-5df5bb3f6cc0 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:39.293071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-06dc280a-caf8-4ecb-95b5-5df5bb3f6cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:39.295413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cae5b-8327-4f88-8e85-6c226b00f9b9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:39.295815 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cae5b-8327-4f88-8e85-6c226b00f9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:39.296243 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cae5b-8327-4f88-8e85-6c226b00f9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:39.335489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-cd1cae5b-8327-4f88-8e85-6c226b00f9b9 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:39.337027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cd1cae5b-8327-4f88-8e85-6c226b00f9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:39.360987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1102/2208] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:39.365124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc280a-caf8-4ecb-95b5-5df5bb3f6cc0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:39.375230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc280a-caf8-4ecb-95b5-5df5bb3f6cc0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:39.380669 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a476c-ae14-48ba-9730-d71221f15529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:39.381327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a476c-ae14-48ba-9730-d71221f15529 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:39.381793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a476c-ae14-48ba-9730-d71221f15529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:39.382070 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a476c-ae14-48ba-9730-d71221f15529 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:39.382730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a476c-ae14-48ba-9730-d71221f15529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:39.383035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a476c-ae14-48ba-9730-d71221f15529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:39.384694 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a476c-ae14-48ba-9730-d71221f15529 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:39.402592 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1103/2209] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:44:39.403496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a476c-ae14-48ba-9730-d71221f15529 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:39.413856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a476c-ae14-48ba-9730-d71221f15529 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:39.425438 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1107/2210] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:39.427967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da418b12-6b88-4b85-9287-ef14f316a967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:39.428710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da418b12-6b88-4b85-9287-ef14f316a967 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:39.433665 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da418b12-6b88-4b85-9287-ef14f316a967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:39.433973 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da418b12-6b88-4b85-9287-ef14f316a967 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:39.434672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da418b12-6b88-4b85-9287-ef14f316a967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:39.436651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da418b12-6b88-4b85-9287-ef14f316a967 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:39.438310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cae5b-8327-4f88-8e85-6c226b00f9b9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:39.439874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cd1cae5b-8327-4f88-8e85-6c226b00f9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:39.500785 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cae5b-8327-4f88-8e85-6c226b00f9b9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:39.504580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f5bce-fce5-4c64-9c50-92d0612c68a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:39.505295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f5bce-fce5-4c64-9c50-92d0612c68a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:39.505651 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f5bce-fce5-4c64-9c50-92d0612c68a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:39.506107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f5bce-fce5-4c64-9c50-92d0612c68a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:39.511423 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1104/2211] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:39 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:39.515408 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da418b12-6b88-4b85-9287-ef14f316a967 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:39.516337 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f5bce-fce5-4c64-9c50-92d0612c68a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:39.517884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f5bce-fce5-4c64-9c50-92d0612c68a8 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:39.529144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1108/2212] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:39.601902 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da418b12-6b88-4b85-9287-ef14f316a967 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:39.608220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89744-8e7b-48f4-9c03-8d90627c2de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:39.608846 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89744-8e7b-48f4-9c03-8d90627c2de0 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:39.609123 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89744-8e7b-48f4-9c03-8d90627c2de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:39.609429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89744-8e7b-48f4-9c03-8d90627c2de0 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:39.610143 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b89744-8e7b-48f4-9c03-8d90627c2de0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:39.612287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b89744-8e7b-48f4-9c03-8d90627c2de0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:39.697856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1105/2213] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:39 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:39.701861 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f5bce-fce5-4c64-9c50-92d0612c68a8 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:39.711482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f5bce-fce5-4c64-9c50-92d0612c68a8 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:39.716914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5066e9d-594a-499b-b91b-cea0673e7a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:39.717534 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5066e9d-594a-499b-b91b-cea0673e7a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:39.717816 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5066e9d-594a-499b-b91b-cea0673e7a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:39.718091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5066e9d-594a-499b-b91b-cea0673e7a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:39.718736 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5066e9d-594a-499b-b91b-cea0673e7a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:39.720370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5066e9d-594a-499b-b91b-cea0673e7a46 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:39.731513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1109/2214] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:39.735820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89744-8e7b-48f4-9c03-8d90627c2de0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:39.760318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89744-8e7b-48f4-9c03-8d90627c2de0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:39.769768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657de063-5c62-4583-b0b4-cd123e3898a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:39.772342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657de063-5c62-4583-b0b4-cd123e3898a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:39.773066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657de063-5c62-4583-b0b4-cd123e3898a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:39.773066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657de063-5c62-4583-b0b4-cd123e3898a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:39.773695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657de063-5c62-4583-b0b4-cd123e3898a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:39.775953 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657de063-5c62-4583-b0b4-cd123e3898a2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:39.798104 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5066e9d-594a-499b-b91b-cea0673e7a46 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:39.798593 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1106/2215] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:39.814991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5066e9d-594a-499b-b91b-cea0673e7a46 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:39.820711 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19277f-9462-4ae9-9e42-b99f471cb00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:39.821455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19277f-9462-4ae9-9e42-b99f471cb00d admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:39.821745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19277f-9462-4ae9-9e42-b99f471cb00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:39.822286 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19277f-9462-4ae9-9e42-b99f471cb00d admin admin] PATH_INFO: `/v3/projects/2ca6a1a6df9c4cda943bd581a07564df/users/f43032979ea34fdf9944a93193620743/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:39.844521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19277f-9462-4ae9-9e42-b99f471cb00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca6a1a6df9c4cda943bd581a07564df, user_id=f43032979ea34fdf9944a93193620743, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:39.847887 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19277f-9462-4ae9-9e42-b99f471cb00d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:39.922963 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1110/2216] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:39 2022] PUT /identity/v3/projects/2ca6a1a6df9c4cda943bd581a07564df/users/f43032979ea34fdf9944a93193620743/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:39.925050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752acb09-36ca-4fb8-9643-6f645cc8027c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:39.925781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752acb09-36ca-4fb8-9643-6f645cc8027c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:39.926463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752acb09-36ca-4fb8-9643-6f645cc8027c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:39.967851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-752acb09-36ca-4fb8-9643-6f645cc8027c None None] MFA Rules not processed for user `f43032979ea34fdf9944a93193620743`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:39.969393 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-752acb09-36ca-4fb8-9643-6f645cc8027c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:39.980286 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:40.027627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19277f-9462-4ae9-9e42-b99f471cb00d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:40.035125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8d19277f-9462-4ae9-9e42-b99f471cb00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:40.098370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1107/2217] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:40.143674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752acb09-36ca-4fb8-9643-6f645cc8027c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:40.143674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-752acb09-36ca-4fb8-9643-6f645cc8027c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:40.163239 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19277f-9462-4ae9-9e42-b99f471cb00d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:40.174336 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c7532-5a98-4af3-8aee-7b5106fba9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:40.175841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7532-5a98-4af3-8aee-7b5106fba9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:40.176227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7532-5a98-4af3-8aee-7b5106fba9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:40.179961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7532-5a98-4af3-8aee-7b5106fba9ef admin admin] PATH_INFO: `/v3/projects/9e06a49a60854115bbc8a32c18945349` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:40.181445 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c7532-5a98-4af3-8aee-7b5106fba9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e06a49a60854115bbc8a32c18945349)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:40.188382 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c7532-5a98-4af3-8aee-7b5106fba9ef admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:40.210498 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752acb09-36ca-4fb8-9643-6f645cc8027c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:40.215319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538ba98-1e97-4547-ac8d-563753b09e93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:40.216209 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538ba98-1e97-4547-ac8d-563753b09e93 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:40.216643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538ba98-1e97-4547-ac8d-563753b09e93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:40.216929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538ba98-1e97-4547-ac8d-563753b09e93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:40.227369 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538ba98-1e97-4547-ac8d-563753b09e93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:40.232994 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538ba98-1e97-4547-ac8d-563753b09e93 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:40.243611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1108/2218] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:44:40.265959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538ba98-1e97-4547-ac8d-563753b09e93 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:40.284832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538ba98-1e97-4547-ac8d-563753b09e93 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:40.299455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040873-bd8c-4356-a53e-8d0d115dfa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:40.301433 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040873-bd8c-4356-a53e-8d0d115dfa74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:40.305094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040873-bd8c-4356-a53e-8d0d115dfa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:40.305618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040873-bd8c-4356-a53e-8d0d115dfa74 admin admin] PATH_INFO: `/v3/users/f43032979ea34fdf9944a93193620743` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:40.307794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e040873-bd8c-4356-a53e-8d0d115dfa74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f43032979ea34fdf9944a93193620743)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:40.310366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e040873-bd8c-4356-a53e-8d0d115dfa74 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:40.322507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-df3c7532-5a98-4af3-8aee-7b5106fba9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e06a49a60854115bbc8a32c18945349', 'request_id': 'req-df3c7532-5a98-4af3-8aee-7b5106fba9ef'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:40.400817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-df3c7532-5a98-4af3-8aee-7b5106fba9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e06a49a60854115bbc8a32c18945349', 'request_id': 'req-df3c7532-5a98-4af3-8aee-7b5106fba9ef'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:40.409281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-df3c7532-5a98-4af3-8aee-7b5106fba9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e06a49a60854115bbc8a32c18945349', 'request_id': 'req-df3c7532-5a98-4af3-8aee-7b5106fba9ef'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:40.421791 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-df3c7532-5a98-4af3-8aee-7b5106fba9ef admin admin] The token cache is being invalidate because project 9e06a49a60854115bbc8a32c18945349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:40.422081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-df3c7532-5a98-4af3-8aee-7b5106fba9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:40.423004 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-df3c7532-5a98-4af3-8aee-7b5106fba9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:40.424804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1111/2219] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:40 2022] DELETE /identity/v3/projects/9e06a49a60854115bbc8a32c18945349 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:40.429699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8d4b0-9af2-4557-b5be-317018cde1cf None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:40.429984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8d4b0-9af2-4557-b5be-317018cde1cf None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:40.430264 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8d4b0-9af2-4557-b5be-317018cde1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:40.452929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ddc8d4b0-9af2-4557-b5be-317018cde1cf None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:40.454221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ddc8d4b0-9af2-4557-b5be-317018cde1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:40.492584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2e040873-bd8c-4356-a53e-8d0d115dfa74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f43032979ea34fdf9944a93193620743'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:40.493465 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2e040873-bd8c-4356-a53e-8d0d115dfa74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f43032979ea34fdf9944a93193620743'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:40.498836 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:40.518042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2e040873-bd8c-4356-a53e-8d0d115dfa74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f43032979ea34fdf9944a93193620743'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:40.521115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1112/2220] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:40.526013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2e040873-bd8c-4356-a53e-8d0d115dfa74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f43032979ea34fdf9944a93193620743'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:40.527196 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2e040873-bd8c-4356-a53e-8d0d115dfa74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f43032979ea34fdf9944a93193620743'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:40.529029 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ffde2-7769-4f33-aaa9-95f9875aff47 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:40.529504 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ffde2-7769-4f33-aaa9-95f9875aff47 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:40.529920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ffde2-7769-4f33-aaa9-95f9875aff47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:40.551859 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bb4ffde2-7769-4f33-aaa9-95f9875aff47 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:40.553110 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bb4ffde2-7769-4f33-aaa9-95f9875aff47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:40.562331 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1113/2221] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:40.567024 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ffde2-7769-4f33-aaa9-95f9875aff47 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:40.576351 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ffde2-7769-4f33-aaa9-95f9875aff47 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:40.581179 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92204da6-3334-4971-97a9-904ce7f1da89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:40.581831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92204da6-3334-4971-97a9-904ce7f1da89 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:40.582223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92204da6-3334-4971-97a9-904ce7f1da89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:40.582458 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92204da6-3334-4971-97a9-904ce7f1da89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:40.583113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92204da6-3334-4971-97a9-904ce7f1da89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:40.583424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92204da6-3334-4971-97a9-904ce7f1da89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:40.585075 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92204da6-3334-4971-97a9-904ce7f1da89 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:40.612512 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1109/2222] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:40 2022] DELETE /identity/v3/users/f43032979ea34fdf9944a93193620743 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:40.621319 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1114/2223] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:44:40.621525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103636f2-d257-4bbe-b3e6-5a8c83fbd475 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:40.621525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103636f2-d257-4bbe-b3e6-5a8c83fbd475 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:40.621525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103636f2-d257-4bbe-b3e6-5a8c83fbd475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:40.622937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92204da6-3334-4971-97a9-904ce7f1da89 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:40.638438 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92204da6-3334-4971-97a9-904ce7f1da89 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:40.643278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-103636f2-d257-4bbe-b3e6-5a8c83fbd475 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:40.644415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-103636f2-d257-4bbe-b3e6-5a8c83fbd475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:40.710955 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3231cd-2845-4997-96c7-b89ed2efcaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:40.712078 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3231cd-2845-4997-96c7-b89ed2efcaaa admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:40.712352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3231cd-2845-4997-96c7-b89ed2efcaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:40.712632 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3231cd-2845-4997-96c7-b89ed2efcaaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:40.713669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3231cd-2845-4997-96c7-b89ed2efcaaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:40.715825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3231cd-2845-4997-96c7-b89ed2efcaaa admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:40.726122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1110/2224] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:40.738619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103636f2-d257-4bbe-b3e6-5a8c83fbd475 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:40.740072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-103636f2-d257-4bbe-b3e6-5a8c83fbd475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:40.797774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103636f2-d257-4bbe-b3e6-5a8c83fbd475 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:40.801534 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7edf9f-a2d6-49a3-9f91-99b33d1702e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:40.802141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7edf9f-a2d6-49a3-9f91-99b33d1702e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:40.802416 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7edf9f-a2d6-49a3-9f91-99b33d1702e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:40.802683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7edf9f-a2d6-49a3-9f91-99b33d1702e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:40.813475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7edf9f-a2d6-49a3-9f91-99b33d1702e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:40.814963 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7edf9f-a2d6-49a3-9f91-99b33d1702e2 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:40.816893 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1115/2225] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:40 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:40.820244 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3231cd-2845-4997-96c7-b89ed2efcaaa admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:40.827460 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1111/2226] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:44:40.897514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3231cd-2845-4997-96c7-b89ed2efcaaa admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:40.904615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7220b4-0466-48eb-b262-e1e6516a27e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:40.905241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7220b4-0466-48eb-b262-e1e6516a27e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:40.905527 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7220b4-0466-48eb-b262-e1e6516a27e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:40.905798 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7220b4-0466-48eb-b262-e1e6516a27e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:40.906504 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7220b4-0466-48eb-b262-e1e6516a27e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:40.908866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7220b4-0466-48eb-b262-e1e6516a27e5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:40.998191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1116/2227] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:40 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:41.000674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7edf9f-a2d6-49a3-9f91-99b33d1702e2 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:41.010483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7edf9f-a2d6-49a3-9f91-99b33d1702e2 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:41.016001 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191481ab-3b6e-4860-a365-3348c92c6e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:41.017568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191481ab-3b6e-4860-a365-3348c92c6e9d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:41.018026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191481ab-3b6e-4860-a365-3348c92c6e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:41.018506 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191481ab-3b6e-4860-a365-3348c92c6e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:41.019155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191481ab-3b6e-4860-a365-3348c92c6e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:41.020912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191481ab-3b6e-4860-a365-3348c92c6e9d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:41.036713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1112/2228] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:41.040744 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7220b4-0466-48eb-b262-e1e6516a27e5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:41.051585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7220b4-0466-48eb-b262-e1e6516a27e5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:41.082157 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa46342-6db3-46f6-9023-0f3f68526c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:41.082799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa46342-6db3-46f6-9023-0f3f68526c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:41.083083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa46342-6db3-46f6-9023-0f3f68526c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:41.083356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa46342-6db3-46f6-9023-0f3f68526c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:41.084018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa46342-6db3-46f6-9023-0f3f68526c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:41.085721 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa46342-6db3-46f6-9023-0f3f68526c6e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:41.098831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1117/2229] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:41.102997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191481ab-3b6e-4860-a365-3348c92c6e9d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:41.114038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191481ab-3b6e-4860-a365-3348c92c6e9d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:41.119394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3921b74-e7fc-4d53-9f76-a64372c43692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:41.120721 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3921b74-e7fc-4d53-9f76-a64372c43692 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:41.121047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3921b74-e7fc-4d53-9f76-a64372c43692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:41.121361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3921b74-e7fc-4d53-9f76-a64372c43692 admin admin] PATH_INFO: `/v3/projects/6a3be2092e7c40fe8aace4438b9dbe55/users/af22e7e3dbf04e669ccb3f6090bb794d/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:41.137647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3921b74-e7fc-4d53-9f76-a64372c43692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a3be2092e7c40fe8aace4438b9dbe55, user_id=af22e7e3dbf04e669ccb3f6090bb794d, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:41.140307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3921b74-e7fc-4d53-9f76-a64372c43692 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:41.254171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1113/2230] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:41 2022] PUT /identity/v3/projects/6a3be2092e7c40fe8aace4438b9dbe55/users/af22e7e3dbf04e669ccb3f6090bb794d/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:41.266474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7b383-7bef-488d-8c21-7648fb6ca4d4 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:41.267023 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7b383-7bef-488d-8c21-7648fb6ca4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:41.267023 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7b383-7bef-488d-8c21-7648fb6ca4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:41.296686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-cdc7b383-7bef-488d-8c21-7648fb6ca4d4 None None] MFA Rules not processed for user `af22e7e3dbf04e669ccb3f6090bb794d`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:41.299519 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cdc7b383-7bef-488d-8c21-7648fb6ca4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:41.325672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3921b74-e7fc-4d53-9f76-a64372c43692 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:41.329009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a3921b74-e7fc-4d53-9f76-a64372c43692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:41.393915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1118/2231] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:41.419567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7b383-7bef-488d-8c21-7648fb6ca4d4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:41.423151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cdc7b383-7bef-488d-8c21-7648fb6ca4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:41.426419 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:41.454659 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:41.511718 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3921b74-e7fc-4d53-9f76-a64372c43692 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:41.522389 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7b383-7bef-488d-8c21-7648fb6ca4d4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:41.524284 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e58b5-ac7a-4637-ae3d-fde57b9f624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:41.524902 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e58b5-ac7a-4637-ae3d-fde57b9f624a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:41.525293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e58b5-ac7a-4637-ae3d-fde57b9f624a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:41.525579 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e58b5-ac7a-4637-ae3d-fde57b9f624a admin admin] PATH_INFO: `/v3/projects/2ca6a1a6df9c4cda943bd581a07564df` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:41.527604 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ddda8-c839-46f7-bc02-e52814fd7197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:41.527753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e58b5-ac7a-4637-ae3d-fde57b9f624a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca6a1a6df9c4cda943bd581a07564df)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:41.528328 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ddda8-c839-46f7-bc02-e52814fd7197 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:41.528677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ddda8-c839-46f7-bc02-e52814fd7197 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:41.529025 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ddda8-c839-46f7-bc02-e52814fd7197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:41.532466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e58b5-ac7a-4637-ae3d-fde57b9f624a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:41.540946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ddda8-c839-46f7-bc02-e52814fd7197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:41.543190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ddda8-c839-46f7-bc02-e52814fd7197 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:41.568324 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1119/2232] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:44:41.700163 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-314e58b5-ac7a-4637-ae3d-fde57b9f624a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca6a1a6df9c4cda943bd581a07564df', 'request_id': 'req-314e58b5-ac7a-4637-ae3d-fde57b9f624a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:41.784733 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-314e58b5-ac7a-4637-ae3d-fde57b9f624a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca6a1a6df9c4cda943bd581a07564df', 'request_id': 'req-314e58b5-ac7a-4637-ae3d-fde57b9f624a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:41.792073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-314e58b5-ac7a-4637-ae3d-fde57b9f624a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca6a1a6df9c4cda943bd581a07564df', 'request_id': 'req-314e58b5-ac7a-4637-ae3d-fde57b9f624a'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:41.803907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-314e58b5-ac7a-4637-ae3d-fde57b9f624a admin admin] The token cache is being invalidate because project 2ca6a1a6df9c4cda943bd581a07564df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:41.804160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-314e58b5-ac7a-4637-ae3d-fde57b9f624a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:41.804876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-314e58b5-ac7a-4637-ae3d-fde57b9f624a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:41.806464 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1114/2233] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:41 2022] DELETE /identity/v3/projects/2ca6a1a6df9c4cda943bd581a07564df => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:41.811955 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c185b-e424-4796-8ece-a238d8264109 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:41.812246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c185b-e424-4796-8ece-a238d8264109 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:41.812530 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c185b-e424-4796-8ece-a238d8264109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:41.832432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ba2c185b-e424-4796-8ece-a238d8264109 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:41.833651 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ba2c185b-e424-4796-8ece-a238d8264109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:41.892159 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1120/2234] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:41.900050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bee3b-78a7-4b6e-8add-ad02752434bf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:41.902473 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bee3b-78a7-4b6e-8add-ad02752434bf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:41.902473 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bee3b-78a7-4b6e-8add-ad02752434bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:41.922139 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f25bee3b-78a7-4b6e-8add-ad02752434bf None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:41.923419 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f25bee3b-78a7-4b6e-8add-ad02752434bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:41.931397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1115/2235] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:41.936532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c185b-e424-4796-8ece-a238d8264109 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:41.946214 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c185b-e424-4796-8ece-a238d8264109 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:41.951559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45fb47-9e63-48e8-9038-33c985acae35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:41.952149 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45fb47-9e63-48e8-9038-33c985acae35 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:41.952426 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45fb47-9e63-48e8-9038-33c985acae35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:41.952695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45fb47-9e63-48e8-9038-33c985acae35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:41.953371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45fb47-9e63-48e8-9038-33c985acae35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:41.953669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45fb47-9e63-48e8-9038-33c985acae35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:41.955249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45fb47-9e63-48e8-9038-33c985acae35 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:41.966575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1121/2236] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:44:41.970999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bee3b-78a7-4b6e-8add-ad02752434bf None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:41.980261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bee3b-78a7-4b6e-8add-ad02752434bf None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:41.985129 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a060c-e232-4ddb-bdf2-5b95c2cde3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:41.985758 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a060c-e232-4ddb-bdf2-5b95c2cde3ad admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:41.988430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a060c-e232-4ddb-bdf2-5b95c2cde3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:41.988430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a060c-e232-4ddb-bdf2-5b95c2cde3ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:41.988430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a060c-e232-4ddb-bdf2-5b95c2cde3ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:41.988798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a060c-e232-4ddb-bdf2-5b95c2cde3ad admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:42.083105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1116/2237] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:41 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:42.087294 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45fb47-9e63-48e8-9038-33c985acae35 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:42.098110 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45fb47-9e63-48e8-9038-33c985acae35 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:42.162711 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1a7d6-15c6-4823-8eb9-cfcb7eb8a22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:42.163320 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1a7d6-15c6-4823-8eb9-cfcb7eb8a22d admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:42.163604 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1a7d6-15c6-4823-8eb9-cfcb7eb8a22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:42.163880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1a7d6-15c6-4823-8eb9-cfcb7eb8a22d admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:42.164585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1a7d6-15c6-4823-8eb9-cfcb7eb8a22d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:42.166977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1a7d6-15c6-4823-8eb9-cfcb7eb8a22d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:42.280939 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1122/2238] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:42 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:42.283122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a060c-e232-4ddb-bdf2-5b95c2cde3ad admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:42.295617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a060c-e232-4ddb-bdf2-5b95c2cde3ad admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:42.302276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e40ae-6876-4d57-9ce6-a12cdc08ddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:42.302906 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e40ae-6876-4d57-9ce6-a12cdc08ddb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:42.303184 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e40ae-6876-4d57-9ce6-a12cdc08ddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:42.314580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e40ae-6876-4d57-9ce6-a12cdc08ddb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:42.315320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e40ae-6876-4d57-9ce6-a12cdc08ddb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:42.317101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e40ae-6876-4d57-9ce6-a12cdc08ddb8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:42.328950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1117/2239] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:42.333158 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1a7d6-15c6-4823-8eb9-cfcb7eb8a22d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:42.343833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1a7d6-15c6-4823-8eb9-cfcb7eb8a22d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:42.348488 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ee4d8-35b0-4087-80a7-bd3605488d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:42.349075 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ee4d8-35b0-4087-80a7-bd3605488d59 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:42.349421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ee4d8-35b0-4087-80a7-bd3605488d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:42.349695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ee4d8-35b0-4087-80a7-bd3605488d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:42.350333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ee4d8-35b0-4087-80a7-bd3605488d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:42.351915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ee4d8-35b0-4087-80a7-bd3605488d59 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:42.363254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1123/2240] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:42.367320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e40ae-6876-4d57-9ce6-a12cdc08ddb8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:42.378167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e40ae-6876-4d57-9ce6-a12cdc08ddb8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:42.382709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9460c-6eb9-4d31-bc2c-62a431bd8122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:42.383344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9460c-6eb9-4d31-bc2c-62a431bd8122 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:42.383616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9460c-6eb9-4d31-bc2c-62a431bd8122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:42.383883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9460c-6eb9-4d31-bc2c-62a431bd8122 admin admin] PATH_INFO: `/v3/projects/fc70a899a5c548cf97dcd9494a3bd3d9/users/1938f6c58e18481ca97dc88268ff43a6/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:42.399179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9460c-6eb9-4d31-bc2c-62a431bd8122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc70a899a5c548cf97dcd9494a3bd3d9, user_id=1938f6c58e18481ca97dc88268ff43a6, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:42.402431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9460c-6eb9-4d31-bc2c-62a431bd8122 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:42.475533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:42.508978 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1118/2241] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:42 2022] PUT /identity/v3/projects/fc70a899a5c548cf97dcd9494a3bd3d9/users/1938f6c58e18481ca97dc88268ff43a6/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:42.520023 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9720a9-1f28-47fd-b3f2-346c4466ab71 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:42.520303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9720a9-1f28-47fd-b3f2-346c4466ab71 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:42.520569 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9720a9-1f28-47fd-b3f2-346c4466ab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:42.532230 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:42.552754 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9d9720a9-1f28-47fd-b3f2-346c4466ab71 None None] MFA Rules not processed for user `1938f6c58e18481ca97dc88268ff43a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:42.554005 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9d9720a9-1f28-47fd-b3f2-346c4466ab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:42.622817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1124/2242] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:42.639476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9460c-6eb9-4d31-bc2c-62a431bd8122 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:42.641225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d0e9460c-6eb9-4d31-bc2c-62a431bd8122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:42.710976 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9460c-6eb9-4d31-bc2c-62a431bd8122 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:42.714949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1385bf-7483-43b5-9c98-fe91cf5a3684 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:42.715559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1385bf-7483-43b5-9c98-fe91cf5a3684 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:42.715971 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1385bf-7483-43b5-9c98-fe91cf5a3684 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:42.716215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1385bf-7483-43b5-9c98-fe91cf5a3684 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:42.731838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1385bf-7483-43b5-9c98-fe91cf5a3684 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:42.733724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1385bf-7483-43b5-9c98-fe91cf5a3684 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:42.747201 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1119/2243] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:44.083373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:45.139580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:46.191307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:47.450692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:48.140809 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:48.395977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:49.185933 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9720a9-1f28-47fd-b3f2-346c4466ab71 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:49.267263 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9720a9-1f28-47fd-b3f2-346c4466ab71 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:49.272123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c8f1f-f131-48de-85bd-aca0555bdc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:49.272756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8f1f-f131-48de-85bd-aca0555bdc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:49.273032 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8f1f-f131-48de-85bd-aca0555bdc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:49.273344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8f1f-f131-48de-85bd-aca0555bdc1a admin admin] PATH_INFO: `/v3/users/1938f6c58e18481ca97dc88268ff43a6` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:49.274732 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c8f1f-f131-48de-85bd-aca0555bdc1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1938f6c58e18481ca97dc88268ff43a6)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:49.279296 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c8f1f-f131-48de-85bd-aca0555bdc1a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:49.475225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:49.489648 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-816c8f1f-f131-48de-85bd-aca0555bdc1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1938f6c58e18481ca97dc88268ff43a6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:49.502198 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-816c8f1f-f131-48de-85bd-aca0555bdc1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1938f6c58e18481ca97dc88268ff43a6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:49.606683 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-816c8f1f-f131-48de-85bd-aca0555bdc1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1938f6c58e18481ca97dc88268ff43a6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:49.614214 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-816c8f1f-f131-48de-85bd-aca0555bdc1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1938f6c58e18481ca97dc88268ff43a6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:49.614832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-816c8f1f-f131-48de-85bd-aca0555bdc1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1938f6c58e18481ca97dc88268ff43a6'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:49.621299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1125/2244] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:49 2022] DELETE /identity/v3/users/1938f6c58e18481ca97dc88268ff43a6 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:49.625762 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0157b9-1a98-4123-9dc4-71bfe91be971 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:49.626119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0157b9-1a98-4123-9dc4-71bfe91be971 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:49.626481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0157b9-1a98-4123-9dc4-71bfe91be971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:49.646224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ea0157b9-1a98-4123-9dc4-71bfe91be971 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:49.647485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ea0157b9-1a98-4123-9dc4-71bfe91be971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:49.706327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1120/2245] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:49.716172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c8f1f-f131-48de-85bd-aca0555bdc1a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:49.717633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-816c8f1f-f131-48de-85bd-aca0555bdc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:49.778680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c8f1f-f131-48de-85bd-aca0555bdc1a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:49.782570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec55b8-8f0b-4c27-a41a-383f17fb23c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:49.783173 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec55b8-8f0b-4c27-a41a-383f17fb23c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:49.783480 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec55b8-8f0b-4c27-a41a-383f17fb23c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:49.785405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec55b8-8f0b-4c27-a41a-383f17fb23c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:49.795752 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec55b8-8f0b-4c27-a41a-383f17fb23c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:49.797226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec55b8-8f0b-4c27-a41a-383f17fb23c8 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:49.807271 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1126/2246] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:49.938249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:50.393329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0157b9-1a98-4123-9dc4-71bfe91be971 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:50.402121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ea0157b9-1a98-4123-9dc4-71bfe91be971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:50.408409 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0157b9-1a98-4123-9dc4-71bfe91be971 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:50.413535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331b22b-a60a-4a50-8225-68a89baa5989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:50.414140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b22b-a60a-4a50-8225-68a89baa5989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:50.414420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b22b-a60a-4a50-8225-68a89baa5989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:50.414690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b22b-a60a-4a50-8225-68a89baa5989 admin admin] PATH_INFO: `/v3/projects/fc70a899a5c548cf97dcd9494a3bd3d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:50.416404 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331b22b-a60a-4a50-8225-68a89baa5989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc70a899a5c548cf97dcd9494a3bd3d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:50.418779 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331b22b-a60a-4a50-8225-68a89baa5989 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:50.548352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9331b22b-a60a-4a50-8225-68a89baa5989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc70a899a5c548cf97dcd9494a3bd3d9', 'request_id': 'req-9331b22b-a60a-4a50-8225-68a89baa5989'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:50.619608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:50.622412 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9331b22b-a60a-4a50-8225-68a89baa5989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc70a899a5c548cf97dcd9494a3bd3d9', 'request_id': 'req-9331b22b-a60a-4a50-8225-68a89baa5989'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:50.631899 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9331b22b-a60a-4a50-8225-68a89baa5989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc70a899a5c548cf97dcd9494a3bd3d9', 'request_id': 'req-9331b22b-a60a-4a50-8225-68a89baa5989'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:50.648097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9331b22b-a60a-4a50-8225-68a89baa5989 admin admin] The token cache is being invalidate because project fc70a899a5c548cf97dcd9494a3bd3d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:50.648668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9331b22b-a60a-4a50-8225-68a89baa5989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:50.652827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9331b22b-a60a-4a50-8225-68a89baa5989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:50.655739 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1121/2247] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:50 2022] DELETE /identity/v3/projects/fc70a899a5c548cf97dcd9494a3bd3d9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:50.657872 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b20b0-b504-4cd8-9839-8a86a8d43f80 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:50.658778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b20b0-b504-4cd8-9839-8a86a8d43f80 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:50.659238 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b20b0-b504-4cd8-9839-8a86a8d43f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:50.683588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a30b20b0-b504-4cd8-9839-8a86a8d43f80 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:50.685150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a30b20b0-b504-4cd8-9839-8a86a8d43f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:50.772171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1127/2248] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:50.773638 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b9f30-dae8-4d3a-b354-60103b6161e6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:50.773995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b9f30-dae8-4d3a-b354-60103b6161e6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:50.774341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b9f30-dae8-4d3a-b354-60103b6161e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:50.795864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8b6b9f30-dae8-4d3a-b354-60103b6161e6 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:50.797188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8b6b9f30-dae8-4d3a-b354-60103b6161e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:50.805744 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1122/2249] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:50.810875 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b20b0-b504-4cd8-9839-8a86a8d43f80 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:50.821940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b20b0-b504-4cd8-9839-8a86a8d43f80 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:50.828617 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4c9b9-762d-461a-af46-98a0e8972c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:50.829067 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4c9b9-762d-461a-af46-98a0e8972c0e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:50.829381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4c9b9-762d-461a-af46-98a0e8972c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:50.829656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4c9b9-762d-461a-af46-98a0e8972c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:50.830317 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4c9b9-762d-461a-af46-98a0e8972c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:50.830621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4c9b9-762d-461a-af46-98a0e8972c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:50.832227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4c9b9-762d-461a-af46-98a0e8972c0e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:50.850589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1128/2250] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:44:50.858498 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b9f30-dae8-4d3a-b354-60103b6161e6 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:50.868179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b9f30-dae8-4d3a-b354-60103b6161e6 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:50.881505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f6804-4cd0-443d-b1e7-93b939dba1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:50.885578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f6804-4cd0-443d-b1e7-93b939dba1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:50.885578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f6804-4cd0-443d-b1e7-93b939dba1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:50.885578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f6804-4cd0-443d-b1e7-93b939dba1c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:50.885578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f6804-4cd0-443d-b1e7-93b939dba1c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:50.890120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f6804-4cd0-443d-b1e7-93b939dba1c5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:50.985075 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:50.992985 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1123/2251] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:50 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:50.997803 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4c9b9-762d-461a-af46-98a0e8972c0e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:51.011382 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4c9b9-762d-461a-af46-98a0e8972c0e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:51.096186 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2cba0-929f-4e7c-a8f6-2b91ff85f8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:51.096932 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2cba0-929f-4e7c-a8f6-2b91ff85f8ef admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:51.097311 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2cba0-929f-4e7c-a8f6-2b91ff85f8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:51.099338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2cba0-929f-4e7c-a8f6-2b91ff85f8ef admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:51.099997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2cba0-929f-4e7c-a8f6-2b91ff85f8ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:51.102319 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2cba0-929f-4e7c-a8f6-2b91ff85f8ef admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:51.168990 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:51.185582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1129/2252] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:50 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:51.190231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f6804-4cd0-443d-b1e7-93b939dba1c5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:51.203497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f6804-4cd0-443d-b1e7-93b939dba1c5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:51.208215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe7a7-bedc-47b6-b95c-826d104fd4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:51.208891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe7a7-bedc-47b6-b95c-826d104fd4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:51.209175 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe7a7-bedc-47b6-b95c-826d104fd4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:51.209547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe7a7-bedc-47b6-b95c-826d104fd4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:51.210201 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffe7a7-bedc-47b6-b95c-826d104fd4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:51.212455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffe7a7-bedc-47b6-b95c-826d104fd4a2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:51.224964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2cba0-929f-4e7c-a8f6-2b91ff85f8ef admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:51.226978 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ebc2cba0-929f-4e7c-a8f6-2b91ff85f8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:51.230634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1124/2253] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:51.237987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe7a7-bedc-47b6-b95c-826d104fd4a2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:51.248182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2cba0-929f-4e7c-a8f6-2b91ff85f8ef admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:51.253395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748d350-9d17-4d21-866b-b4eff86fd28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:51.254126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748d350-9d17-4d21-866b-b4eff86fd28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:51.260417 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748d350-9d17-4d21-866b-b4eff86fd28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:51.261489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe7a7-bedc-47b6-b95c-826d104fd4a2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:51.261655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748d350-9d17-4d21-866b-b4eff86fd28a admin admin] PATH_INFO: `/v3/users/af22e7e3dbf04e669ccb3f6090bb794d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:51.261655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748d350-9d17-4d21-866b-b4eff86fd28a admin admin] RBAC: Authorizing `identity:delete_user(user_id=af22e7e3dbf04e669ccb3f6090bb794d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:51.261655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748d350-9d17-4d21-866b-b4eff86fd28a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:51.261881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d4c83-b8d0-4573-a22a-0c3d2251641c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:51.261881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d4c83-b8d0-4573-a22a-0c3d2251641c admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:51.261881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d4c83-b8d0-4573-a22a-0c3d2251641c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:51.261881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d4c83-b8d0-4573-a22a-0c3d2251641c admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:51.262187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d4c83-b8d0-4573-a22a-0c3d2251641c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:51.263251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d4c83-b8d0-4573-a22a-0c3d2251641c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:51.279430 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1125/2254] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:51.281246 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d4c83-b8d0-4573-a22a-0c3d2251641c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:51.297465 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d4c83-b8d0-4573-a22a-0c3d2251641c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:51.304938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df4ef0-d111-46a4-ae39-ec58874b85cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:51.305785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4ef0-d111-46a4-ae39-ec58874b85cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:51.305918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4ef0-d111-46a4-ae39-ec58874b85cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:51.306274 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4ef0-d111-46a4-ae39-ec58874b85cd admin admin] PATH_INFO: `/v3/projects/750170522acd4ca0a91846750b5adcd7/users/ce6702a140d441e2b15de715372ddb33/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:51.325989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df4ef0-d111-46a4-ae39-ec58874b85cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=750170522acd4ca0a91846750b5adcd7, user_id=ce6702a140d441e2b15de715372ddb33, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:51.328703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df4ef0-d111-46a4-ae39-ec58874b85cd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:51.424854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1126/2255] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:51 2022] PUT /identity/v3/projects/750170522acd4ca0a91846750b5adcd7/users/ce6702a140d441e2b15de715372ddb33/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:51.435699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91759e58-e919-40d3-8d15-e726109768d0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:51.436011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91759e58-e919-40d3-8d15-e726109768d0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:51.436536 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91759e58-e919-40d3-8d15-e726109768d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:51.482870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a748d350-9d17-4d21-866b-b4eff86fd28a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af22e7e3dbf04e669ccb3f6090bb794d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:51.487753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-91759e58-e919-40d3-8d15-e726109768d0 None None] MFA Rules not processed for user `ce6702a140d441e2b15de715372ddb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:51.489308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-91759e58-e919-40d3-8d15-e726109768d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:51.499979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a748d350-9d17-4d21-866b-b4eff86fd28a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af22e7e3dbf04e669ccb3f6090bb794d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:51.543800 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a748d350-9d17-4d21-866b-b4eff86fd28a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af22e7e3dbf04e669ccb3f6090bb794d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:51.551840 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a748d350-9d17-4d21-866b-b4eff86fd28a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af22e7e3dbf04e669ccb3f6090bb794d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:51.552775 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a748d350-9d17-4d21-866b-b4eff86fd28a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af22e7e3dbf04e669ccb3f6090bb794d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:51.565549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1130/2256] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:51 2022] DELETE /identity/v3/users/af22e7e3dbf04e669ccb3f6090bb794d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:51.567724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d417faf-131f-4a43-8573-c38c3050c83a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:51.568059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d417faf-131f-4a43-8573-c38c3050c83a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:51.568507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d417faf-131f-4a43-8573-c38c3050c83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:51.573386 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1127/2257] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:51.575333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91759e58-e919-40d3-8d15-e726109768d0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:51.590134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3d417faf-131f-4a43-8573-c38c3050c83a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:51.591783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3d417faf-131f-4a43-8573-c38c3050c83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:51.683690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91759e58-e919-40d3-8d15-e726109768d0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:51.701922 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1131/2258] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:51.707270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:51.715146 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d417faf-131f-4a43-8573-c38c3050c83a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:51.716929 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3d417faf-131f-4a43-8573-c38c3050c83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:51.759816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac7720-31dc-4f4d-b741-6454ca5ce7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:51.760660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac7720-31dc-4f4d-b741-6454ca5ce7be admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:51.760851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac7720-31dc-4f4d-b741-6454ca5ce7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:51.761159 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac7720-31dc-4f4d-b741-6454ca5ce7be admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:51.761876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac7720-31dc-4f4d-b741-6454ca5ce7be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:51.763928 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac7720-31dc-4f4d-b741-6454ca5ce7be admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:51.785080 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d417faf-131f-4a43-8573-c38c3050c83a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:51.793832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f04d5-68b3-4246-89b4-ebb68d3c4f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:51.794321 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f04d5-68b3-4246-89b4-ebb68d3c4f1d service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:51.794607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f04d5-68b3-4246-89b4-ebb68d3c4f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:51.794890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f04d5-68b3-4246-89b4-ebb68d3c4f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:51.804991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f04d5-68b3-4246-89b4-ebb68d3c4f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:51.806533 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f04d5-68b3-4246-89b4-ebb68d3c4f1d service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:51.825272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1132/2259] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:51.888696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1128/2260] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:51 2022] POST /identity/v3/projects => generated 377 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:51.899164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f04d5-68b3-4246-89b4-ebb68d3c4f1d service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:51.903280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9d5f04d5-68b3-4246-89b4-ebb68d3c4f1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:51.933753 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f04d5-68b3-4246-89b4-ebb68d3c4f1d service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:52.044770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212137c8-e935-4f8b-9977-31369b5ac84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:52.045837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212137c8-e935-4f8b-9977-31369b5ac84c admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:52.046127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212137c8-e935-4f8b-9977-31369b5ac84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:52.046451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212137c8-e935-4f8b-9977-31369b5ac84c admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:52.047104 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212137c8-e935-4f8b-9977-31369b5ac84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:52.054345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212137c8-e935-4f8b-9977-31369b5ac84c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:52.195634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1133/2261] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:51 2022] POST /identity/v3/users => generated 289 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:52.201055 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac7720-31dc-4f4d-b741-6454ca5ce7be admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:52.225969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac7720-31dc-4f4d-b741-6454ca5ce7be admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:52.235513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975577a-448c-4f15-b6cd-acb2301609cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:52.236418 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975577a-448c-4f15-b6cd-acb2301609cd admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:52.236932 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975577a-448c-4f15-b6cd-acb2301609cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:52.237523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975577a-448c-4f15-b6cd-acb2301609cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:52.246546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975577a-448c-4f15-b6cd-acb2301609cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:52.246546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975577a-448c-4f15-b6cd-acb2301609cd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:52.255429 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1129/2262] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:52.259102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212137c8-e935-4f8b-9977-31369b5ac84c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:52.274004 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212137c8-e935-4f8b-9977-31369b5ac84c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:52.304005 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339c50b-94b0-4e32-bd2b-55faa6f42b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:52.308826 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339c50b-94b0-4e32-bd2b-55faa6f42b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:52.309307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339c50b-94b0-4e32-bd2b-55faa6f42b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:52.309591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339c50b-94b0-4e32-bd2b-55faa6f42b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:52.310266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339c50b-94b0-4e32-bd2b-55faa6f42b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:52.319677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339c50b-94b0-4e32-bd2b-55faa6f42b00 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:52.349501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1134/2263] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:52.354036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975577a-448c-4f15-b6cd-acb2301609cd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:52.383248 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975577a-448c-4f15-b6cd-acb2301609cd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:52.402841 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b6432-89f7-485d-87e1-99277183e058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:52.403545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b6432-89f7-485d-87e1-99277183e058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:52.403828 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b6432-89f7-485d-87e1-99277183e058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:52.404110 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b6432-89f7-485d-87e1-99277183e058 admin admin] PATH_INFO: `/v3/projects/ed26b54423e84e01b90c8072657f315e/users/649319f5eb71470783292deb6c9c3acd/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:52.412860 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:52.452062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b6432-89f7-485d-87e1-99277183e058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed26b54423e84e01b90c8072657f315e, user_id=649319f5eb71470783292deb6c9c3acd, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:52.456179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b6432-89f7-485d-87e1-99277183e058 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:52.534433 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:52.555530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1130/2264] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:52 2022] PUT /identity/v3/projects/ed26b54423e84e01b90c8072657f315e/users/649319f5eb71470783292deb6c9c3acd/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:52.567889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85014125-8a65-4c5d-8250-856694700444 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:52.568184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85014125-8a65-4c5d-8250-856694700444 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:52.568493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85014125-8a65-4c5d-8250-856694700444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:52.618006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-85014125-8a65-4c5d-8250-856694700444 None None] MFA Rules not processed for user `649319f5eb71470783292deb6c9c3acd`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:52.619263 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-85014125-8a65-4c5d-8250-856694700444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:52.770254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1135/2265] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:52.774580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b6432-89f7-485d-87e1-99277183e058 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:52.858251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85014125-8a65-4c5d-8250-856694700444 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:52.859732 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-85014125-8a65-4c5d-8250-856694700444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:52.941412 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b6432-89f7-485d-87e1-99277183e058 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:52.955214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27c9ca-8e1f-4c96-99f7-62ac39618ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:52.955900 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27c9ca-8e1f-4c96-99f7-62ac39618ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:52.956189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27c9ca-8e1f-4c96-99f7-62ac39618ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:52.956463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27c9ca-8e1f-4c96-99f7-62ac39618ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:52.957117 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27c9ca-8e1f-4c96-99f7-62ac39618ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:52.975073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27c9ca-8e1f-4c96-99f7-62ac39618ca2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:52.980304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85014125-8a65-4c5d-8250-856694700444 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:53.010136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843ae55-13d1-42c0-a0bf-ed891446acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:53.011373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ae55-13d1-42c0-a0bf-ed891446acba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:53.011810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ae55-13d1-42c0-a0bf-ed891446acba admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:53.012251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ae55-13d1-42c0-a0bf-ed891446acba admin admin] PATH_INFO: `/v3/projects/6a3be2092e7c40fe8aace4438b9dbe55` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:53.014751 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843ae55-13d1-42c0-a0bf-ed891446acba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a3be2092e7c40fe8aace4438b9dbe55)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:53.017641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843ae55-13d1-42c0-a0bf-ed891446acba admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:53.150890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1131/2266] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:52 2022] POST /identity/v3/projects => generated 377 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:53.156287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27c9ca-8e1f-4c96-99f7-62ac39618ca2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:53.223809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0843ae55-13d1-42c0-a0bf-ed891446acba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a3be2092e7c40fe8aace4438b9dbe55', 'request_id': 'req-0843ae55-13d1-42c0-a0bf-ed891446acba'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:53.298952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27c9ca-8e1f-4c96-99f7-62ac39618ca2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:53.363268 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0843ae55-13d1-42c0-a0bf-ed891446acba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a3be2092e7c40fe8aace4438b9dbe55', 'request_id': 'req-0843ae55-13d1-42c0-a0bf-ed891446acba'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:53.372257 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0843ae55-13d1-42c0-a0bf-ed891446acba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a3be2092e7c40fe8aace4438b9dbe55', 'request_id': 'req-0843ae55-13d1-42c0-a0bf-ed891446acba'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:53.380613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e44ee4-c1e7-4e2d-85f1-f35f067a2e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:53.381441 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e44ee4-c1e7-4e2d-85f1-f35f067a2e72 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:53.381873 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e44ee4-c1e7-4e2d-85f1-f35f067a2e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:53.382247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e44ee4-c1e7-4e2d-85f1-f35f067a2e72 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:53.383071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e44ee4-c1e7-4e2d-85f1-f35f067a2e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:53.385561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e44ee4-c1e7-4e2d-85f1-f35f067a2e72 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:53.398336 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0843ae55-13d1-42c0-a0bf-ed891446acba admin admin] The token cache is being invalidate because project 6a3be2092e7c40fe8aace4438b9dbe55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:53.398753 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0843ae55-13d1-42c0-a0bf-ed891446acba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:53.400713 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-0843ae55-13d1-42c0-a0bf-ed891446acba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:53.409362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1136/2267] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:52 2022] DELETE /identity/v3/projects/6a3be2092e7c40fe8aace4438b9dbe55 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:53.411552 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64153f-b93c-4351-8637-21350b9eebff None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:53.411743 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64153f-b93c-4351-8637-21350b9eebff None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:53.412022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64153f-b93c-4351-8637-21350b9eebff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:53.446068 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ad64153f-b93c-4351-8637-21350b9eebff None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:53.447521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ad64153f-b93c-4351-8637-21350b9eebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:53.462392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1137/2268] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:53.471655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac621-dca1-430a-9fb6-4bf1832a35d4 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:53.472051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac621-dca1-430a-9fb6-4bf1832a35d4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:53.472539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac621-dca1-430a-9fb6-4bf1832a35d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:53.498817 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1132/2269] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:53 2022] POST /identity/v3/users => generated 295 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:53.503137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e44ee4-c1e7-4e2d-85f1-f35f067a2e72 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:53.505488 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-99fac621-dca1-430a-9fb6-4bf1832a35d4 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:53.507881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-99fac621-dca1-430a-9fb6-4bf1832a35d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:53.508696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-50e44ee4-c1e7-4e2d-85f1-f35f067a2e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:53.519533 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1138/2270] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:53.531125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fac621-dca1-430a-9fb6-4bf1832a35d4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:53.531704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e44ee4-c1e7-4e2d-85f1-f35f067a2e72 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:53.537938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493688c-ac4d-4cb0-8420-875669d413b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:53.538221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493688c-ac4d-4cb0-8420-875669d413b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:53.538498 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493688c-ac4d-4cb0-8420-875669d413b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:53.538768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493688c-ac4d-4cb0-8420-875669d413b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:53.539415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493688c-ac4d-4cb0-8420-875669d413b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:53.541308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493688c-ac4d-4cb0-8420-875669d413b2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:53.565117 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1133/2271] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:53.566075 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493688c-ac4d-4cb0-8420-875669d413b2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:53.584253 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fac621-dca1-430a-9fb6-4bf1832a35d4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:53.584615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493688c-ac4d-4cb0-8420-875669d413b2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:53.590571 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af5b1e-5166-493a-bcb3-b45a40ebc61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:53.591244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af5b1e-5166-493a-bcb3-b45a40ebc61b admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:53.591522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af5b1e-5166-493a-bcb3-b45a40ebc61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:53.591956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af5b1e-5166-493a-bcb3-b45a40ebc61b admin admin] PATH_INFO: `/v3/projects/5c7fbf39f9604c5e81f1743aecc44b48/users/6f03d4b299a94a01b00136a0dc38581f/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:53.596956 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed6b76-0204-4d41-862f-af6f8f21ba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:53.610374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed6b76-0204-4d41-862f-af6f8f21ba09 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:53.610374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed6b76-0204-4d41-862f-af6f8f21ba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:53.610374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed6b76-0204-4d41-862f-af6f8f21ba09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:53.610374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed6b76-0204-4d41-862f-af6f8f21ba09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:53.610374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed6b76-0204-4d41-862f-af6f8f21ba09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:53.610374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed6b76-0204-4d41-862f-af6f8f21ba09 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:53.623695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af5b1e-5166-493a-bcb3-b45a40ebc61b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7fbf39f9604c5e81f1743aecc44b48, user_id=6f03d4b299a94a01b00136a0dc38581f, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:53.626747 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af5b1e-5166-493a-bcb3-b45a40ebc61b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:53.641551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1139/2272] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:44:53.647066 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed6b76-0204-4d41-862f-af6f8f21ba09 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:53.662107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed6b76-0204-4d41-862f-af6f8f21ba09 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:53.687370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ba3cc-881b-470d-9ac4-be709092e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:53.687370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ba3cc-881b-470d-9ac4-be709092e43e admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:53.687370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ba3cc-881b-470d-9ac4-be709092e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:53.687370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ba3cc-881b-470d-9ac4-be709092e43e admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:53.687813 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ba3cc-881b-470d-9ac4-be709092e43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:53.690991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ba3cc-881b-470d-9ac4-be709092e43e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:53.705869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1134/2273] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:53 2022] PUT /identity/v3/projects/5c7fbf39f9604c5e81f1743aecc44b48/users/6f03d4b299a94a01b00136a0dc38581f/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:53.710431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af5b1e-5166-493a-bcb3-b45a40ebc61b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:53.805412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1140/2274] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:53 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:53.809262 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ba3cc-881b-470d-9ac4-be709092e43e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:53.840812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af5b1e-5166-493a-bcb3-b45a40ebc61b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:53.924967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea49c1-d495-43a1-b094-19e3529f999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:53.925909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea49c1-d495-43a1-b094-19e3529f999f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:53.926367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea49c1-d495-43a1-b094-19e3529f999f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:53.926828 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea49c1-d495-43a1-b094-19e3529f999f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:53.927662 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea49c1-d495-43a1-b094-19e3529f999f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:53.929884 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea49c1-d495-43a1-b094-19e3529f999f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:53.958483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1135/2275] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:53.959386 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea49c1-d495-43a1-b094-19e3529f999f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:53.963627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bfea49c1-d495-43a1-b094-19e3529f999f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:53.967686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ba3cc-881b-470d-9ac4-be709092e43e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:53.998743 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5aee4-b607-4584-8688-2d4b8f7ced30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:53.999681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5aee4-b607-4584-8688-2d4b8f7ced30 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:54.000119 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5aee4-b607-4584-8688-2d4b8f7ced30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:54.000391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5aee4-b607-4584-8688-2d4b8f7ced30 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:54.001237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5aee4-b607-4584-8688-2d4b8f7ced30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:54.004781 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5aee4-b607-4584-8688-2d4b8f7ced30 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:54.016870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea49c1-d495-43a1-b094-19e3529f999f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:54.024480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77b07f-7238-45c3-aafd-14da6650d558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:54.025464 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77b07f-7238-45c3-aafd-14da6650d558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:54.030791 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77b07f-7238-45c3-aafd-14da6650d558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:54.031738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77b07f-7238-45c3-aafd-14da6650d558 admin admin] PATH_INFO: `/v3/users/6f6d5713d7a740a9b6ea91238cb182aa` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:54.032621 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77b07f-7238-45c3-aafd-14da6650d558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f6d5713d7a740a9b6ea91238cb182aa)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:54.035052 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77b07f-7238-45c3-aafd-14da6650d558 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:54.105554 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1141/2276] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:53 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:54.105554 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5aee4-b607-4584-8688-2d4b8f7ced30 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:54.121543 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:54.122119 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5aee4-b607-4584-8688-2d4b8f7ced30 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:54.127589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74457c-b688-46a3-8f6e-06241c84ca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:54.128455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74457c-b688-46a3-8f6e-06241c84ca4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:54.128897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74457c-b688-46a3-8f6e-06241c84ca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:54.129482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74457c-b688-46a3-8f6e-06241c84ca4e admin admin] PATH_INFO: `/v3/projects/5c7fbf39f9604c5e81f1743aecc44b48/users/6f03d4b299a94a01b00136a0dc38581f/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:54.149127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74457c-b688-46a3-8f6e-06241c84ca4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7fbf39f9604c5e81f1743aecc44b48, user_id=6f03d4b299a94a01b00136a0dc38581f, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:54.156372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74457c-b688-46a3-8f6e-06241c84ca4e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:54.167839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:54.244549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1142/2277] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:54 2022] PUT /identity/v3/projects/5c7fbf39f9604c5e81f1743aecc44b48/users/6f03d4b299a94a01b00136a0dc38581f/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:54.246967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85af212-96d2-4ead-a753-a536dd5b2b34 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:54.247325 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85af212-96d2-4ead-a753-a536dd5b2b34 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:54.247662 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85af212-96d2-4ead-a753-a536dd5b2b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:54.270332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c85af212-96d2-4ead-a753-a536dd5b2b34 None None] MFA Rules not processed for user `1224284a60e64f07ba98d80901091550`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:54.271545 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c85af212-96d2-4ead-a753-a536dd5b2b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:54.331571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1143/2278] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:54.332309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85af212-96d2-4ead-a753-a536dd5b2b34 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:54.353455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c77b07f-7238-45c3-aafd-14da6650d558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f6d5713d7a740a9b6ea91238cb182aa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:54.355311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c77b07f-7238-45c3-aafd-14da6650d558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f6d5713d7a740a9b6ea91238cb182aa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:54.374502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c77b07f-7238-45c3-aafd-14da6650d558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f6d5713d7a740a9b6ea91238cb182aa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:54.389862 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c77b07f-7238-45c3-aafd-14da6650d558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f6d5713d7a740a9b6ea91238cb182aa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:54.390773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c77b07f-7238-45c3-aafd-14da6650d558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f6d5713d7a740a9b6ea91238cb182aa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:54.424026 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85af212-96d2-4ead-a753-a536dd5b2b34 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:54.429530 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5e1ee-0db5-4536-9b12-f6c71d4a325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:54.430118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5e1ee-0db5-4536-9b12-f6c71d4a325d admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:54.430399 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5e1ee-0db5-4536-9b12-f6c71d4a325d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:54.430672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5e1ee-0db5-4536-9b12-f6c71d4a325d admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:54.431359 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5e1ee-0db5-4536-9b12-f6c71d4a325d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:54.433872 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5e1ee-0db5-4536-9b12-f6c71d4a325d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:54.446820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1144/2279] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:54.448436 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc4013-672a-44ba-b1a8-f73a9f295ecb None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:54.448759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc4013-672a-44ba-b1a8-f73a9f295ecb None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:54.449018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc4013-672a-44ba-b1a8-f73a9f295ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:54.475253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1136/2280] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:44:53 2022] DELETE /identity/v3/users/6f6d5713d7a740a9b6ea91238cb182aa => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:54.475932 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77b07f-7238-45c3-aafd-14da6650d558 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:54.477355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2c77b07f-7238-45c3-aafd-14da6650d558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:54.500901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-28cc4013-672a-44ba-b1a8-f73a9f295ecb None None] MFA Rules not processed for user `6f03d4b299a94a01b00136a0dc38581f`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:54.502226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-28cc4013-672a-44ba-b1a8-f73a9f295ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:54.553366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77b07f-7238-45c3-aafd-14da6650d558 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:54.562997 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa666e1-15e5-4b35-99b0-8b3139db2bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:54.563686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa666e1-15e5-4b35-99b0-8b3139db2bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:54.563972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa666e1-15e5-4b35-99b0-8b3139db2bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:54.564245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa666e1-15e5-4b35-99b0-8b3139db2bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:54.564908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa666e1-15e5-4b35-99b0-8b3139db2bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:54.566651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa666e1-15e5-4b35-99b0-8b3139db2bb2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:54.578585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1137/2281] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:54.583920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4566e-9274-48ba-9831-ff89cce3ddcc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:54.583920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4566e-9274-48ba-9831-ff89cce3ddcc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:54.583920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4566e-9274-48ba-9831-ff89cce3ddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:54.593306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1145/2282] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:54.594341 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc4013-672a-44ba-b1a8-f73a9f295ecb None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:54.605525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc4013-672a-44ba-b1a8-f73a9f295ecb None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:54.611199 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1ae2-fd34-45ee-9b9b-8cb6efe7e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:54.611870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1ae2-fd34-45ee-9b9b-8cb6efe7e011 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:54.612246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1ae2-fd34-45ee-9b9b-8cb6efe7e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:54.618346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1ae2-fd34-45ee-9b9b-8cb6efe7e011 admin admin] PATH_INFO: `/v3/projects/9cf38e9d73af4f70bfe490aef94a2726/users/df5f017ead1147a9bfa33d2f7b8c0dc1/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:54.625859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-65e4566e-9274-48ba-9831-ff89cce3ddcc None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:54.627494 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-65e4566e-9274-48ba-9831-ff89cce3ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:54.633479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef1ae2-fd34-45ee-9b9b-8cb6efe7e011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf38e9d73af4f70bfe490aef94a2726, user_id=df5f017ead1147a9bfa33d2f7b8c0dc1, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:54.637210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef1ae2-fd34-45ee-9b9b-8cb6efe7e011 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:54.645354 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1138/2283] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:54.645354 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4566e-9274-48ba-9831-ff89cce3ddcc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:54.645354 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-65e4566e-9274-48ba-9831-ff89cce3ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:54.720499 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4566e-9274-48ba-9831-ff89cce3ddcc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:54.727828 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134b8d0-35ca-4464-91b2-5ac839008eb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:54.728698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134b8d0-35ca-4464-91b2-5ac839008eb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:54.729235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134b8d0-35ca-4464-91b2-5ac839008eb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:54.729718 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134b8d0-35ca-4464-91b2-5ac839008eb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:54.731893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1134b8d0-35ca-4464-91b2-5ac839008eb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:54.736200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1146/2284] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:54 2022] PUT /identity/v3/projects/9cf38e9d73af4f70bfe490aef94a2726/users/df5f017ead1147a9bfa33d2f7b8c0dc1/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:54.737452 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1ae2-fd34-45ee-9b9b-8cb6efe7e011 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:54.739199 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-78ef1ae2-fd34-45ee-9b9b-8cb6efe7e011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:54.830157 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1ae2-fd34-45ee-9b9b-8cb6efe7e011 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:54.840739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275955f-89b0-48e5-9e35-2bdad7e3be3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:54.841595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275955f-89b0-48e5-9e35-2bdad7e3be3a service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:54.841891 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275955f-89b0-48e5-9e35-2bdad7e3be3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:54.842299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275955f-89b0-48e5-9e35-2bdad7e3be3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:54.845794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134b8d0-35ca-4464-91b2-5ac839008eb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:54.847856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134b8d0-35ca-4464-91b2-5ac839008eb8 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:54.865185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1139/2285] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:54.866937 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7527bc5-eaf1-4e86-8d96-39ef28c153d7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:54.867465 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7527bc5-eaf1-4e86-8d96-39ef28c153d7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:54.867945 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7527bc5-eaf1-4e86-8d96-39ef28c153d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:54.915014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f7527bc5-eaf1-4e86-8d96-39ef28c153d7 None None] MFA Rules not processed for user `df5f017ead1147a9bfa33d2f7b8c0dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:54.916592 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f7527bc5-eaf1-4e86-8d96-39ef28c153d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:54.961393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275955f-89b0-48e5-9e35-2bdad7e3be3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:54.963170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275955f-89b0-48e5-9e35-2bdad7e3be3a service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:54.984813 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1147/2286] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:55.013359 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1140/2287] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:55.015016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275955f-89b0-48e5-9e35-2bdad7e3be3a service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:55.031818 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275955f-89b0-48e5-9e35-2bdad7e3be3a service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:55.040407 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72408960-5af7-4de2-bde5-0c7d7cf6db9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:55.041325 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72408960-5af7-4de2-bde5-0c7d7cf6db9b admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:55.041613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72408960-5af7-4de2-bde5-0c7d7cf6db9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:55.042418 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72408960-5af7-4de2-bde5-0c7d7cf6db9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:55.043298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72408960-5af7-4de2-bde5-0c7d7cf6db9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:55.045054 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72408960-5af7-4de2-bde5-0c7d7cf6db9b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:55.272985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1148/2288] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:55 2022] POST /identity/v3/projects => generated 385 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:55.277533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7527bc5-eaf1-4e86-8d96-39ef28c153d7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:55.313257 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7527bc5-eaf1-4e86-8d96-39ef28c153d7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:55.409192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74671528-2dd8-451a-b1c2-9a1ebdf9c78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:55.411191 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74671528-2dd8-451a-b1c2-9a1ebdf9c78a admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:55.411480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74671528-2dd8-451a-b1c2-9a1ebdf9c78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:55.411757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74671528-2dd8-451a-b1c2-9a1ebdf9c78a admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:55.412412 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74671528-2dd8-451a-b1c2-9a1ebdf9c78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:55.416624 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74671528-2dd8-451a-b1c2-9a1ebdf9c78a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:55.514289 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1141/2289] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:55 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:55.515721 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72408960-5af7-4de2-bde5-0c7d7cf6db9b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:55.526896 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72408960-5af7-4de2-bde5-0c7d7cf6db9b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:55.531730 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043672f7-6cff-401c-a237-3357f4394d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:55.532333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043672f7-6cff-401c-a237-3357f4394d13 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:55.532633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043672f7-6cff-401c-a237-3357f4394d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:55.532915 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043672f7-6cff-401c-a237-3357f4394d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:55.533592 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043672f7-6cff-401c-a237-3357f4394d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:55.535189 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043672f7-6cff-401c-a237-3357f4394d13 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:55.547482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1149/2290] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:55.551534 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74671528-2dd8-451a-b1c2-9a1ebdf9c78a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:55.565764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74671528-2dd8-451a-b1c2-9a1ebdf9c78a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:55.571584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef105c-dceb-4328-a9e8-0c5c95446ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:55.572195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef105c-dceb-4328-a9e8-0c5c95446ded admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:55.572474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef105c-dceb-4328-a9e8-0c5c95446ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:55.572749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef105c-dceb-4328-a9e8-0c5c95446ded admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:55.574087 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef105c-dceb-4328-a9e8-0c5c95446ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:55.575691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef105c-dceb-4328-a9e8-0c5c95446ded admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:55.586306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1142/2291] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:55.590519 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043672f7-6cff-401c-a237-3357f4394d13 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:55.601629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043672f7-6cff-401c-a237-3357f4394d13 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:55.607219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beb338-0de9-4188-ac13-31e4170b4aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:55.608636 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb338-0de9-4188-ac13-31e4170b4aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:55.609041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb338-0de9-4188-ac13-31e4170b4aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:55.609352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb338-0de9-4188-ac13-31e4170b4aa7 admin admin] PATH_INFO: `/v3/projects/8b370153f34a4619af92b63c2a01e063/users/8c2594c01ef2411382c22e89e8fe4dc7/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:55.624211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef105c-dceb-4328-a9e8-0c5c95446ded admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:55.625817 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dcef105c-dceb-4328-a9e8-0c5c95446ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:55.626870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beb338-0de9-4188-ac13-31e4170b4aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b370153f34a4619af92b63c2a01e063, user_id=8c2594c01ef2411382c22e89e8fe4dc7, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:55.629833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beb338-0de9-4188-ac13-31e4170b4aa7 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:55.641891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef105c-dceb-4328-a9e8-0c5c95446ded admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:55.646066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:55.646781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:55.647117 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:55.647397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1 admin admin] PATH_INFO: `/v3/projects/c77495abf139449b9d259723b0795040` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:55.648608 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77495abf139449b9d259723b0795040)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:55.650497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:55.696484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1150/2292] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:55 2022] PUT /identity/v3/projects/8b370153f34a4619af92b63c2a01e063/users/8c2594c01ef2411382c22e89e8fe4dc7/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:44:55.708168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a78674-53b4-4ffd-ace2-8c6794b8e417 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:55.716080 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a78674-53b4-4ffd-ace2-8c6794b8e417 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:55.716080 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a78674-53b4-4ffd-ace2-8c6794b8e417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:55.741814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e4a78674-53b4-4ffd-ace2-8c6794b8e417 None None] MFA Rules not processed for user `8c2594c01ef2411382c22e89e8fe4dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:55.743070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e4a78674-53b4-4ffd-ace2-8c6794b8e417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:55.823658 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1151/2293] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:55.827641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a78674-53b4-4ffd-ace2-8c6794b8e417 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:55.842098 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:55.843042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77495abf139449b9d259723b0795040', 'request_id': 'req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:55.907998 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a78674-53b4-4ffd-ace2-8c6794b8e417 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:55.949290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77495abf139449b9d259723b0795040', 'request_id': 'req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:55.956376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77495abf139449b9d259723b0795040', 'request_id': 'req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:55.969704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1 admin admin] The token cache is being invalidate because project c77495abf139449b9d259723b0795040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:44:55.969994 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:55.970728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3505f0cd-381f-4958-b85e-ec43c3e3c9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:44:55.972375 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1143/2294] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:44:55 2022] DELETE /identity/v3/projects/c77495abf139449b9d259723b0795040 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:55.973134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6859b-e990-4260-a775-da108cac3d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:55.973967 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6859b-e990-4260-a775-da108cac3d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:55.974255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6859b-e990-4260-a775-da108cac3d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:55.974529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6859b-e990-4260-a775-da108cac3d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:55.975172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6859b-e990-4260-a775-da108cac3d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:55.977305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6859b-e990-4260-a775-da108cac3d99 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:55.978728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ef681-0689-48e6-838b-1a8a78d90182 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:55.979065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ef681-0689-48e6-838b-1a8a78d90182 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:55.979935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ef681-0689-48e6-838b-1a8a78d90182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.012339 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:56.013583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-644ef681-0689-48e6-838b-1a8a78d90182 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:56.014814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-644ef681-0689-48e6-838b-1a8a78d90182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:56.028285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1144/2295] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:44:56.037588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a2db2-b4c1-492e-a2eb-5143be4ffce5 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.037874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a2db2-b4c1-492e-a2eb-5143be4ffce5 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.038116 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a2db2-b4c1-492e-a2eb-5143be4ffce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.063496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a84a2db2-b4c1-492e-a2eb-5143be4ffce5 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:56.067212 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a84a2db2-b4c1-492e-a2eb-5143be4ffce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:56.079135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1145/2296] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:56.080392 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a2db2-b4c1-492e-a2eb-5143be4ffce5 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:56.086995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1152/2297] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:55 2022] POST /identity/v3/projects => generated 385 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:44:56.096072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6859b-e990-4260-a775-da108cac3d99 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:56.099962 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e3f6859b-e990-4260-a775-da108cac3d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:56.103634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a2db2-b4c1-492e-a2eb-5143be4ffce5 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:56.175703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19859e70-9692-4410-87a6-87230cf53ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:56.176588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19859e70-9692-4410-87a6-87230cf53ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.176877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19859e70-9692-4410-87a6-87230cf53ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.177151 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19859e70-9692-4410-87a6-87230cf53ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.177840 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19859e70-9692-4410-87a6-87230cf53ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:44:56.178146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19859e70-9692-4410-87a6-87230cf53ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:56.179751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19859e70-9692-4410-87a6-87230cf53ee1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:56.191869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1146/2298] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:44:56.196706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19859e70-9692-4410-87a6-87230cf53ee1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:56.201313 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6859b-e990-4260-a775-da108cac3d99 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:56.207444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19859e70-9692-4410-87a6-87230cf53ee1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:56.208283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d735087-63c4-415b-a399-00a8f499ea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:56.209403 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d735087-63c4-415b-a399-00a8f499ea65 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.209940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d735087-63c4-415b-a399-00a8f499ea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.210629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d735087-63c4-415b-a399-00a8f499ea65 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.211681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d735087-63c4-415b-a399-00a8f499ea65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:56.215244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd8a64-0f5c-4258-a88f-9f646421ebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:56.216105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d735087-63c4-415b-a399-00a8f499ea65 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:56.216456 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd8a64-0f5c-4258-a88f-9f646421ebd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.217029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd8a64-0f5c-4258-a88f-9f646421ebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.221844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd8a64-0f5c-4258-a88f-9f646421ebd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.221844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd8a64-0f5c-4258-a88f-9f646421ebd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:56.221844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd8a64-0f5c-4258-a88f-9f646421ebd4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:56.340789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1153/2299] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:56 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:56.351093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d735087-63c4-415b-a399-00a8f499ea65 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:56.357500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1147/2300] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:44:56 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:56.359696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd8a64-0f5c-4258-a88f-9f646421ebd4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:56.367265 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d735087-63c4-415b-a399-00a8f499ea65 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:56.427105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:56.428634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e502177-b65f-4924-9421-c57d11a8c7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:56.429271 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e502177-b65f-4924-9421-c57d11a8c7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.429552 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e502177-b65f-4924-9421-c57d11a8c7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.429827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e502177-b65f-4924-9421-c57d11a8c7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.431986 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e502177-b65f-4924-9421-c57d11a8c7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:56.432101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd8a64-0f5c-4258-a88f-9f646421ebd4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:56.432196 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e502177-b65f-4924-9421-c57d11a8c7b6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:56.436706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed211a69-6a0f-4273-afcd-6489af8160ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:56.437368 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed211a69-6a0f-4273-afcd-6489af8160ae admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.437619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed211a69-6a0f-4273-afcd-6489af8160ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.437892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed211a69-6a0f-4273-afcd-6489af8160ae admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.438523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed211a69-6a0f-4273-afcd-6489af8160ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:56.440470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed211a69-6a0f-4273-afcd-6489af8160ae admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:56.446962 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1154/2301] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:56.448001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e502177-b65f-4924-9421-c57d11a8c7b6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:56.459106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e502177-b65f-4924-9421-c57d11a8c7b6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:56.464870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1b7da-d051-40b9-b184-cd695427168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:56.465738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1b7da-d051-40b9-b184-cd695427168f admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.466034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1b7da-d051-40b9-b184-cd695427168f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.466302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1b7da-d051-40b9-b184-cd695427168f admin admin] PATH_INFO: `/v3/projects/8c7b978e56e04cb1b816f3607566ce1e/users/46ce8cd368df453ca514f2ff55a5c2f7/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.481983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1b7da-d051-40b9-b184-cd695427168f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7b978e56e04cb1b816f3607566ce1e, user_id=46ce8cd368df453ca514f2ff55a5c2f7, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:56.484738 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1b7da-d051-40b9-b184-cd695427168f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:56.538784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1148/2302] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:44:56 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:44:56.543857 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed211a69-6a0f-4273-afcd-6489af8160ae admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:56.553394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed211a69-6a0f-4273-afcd-6489af8160ae admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:56.558040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054e095-a4e2-4728-8994-851e0966f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:56.558631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054e095-a4e2-4728-8994-851e0966f833 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.558971 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054e095-a4e2-4728-8994-851e0966f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.559176 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054e095-a4e2-4728-8994-851e0966f833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.559804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054e095-a4e2-4728-8994-851e0966f833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:56.561420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054e095-a4e2-4728-8994-851e0966f833 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:56.571005 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1149/2303] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:56.575737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054e095-a4e2-4728-8994-851e0966f833 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:56.585584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054e095-a4e2-4728-8994-851e0966f833 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:56.590863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d6a79-1414-4cc1-869c-71be68791dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:56.591454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d6a79-1414-4cc1-869c-71be68791dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.591730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d6a79-1414-4cc1-869c-71be68791dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.591999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d6a79-1414-4cc1-869c-71be68791dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.592662 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d6a79-1414-4cc1-869c-71be68791dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:56.594228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d6a79-1414-4cc1-869c-71be68791dd0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:56.607603 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1150/2304] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:44:56.609999 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1155/2305] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:56 2022] PUT /identity/v3/projects/8c7b978e56e04cb1b816f3607566ce1e/users/46ce8cd368df453ca514f2ff55a5c2f7/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:56.611680 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d6a79-1414-4cc1-869c-71be68791dd0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:56.611813 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1b7da-d051-40b9-b184-cd695427168f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:56.622943 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d6a79-1414-4cc1-869c-71be68791dd0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:56.680629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1b7da-d051-40b9-b184-cd695427168f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:56.686204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aea001-4ba0-4c3c-b61c-7eebb5a66038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:56.686814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aea001-4ba0-4c3c-b61c-7eebb5a66038 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.687096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aea001-4ba0-4c3c-b61c-7eebb5a66038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.687371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aea001-4ba0-4c3c-b61c-7eebb5a66038 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.688016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aea001-4ba0-4c3c-b61c-7eebb5a66038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:56.689673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aea001-4ba0-4c3c-b61c-7eebb5a66038 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:56.689832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5f411-4262-4c1b-9a9d-1ad7bb0bbd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:56.690490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f411-4262-4c1b-9a9d-1ad7bb0bbd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.690766 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f411-4262-4c1b-9a9d-1ad7bb0bbd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.691059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f411-4262-4c1b-9a9d-1ad7bb0bbd5c admin admin] PATH_INFO: `/v3/projects/84f7e3ee25f14430bb92ffa1a27ba2ac/users/6c3d3a713cc44127bffb0bd64fd22bea/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.700892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1156/2306] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:44:56.705097 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aea001-4ba0-4c3c-b61c-7eebb5a66038 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:56.707182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5f411-4262-4c1b-9a9d-1ad7bb0bbd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f7e3ee25f14430bb92ffa1a27ba2ac, user_id=6c3d3a713cc44127bffb0bd64fd22bea, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:56.710405 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5f411-4262-4c1b-9a9d-1ad7bb0bbd5c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:56.718825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aea001-4ba0-4c3c-b61c-7eebb5a66038 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:56.723562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb04371-0d8f-4ffd-ba5a-cbcbff2d7c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:56.724235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb04371-0d8f-4ffd-ba5a-cbcbff2d7c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.724516 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb04371-0d8f-4ffd-ba5a-cbcbff2d7c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.724786 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb04371-0d8f-4ffd-ba5a-cbcbff2d7c40 admin admin] PATH_INFO: `/v3/projects/8c7b978e56e04cb1b816f3607566ce1e/users/46ce8cd368df453ca514f2ff55a5c2f7/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.726728 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb04371-0d8f-4ffd-ba5a-cbcbff2d7c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7b978e56e04cb1b816f3607566ce1e, user_id=46ce8cd368df453ca514f2ff55a5c2f7, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:56.729418 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb04371-0d8f-4ffd-ba5a-cbcbff2d7c40 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:56.739636 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1157/2307] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:56 2022] PUT /identity/v3/projects/8c7b978e56e04cb1b816f3607566ce1e/users/46ce8cd368df453ca514f2ff55a5c2f7/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:56.777082 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1151/2308] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:44:56 2022] PUT /identity/v3/projects/84f7e3ee25f14430bb92ffa1a27ba2ac/users/6c3d3a713cc44127bffb0bd64fd22bea/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:44:56.787872 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605b73-490d-46b2-9462-01c288a5b130 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.788163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605b73-490d-46b2-9462-01c288a5b130 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.788495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605b73-490d-46b2-9462-01c288a5b130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.815888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce163f-dc6b-4042-ac23-1accdb6cc534 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.816471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce163f-dc6b-4042-ac23-1accdb6cc534 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.817049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce163f-dc6b-4042-ac23-1accdb6cc534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.828623 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-65605b73-490d-46b2-9462-01c288a5b130 None None] MFA Rules not processed for user `6c3d3a713cc44127bffb0bd64fd22bea`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:56.829958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-65605b73-490d-46b2-9462-01c288a5b130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:56.854908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-85ce163f-dc6b-4042-ac23-1accdb6cc534 None None] MFA Rules not processed for user `46ce8cd368df453ca514f2ff55a5c2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:44:56.856913 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-85ce163f-dc6b-4042-ac23-1accdb6cc534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:56.898699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1158/2309] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:56.911510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65605b73-490d-46b2-9462-01c288a5b130 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:56.914377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-65605b73-490d-46b2-9462-01c288a5b130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:56.937370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1152/2310] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:44:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:44:56.963567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce163f-dc6b-4042-ac23-1accdb6cc534 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:56.966481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-85ce163f-dc6b-4042-ac23-1accdb6cc534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:56.973348 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65605b73-490d-46b2-9462-01c288a5b130 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:56.977446 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81116c-9f01-43cf-be6f-04743233926c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:56.978063 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81116c-9f01-43cf-be6f-04743233926c service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.978345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81116c-9f01-43cf-be6f-04743233926c service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.978614 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81116c-9f01-43cf-be6f-04743233926c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.978865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce163f-dc6b-4042-ac23-1accdb6cc534 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:56.982696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96ff08-1ba3-4321-85d4-12a5605b3196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:56.983306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96ff08-1ba3-4321-85d4-12a5605b3196 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:56.983585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96ff08-1ba3-4321-85d4-12a5605b3196 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:56.983857 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96ff08-1ba3-4321-85d4-12a5605b3196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:56.985675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9d96ff08-1ba3-4321-85d4-12a5605b3196 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:56.987558 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81116c-9f01-43cf-be6f-04743233926c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:56.988978 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81116c-9f01-43cf-be6f-04743233926c service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:56.999050 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1159/2311] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:44:57.067337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96ff08-1ba3-4321-85d4-12a5605b3196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:57.068983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96ff08-1ba3-4321-85d4-12a5605b3196 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:57.079726 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1153/2312] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:44:57.269484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:57.406444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:57.891916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81116c-9f01-43cf-be6f-04743233926c service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:44:57.903506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81116c-9f01-43cf-be6f-04743233926c service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:44:57.921336 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4087469-d7eb-434b-b3cb-f9b54258b859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:44:57.921336 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4087469-d7eb-434b-b3cb-f9b54258b859 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:44:57.921336 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4087469-d7eb-434b-b3cb-f9b54258b859 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:44:57.921336 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4087469-d7eb-434b-b3cb-f9b54258b859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:44:57.922280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e4087469-d7eb-434b-b3cb-f9b54258b859 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:44:57.984856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4087469-d7eb-434b-b3cb-f9b54258b859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:44:57.986428 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4087469-d7eb-434b-b3cb-f9b54258b859 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:44:57.998645 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1160/2313] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:44:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:44:58.134377 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:58.277948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:59.735558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:44:59.927134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:00.301047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96ff08-1ba3-4321-85d4-12a5605b3196 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:00.320476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96ff08-1ba3-4321-85d4-12a5605b3196 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:00.323204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4087469-d7eb-434b-b3cb-f9b54258b859 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:00.330812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7537f93-9752-4016-9f18-88bc760413bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:00.331740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7537f93-9752-4016-9f18-88bc760413bd service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:00.332003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7537f93-9752-4016-9f18-88bc760413bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:00.332431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7537f93-9752-4016-9f18-88bc760413bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:00.333061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4087469-d7eb-434b-b3cb-f9b54258b859 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:00.335054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b7537f93-9752-4016-9f18-88bc760413bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:00.337042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23d3c1-2a3d-41e9-943d-46998086b703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:00.337811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23d3c1-2a3d-41e9-943d-46998086b703 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:00.338232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23d3c1-2a3d-41e9-943d-46998086b703 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:00.338610 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23d3c1-2a3d-41e9-943d-46998086b703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:00.341910 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5a23d3c1-2a3d-41e9-943d-46998086b703 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:00.355892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:00.417164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23d3c1-2a3d-41e9-943d-46998086b703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:00.418878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23d3c1-2a3d-41e9-943d-46998086b703 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:00.433414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7537f93-9752-4016-9f18-88bc760413bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:00.435912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7537f93-9752-4016-9f18-88bc760413bd service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:00.443003 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1161/2314] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:45:00.446330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1154/2315] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:01.123861 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:01.311663 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23d3c1-2a3d-41e9-943d-46998086b703 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:01.386950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23d3c1-2a3d-41e9-943d-46998086b703 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:01.391856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0fca9-3c60-4fe7-ba0b-0fc54e26a672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:01.392537 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0fca9-3c60-4fe7-ba0b-0fc54e26a672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:01.392815 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0fca9-3c60-4fe7-ba0b-0fc54e26a672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:01.393081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0fca9-3c60-4fe7-ba0b-0fc54e26a672 admin admin] PATH_INFO: `/v3/users/6c3d3a713cc44127bffb0bd64fd22bea` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:01.394343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0fca9-3c60-4fe7-ba0b-0fc54e26a672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3d3a713cc44127bffb0bd64fd22bea)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:01.396313 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0fca9-3c60-4fe7-ba0b-0fc54e26a672 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:01.599666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-abf0fca9-3c60-4fe7-ba0b-0fc54e26a672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3d3a713cc44127bffb0bd64fd22bea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:01.615273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-abf0fca9-3c60-4fe7-ba0b-0fc54e26a672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3d3a713cc44127bffb0bd64fd22bea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:01.687142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-abf0fca9-3c60-4fe7-ba0b-0fc54e26a672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3d3a713cc44127bffb0bd64fd22bea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:01.695400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-abf0fca9-3c60-4fe7-ba0b-0fc54e26a672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3d3a713cc44127bffb0bd64fd22bea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:01.696222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-abf0fca9-3c60-4fe7-ba0b-0fc54e26a672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3d3a713cc44127bffb0bd64fd22bea'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:01.702295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1162/2316] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:01 2022] DELETE /identity/v3/users/6c3d3a713cc44127bffb0bd64fd22bea => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:01.706778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c432-1222-4f64-87fb-e91572d6d195 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:01.707286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c432-1222-4f64-87fb-e91572d6d195 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:01.707391 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c432-1222-4f64-87fb-e91572d6d195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:01.726629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2268c432-1222-4f64-87fb-e91572d6d195 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:01.727842 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2268c432-1222-4f64-87fb-e91572d6d195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:01.792742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1155/2317] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:01.814164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0fca9-3c60-4fe7-ba0b-0fc54e26a672 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:01.820056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-abf0fca9-3c60-4fe7-ba0b-0fc54e26a672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:01.903323 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0fca9-3c60-4fe7-ba0b-0fc54e26a672 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:01.908724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7bcc1-51fb-4a9f-8a59-4cb15cd035b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:01.909546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7bcc1-51fb-4a9f-8a59-4cb15cd035b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:01.909833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7bcc1-51fb-4a9f-8a59-4cb15cd035b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:01.910181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7bcc1-51fb-4a9f-8a59-4cb15cd035b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:01.910932 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:01.923082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7bcc1-51fb-4a9f-8a59-4cb15cd035b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:01.925264 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7bcc1-51fb-4a9f-8a59-4cb15cd035b9 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:01.952201 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1163/2318] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:02.038702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411da52d-9af7-455d-8489-f97fbd5c0ed0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:02.039587 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411da52d-9af7-455d-8489-f97fbd5c0ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:02.042592 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411da52d-9af7-455d-8489-f97fbd5c0ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:02.087735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-411da52d-9af7-455d-8489-f97fbd5c0ed0 None None] MFA Rules not processed for user `e91b32ab25854882af7bc313fdd342b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:02.089227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-411da52d-9af7-455d-8489-f97fbd5c0ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:02.155658 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1156/2319] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:02.378832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:02.446743 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7bcc1-51fb-4a9f-8a59-4cb15cd035b9 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:02.448956 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-27b7bcc1-51fb-4a9f-8a59-4cb15cd035b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:02.547858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7bcc1-51fb-4a9f-8a59-4cb15cd035b9 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:02.555583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124084fa-2b7f-4b0c-ab5f-539e254250fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:02.556355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124084fa-2b7f-4b0c-ab5f-539e254250fc service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:02.556874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124084fa-2b7f-4b0c-ab5f-539e254250fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:02.557440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124084fa-2b7f-4b0c-ab5f-539e254250fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:02.559987 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-124084fa-2b7f-4b0c-ab5f-539e254250fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:02.677423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124084fa-2b7f-4b0c-ab5f-539e254250fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:02.679112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124084fa-2b7f-4b0c-ab5f-539e254250fc service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:02.692906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1164/2320] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:02.759015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411da52d-9af7-455d-8489-f97fbd5c0ed0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:02.761365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-411da52d-9af7-455d-8489-f97fbd5c0ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:02.805071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411da52d-9af7-455d-8489-f97fbd5c0ed0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:02.822413 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896624c-7aa8-4f22-aa52-f82194a2aeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:02.823066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896624c-7aa8-4f22-aa52-f82194a2aeeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:02.823342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896624c-7aa8-4f22-aa52-f82194a2aeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:02.823618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896624c-7aa8-4f22-aa52-f82194a2aeeb admin admin] PATH_INFO: `/v3/projects/84f7e3ee25f14430bb92ffa1a27ba2ac` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:02.824731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896624c-7aa8-4f22-aa52-f82194a2aeeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f7e3ee25f14430bb92ffa1a27ba2ac)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:02.828061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896624c-7aa8-4f22-aa52-f82194a2aeeb admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:03.010847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2896624c-7aa8-4f22-aa52-f82194a2aeeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f7e3ee25f14430bb92ffa1a27ba2ac', 'request_id': 'req-2896624c-7aa8-4f22-aa52-f82194a2aeeb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:03.098014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2896624c-7aa8-4f22-aa52-f82194a2aeeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f7e3ee25f14430bb92ffa1a27ba2ac', 'request_id': 'req-2896624c-7aa8-4f22-aa52-f82194a2aeeb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:03.105646 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2896624c-7aa8-4f22-aa52-f82194a2aeeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f7e3ee25f14430bb92ffa1a27ba2ac', 'request_id': 'req-2896624c-7aa8-4f22-aa52-f82194a2aeeb'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:03.118611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2896624c-7aa8-4f22-aa52-f82194a2aeeb admin admin] The token cache is being invalidate because project 84f7e3ee25f14430bb92ffa1a27ba2ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:03.118899 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2896624c-7aa8-4f22-aa52-f82194a2aeeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:03.119554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2896624c-7aa8-4f22-aa52-f82194a2aeeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:03.121035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1157/2321] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:02 2022] DELETE /identity/v3/projects/84f7e3ee25f14430bb92ffa1a27ba2ac => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:03.126961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f749c-c9a8-4b73-853d-9d9c28ca1445 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:03.127252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f749c-c9a8-4b73-853d-9d9c28ca1445 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:03.127565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f749c-c9a8-4b73-853d-9d9c28ca1445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:03.148253 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2c0f749c-c9a8-4b73-853d-9d9c28ca1445 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:03.149934 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2c0f749c-c9a8-4b73-853d-9d9c28ca1445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:03.238254 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1165/2322] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:03.239955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa956f9-00b0-49ee-ac78-db591bed7141 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:03.240244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa956f9-00b0-49ee-ac78-db591bed7141 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:03.240526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa956f9-00b0-49ee-ac78-db591bed7141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:03.265948 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5fa956f9-00b0-49ee-ac78-db591bed7141 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:03.267526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5fa956f9-00b0-49ee-ac78-db591bed7141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:03.276391 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1158/2323] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:03.281609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f749c-c9a8-4b73-853d-9d9c28ca1445 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:03.291505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f749c-c9a8-4b73-853d-9d9c28ca1445 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:03.296816 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa953e5f-d469-4d8f-a412-da708c9da326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:03.297451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa953e5f-d469-4d8f-a412-da708c9da326 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:03.301284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa953e5f-d469-4d8f-a412-da708c9da326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:03.301284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa953e5f-d469-4d8f-a412-da708c9da326 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:03.301284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa953e5f-d469-4d8f-a412-da708c9da326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:45:03.301284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa953e5f-d469-4d8f-a412-da708c9da326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:03.301284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa953e5f-d469-4d8f-a412-da708c9da326 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:03.313003 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1166/2324] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:45:03.318112 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa956f9-00b0-49ee-ac78-db591bed7141 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:03.329241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa956f9-00b0-49ee-ac78-db591bed7141 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:03.334446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0953558-d2f8-44bb-a37b-dc064024516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:03.335123 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953558-d2f8-44bb-a37b-dc064024516c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:03.335463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953558-d2f8-44bb-a37b-dc064024516c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:03.335802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953558-d2f8-44bb-a37b-dc064024516c admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:03.336509 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0953558-d2f8-44bb-a37b-dc064024516c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:03.338678 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0953558-d2f8-44bb-a37b-dc064024516c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:03.483311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1159/2325] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:45:03 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:45:03.487440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa953e5f-d469-4d8f-a412-da708c9da326 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:03.500160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa953e5f-d469-4d8f-a412-da708c9da326 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:03.584284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521775e-295e-4da6-95d3-c613f21213e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:03.584912 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521775e-295e-4da6-95d3-c613f21213e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:03.585192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521775e-295e-4da6-95d3-c613f21213e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:03.585484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521775e-295e-4da6-95d3-c613f21213e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:03.586126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521775e-295e-4da6-95d3-c613f21213e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:03.590212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521775e-295e-4da6-95d3-c613f21213e5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:03.701003 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:03.710163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1167/2326] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:45:03 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:45:03.711622 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0953558-d2f8-44bb-a37b-dc064024516c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:03.726335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0953558-d2f8-44bb-a37b-dc064024516c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:03.733636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a10304-278e-43e3-955d-de0ecd6571a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:03.736459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a10304-278e-43e3-955d-de0ecd6571a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:03.737056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a10304-278e-43e3-955d-de0ecd6571a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:03.738415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a10304-278e-43e3-955d-de0ecd6571a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:03.738415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a10304-278e-43e3-955d-de0ecd6571a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:03.740981 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a10304-278e-43e3-955d-de0ecd6571a1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:03.757539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1160/2327] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:45:03.766235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521775e-295e-4da6-95d3-c613f21213e5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:03.784831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:03.802235 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521775e-295e-4da6-95d3-c613f21213e5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:03.809116 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46f3c9-2258-4ef6-93cd-d3f424a43439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:03.810215 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46f3c9-2258-4ef6-93cd-d3f424a43439 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:03.810716 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46f3c9-2258-4ef6-93cd-d3f424a43439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:03.811220 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46f3c9-2258-4ef6-93cd-d3f424a43439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:03.812102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46f3c9-2258-4ef6-93cd-d3f424a43439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:03.814471 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46f3c9-2258-4ef6-93cd-d3f424a43439 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:03.831586 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1168/2328] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:45:03.835798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a10304-278e-43e3-955d-de0ecd6571a1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:03.849443 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a10304-278e-43e3-955d-de0ecd6571a1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:03.855634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23a56f-08b2-4464-9fcb-d9514f835ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:03.859290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23a56f-08b2-4464-9fcb-d9514f835ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:03.859290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23a56f-08b2-4464-9fcb-d9514f835ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:03.859290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23a56f-08b2-4464-9fcb-d9514f835ab1 admin admin] PATH_INFO: `/v3/projects/67678a0aa5ee4f6d96e9589c50c967fd/users/228a98c7d9b44f26b8afdac5a9badf1a/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:03.874277 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23a56f-08b2-4464-9fcb-d9514f835ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67678a0aa5ee4f6d96e9589c50c967fd, user_id=228a98c7d9b44f26b8afdac5a9badf1a, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:03.877063 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23a56f-08b2-4464-9fcb-d9514f835ab1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:04.007388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1161/2329] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:45:03 2022] PUT /identity/v3/projects/67678a0aa5ee4f6d96e9589c50c967fd/users/228a98c7d9b44f26b8afdac5a9badf1a/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:04.027747 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37aead-a1d4-4e95-87fc-8736de28973d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:04.027944 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37aead-a1d4-4e95-87fc-8736de28973d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:04.028881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37aead-a1d4-4e95-87fc-8736de28973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:04.094367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-dc37aead-a1d4-4e95-87fc-8736de28973d None None] MFA Rules not processed for user `228a98c7d9b44f26b8afdac5a9badf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:04.095791 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-dc37aead-a1d4-4e95-87fc-8736de28973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:04.195794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1169/2330] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:04.223189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23a56f-08b2-4464-9fcb-d9514f835ab1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:04.223189 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3e23a56f-08b2-4464-9fcb-d9514f835ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:04.282220 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493dc8b-75fe-40f5-a439-58e8b78a8a68 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:04.282505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493dc8b-75fe-40f5-a439-58e8b78a8a68 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:04.282779 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493dc8b-75fe-40f5-a439-58e8b78a8a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:04.290894 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23a56f-08b2-4464-9fcb-d9514f835ab1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:04.297321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e2cd4-f4e1-447e-bcd3-3f52356e5eb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:04.298252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e2cd4-f4e1-447e-bcd3-3f52356e5eb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:04.298600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e2cd4-f4e1-447e-bcd3-3f52356e5eb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:04.299155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e2cd4-f4e1-447e-bcd3-3f52356e5eb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:04.306411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6493dc8b-75fe-40f5-a439-58e8b78a8a68 None None] MFA Rules not processed for user `75d4111e41a743bfa5016241e48bc9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:04.307614 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6493dc8b-75fe-40f5-a439-58e8b78a8a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:04.310814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e2cd4-f4e1-447e-bcd3-3f52356e5eb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:04.312240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e2cd4-f4e1-447e-bcd3-3f52356e5eb1 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:04.323948 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1162/2331] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:04.396660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1170/2332] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:05.669679 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:05.755632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:06.244963 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e2cd4-f4e1-447e-bcd3-3f52356e5eb1 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:06.246453 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2f5e2cd4-f4e1-447e-bcd3-3f52356e5eb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:06.346999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e2cd4-f4e1-447e-bcd3-3f52356e5eb1 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:06.354102 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1a30a-f044-465d-bd4d-4172cefdb3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:06.355255 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1a30a-f044-465d-bd4d-4172cefdb3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:06.363152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1a30a-f044-465d-bd4d-4172cefdb3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:06.363769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1a30a-f044-465d-bd4d-4172cefdb3f3 admin admin] PATH_INFO: `/v3/users/ce6702a140d441e2b15de715372ddb33` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:06.365378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1a30a-f044-465d-bd4d-4172cefdb3f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6702a140d441e2b15de715372ddb33)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:06.367670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1a30a-f044-465d-bd4d-4172cefdb3f3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:06.581491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d0a1a30a-f044-465d-bd4d-4172cefdb3f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6702a140d441e2b15de715372ddb33'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:06.582596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d0a1a30a-f044-465d-bd4d-4172cefdb3f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6702a140d441e2b15de715372ddb33'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:06.601116 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d0a1a30a-f044-465d-bd4d-4172cefdb3f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6702a140d441e2b15de715372ddb33'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:06.609044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d0a1a30a-f044-465d-bd4d-4172cefdb3f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6702a140d441e2b15de715372ddb33'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:06.609835 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d0a1a30a-f044-465d-bd4d-4172cefdb3f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6702a140d441e2b15de715372ddb33'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:06.696718 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1163/2333] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:06 2022] DELETE /identity/v3/users/ce6702a140d441e2b15de715372ddb33 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:06.699072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0baa1d-8d18-4171-a7f6-285189ef7497 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:06.699635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0baa1d-8d18-4171-a7f6-285189ef7497 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:06.699635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0baa1d-8d18-4171-a7f6-285189ef7497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:06.720314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-db0baa1d-8d18-4171-a7f6-285189ef7497 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:06.721981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-db0baa1d-8d18-4171-a7f6-285189ef7497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:06.795494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1171/2334] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:06.803300 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1a30a-f044-465d-bd4d-4172cefdb3f3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:06.804919 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d0a1a30a-f044-465d-bd4d-4172cefdb3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:06.867764 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1a30a-f044-465d-bd4d-4172cefdb3f3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:06.871320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1d77a-fce0-48a7-a0c5-a929e6f5e514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:06.872570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d77a-fce0-48a7-a0c5-a929e6f5e514 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:06.873074 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d77a-fce0-48a7-a0c5-a929e6f5e514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:06.873522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d77a-fce0-48a7-a0c5-a929e6f5e514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:06.882837 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1d77a-fce0-48a7-a0c5-a929e6f5e514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:06.884356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1d77a-fce0-48a7-a0c5-a929e6f5e514 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:06.897262 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1164/2335] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:07.212355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d7924-0c3e-4e05-8b85-0e8cf31cf23d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:07.212582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d7924-0c3e-4e05-8b85-0e8cf31cf23d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:07.213059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d7924-0c3e-4e05-8b85-0e8cf31cf23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:07.275803 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f64d7924-0c3e-4e05-8b85-0e8cf31cf23d None None] MFA Rules not processed for user `228a98c7d9b44f26b8afdac5a9badf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:07.281923 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f64d7924-0c3e-4e05-8b85-0e8cf31cf23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:07.375908 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1172/2336] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:07.499627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:07.578867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:07.879385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1d77a-fce0-48a7-a0c5-a929e6f5e514 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:07.881534 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-13c1d77a-fce0-48a7-a0c5-a929e6f5e514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:07.891481 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d7924-0c3e-4e05-8b85-0e8cf31cf23d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:07.893065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f64d7924-0c3e-4e05-8b85-0e8cf31cf23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:07.911581 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1d77a-fce0-48a7-a0c5-a929e6f5e514 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:07.913134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d7924-0c3e-4e05-8b85-0e8cf31cf23d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:07.923006 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:07.923840 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b5cc6-e2be-4b6b-9184-9f3cdb0e2f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:07.925914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b5cc6-e2be-4b6b-9184-9f3cdb0e2f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:07.926151 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:07.926619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:07.927069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] PATH_INFO: `/v3/projects/750170522acd4ca0a91846750b5adcd7` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:07.927528 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b5cc6-e2be-4b6b-9184-9f3cdb0e2f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:07.928800 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b5cc6-e2be-4b6b-9184-9f3cdb0e2f6b admin admin] PATH_INFO: `/v3/users/df5f017ead1147a9bfa33d2f7b8c0dc1` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:07.930231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=750170522acd4ca0a91846750b5adcd7)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:07.931038 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b5cc6-e2be-4b6b-9184-9f3cdb0e2f6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df5f017ead1147a9bfa33d2f7b8c0dc1)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:07.933147 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:07.945513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b5cc6-e2be-4b6b-9184-9f3cdb0e2f6b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:08.141149 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750170522acd4ca0a91846750b5adcd7', 'request_id': 'req-1f49b837-9056-4586-bb88-783bc4a072d7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.142469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3a5b5cc6-e2be-4b6b-9184-9f3cdb0e2f6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df5f017ead1147a9bfa33d2f7b8c0dc1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.164037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3a5b5cc6-e2be-4b6b-9184-9f3cdb0e2f6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df5f017ead1147a9bfa33d2f7b8c0dc1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.252186 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750170522acd4ca0a91846750b5adcd7', 'request_id': 'req-1f49b837-9056-4586-bb88-783bc4a072d7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.260447 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750170522acd4ca0a91846750b5adcd7', 'request_id': 'req-1f49b837-9056-4586-bb88-783bc4a072d7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.275803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] The token cache is being invalidate because project 750170522acd4ca0a91846750b5adcd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:08.276136 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.276781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.278811 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1165/2337] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:07 2022] DELETE /identity/v3/projects/750170522acd4ca0a91846750b5adcd7 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:08.283797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:08.284853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:08.333685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3a5b5cc6-e2be-4b6b-9184-9f3cdb0e2f6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df5f017ead1147a9bfa33d2f7b8c0dc1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.348361 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3a5b5cc6-e2be-4b6b-9184-9f3cdb0e2f6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df5f017ead1147a9bfa33d2f7b8c0dc1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.349658 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3a5b5cc6-e2be-4b6b-9184-9f3cdb0e2f6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df5f017ead1147a9bfa33d2f7b8c0dc1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.372718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1173/2338] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:07 2022] DELETE /identity/v3/users/df5f017ead1147a9bfa33d2f7b8c0dc1 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:45:08.377544 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d2a6c-d476-48db-b02b-266afefdd069 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:08.378140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49b837-9056-4586-bb88-783bc4a072d7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:08.378314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d2a6c-d476-48db-b02b-266afefdd069 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:08.378860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d2a6c-d476-48db-b02b-266afefdd069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:08.422697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a43d2a6c-d476-48db-b02b-266afefdd069 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:08.424190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a43d2a6c-d476-48db-b02b-266afefdd069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:08.514598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fae764-b12c-4027-ab11-adea3f66910d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:08.515317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fae764-b12c-4027-ab11-adea3f66910d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:08.515736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fae764-b12c-4027-ab11-adea3f66910d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:08.516079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fae764-b12c-4027-ab11-adea3f66910d admin admin] PATH_INFO: `/v3/users/649319f5eb71470783292deb6c9c3acd` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:08.517535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fae764-b12c-4027-ab11-adea3f66910d admin admin] RBAC: Authorizing `identity:delete_user(user_id=649319f5eb71470783292deb6c9c3acd)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:08.522141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fae764-b12c-4027-ab11-adea3f66910d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:08.526847 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1174/2339] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:45:08.539206 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d2a6c-d476-48db-b02b-266afefdd069 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:08.541171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a43d2a6c-d476-48db-b02b-266afefdd069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:08.609546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d2a6c-d476-48db-b02b-266afefdd069 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:08.613424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c574e1-585e-4496-93ac-8b80ec462838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:08.614034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c574e1-585e-4496-93ac-8b80ec462838 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:08.614316 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c574e1-585e-4496-93ac-8b80ec462838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:08.614591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c574e1-585e-4496-93ac-8b80ec462838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:08.624674 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c574e1-585e-4496-93ac-8b80ec462838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:08.626200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c574e1-585e-4496-93ac-8b80ec462838 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:08.636330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1175/2340] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:45:08.700506 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-39fae764-b12c-4027-ab11-adea3f66910d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649319f5eb71470783292deb6c9c3acd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.701853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-39fae764-b12c-4027-ab11-adea3f66910d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649319f5eb71470783292deb6c9c3acd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.705542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:08.717363 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-39fae764-b12c-4027-ab11-adea3f66910d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649319f5eb71470783292deb6c9c3acd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.725388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-39fae764-b12c-4027-ab11-adea3f66910d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649319f5eb71470783292deb6c9c3acd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.726215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-39fae764-b12c-4027-ab11-adea3f66910d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649319f5eb71470783292deb6c9c3acd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:08.835075 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1166/2341] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:08 2022] DELETE /identity/v3/users/649319f5eb71470783292deb6c9c3acd => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:45:09.150170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:09.370747 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c574e1-585e-4496-93ac-8b80ec462838 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:09.372437 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-70c574e1-585e-4496-93ac-8b80ec462838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:09.399340 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c574e1-585e-4496-93ac-8b80ec462838 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:09.402626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fae764-b12c-4027-ab11-adea3f66910d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:09.405152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-39fae764-b12c-4027-ab11-adea3f66910d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:09.598389 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:09.613519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fae764-b12c-4027-ab11-adea3f66910d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:09.620811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:09.623549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:09.624040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] PATH_INFO: `/v3/projects/9cf38e9d73af4f70bfe490aef94a2726` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:09.627927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf38e9d73af4f70bfe490aef94a2726)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:09.635997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:09.649470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:09.651984 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:09.652833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:09.652833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] PATH_INFO: `/v3/projects/ed26b54423e84e01b90c8072657f315e` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:09.655920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed26b54423e84e01b90c8072657f315e)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:09.658994 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:09.790110 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed26b54423e84e01b90c8072657f315e', 'request_id': 'req-da5fdaea-12e9-4945-90da-90b9653445ce'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:09.815790 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf38e9d73af4f70bfe490aef94a2726', 'request_id': 'req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:09.863824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed26b54423e84e01b90c8072657f315e', 'request_id': 'req-da5fdaea-12e9-4945-90da-90b9653445ce'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:09.870427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed26b54423e84e01b90c8072657f315e', 'request_id': 'req-da5fdaea-12e9-4945-90da-90b9653445ce'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:09.882679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] The token cache is being invalidate because project ed26b54423e84e01b90c8072657f315e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:09.882970 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:09.883687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:09.885870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1167/2342] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:09 2022] DELETE /identity/v3/projects/ed26b54423e84e01b90c8072657f315e => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:45:09.889566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:09.891858 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:09.894640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:09.942984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf38e9d73af4f70bfe490aef94a2726', 'request_id': 'req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:09.949830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf38e9d73af4f70bfe490aef94a2726', 'request_id': 'req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:09.964089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fdaea-12e9-4945-90da-90b9653445ce admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:09.967848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] The token cache is being invalidate because project 9cf38e9d73af4f70bfe490aef94a2726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:09.968155 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:09.968925 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:09.974839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f03149-805a-4ef9-87fb-3a636d9f9646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:09.974839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f03149-805a-4ef9-87fb-3a636d9f9646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:09.974839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f03149-805a-4ef9-87fb-3a636d9f9646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:09.975136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1176/2343] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:09 2022] DELETE /identity/v3/projects/9cf38e9d73af4f70bfe490aef94a2726 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:09.975225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f03149-805a-4ef9-87fb-3a636d9f9646 admin admin] PATH_INFO: `/v3/users/6f03d4b299a94a01b00136a0dc38581f` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:09.975225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f03149-805a-4ef9-87fb-3a636d9f9646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f03d4b299a94a01b00136a0dc38581f)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:09.975402 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:09.975762 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:09.976291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f03149-805a-4ef9-87fb-3a636d9f9646 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:10.042688 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b25e6d-bfca-41a0-bdfc-e83b548fb22c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:10.047381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2d2ef-b166-4472-b93c-c7081a27aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:10.047997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2d2ef-b166-4472-b93c-c7081a27aad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:10.048275 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2d2ef-b166-4472-b93c-c7081a27aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:10.048547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2d2ef-b166-4472-b93c-c7081a27aad5 admin admin] PATH_INFO: `/v3/users/8c2594c01ef2411382c22e89e8fe4dc7` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:10.049718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2d2ef-b166-4472-b93c-c7081a27aad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2594c01ef2411382c22e89e8fe4dc7)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:10.051706 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2d2ef-b166-4472-b93c-c7081a27aad5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:10.197604 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-15f03149-805a-4ef9-87fb-3a636d9f9646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f03d4b299a94a01b00136a0dc38581f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:10.200150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-15f03149-805a-4ef9-87fb-3a636d9f9646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f03d4b299a94a01b00136a0dc38581f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:10.239655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-15f03149-805a-4ef9-87fb-3a636d9f9646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f03d4b299a94a01b00136a0dc38581f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:10.254468 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-15f03149-805a-4ef9-87fb-3a636d9f9646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f03d4b299a94a01b00136a0dc38581f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:10.255286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-15f03149-805a-4ef9-87fb-3a636d9f9646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f03d4b299a94a01b00136a0dc38581f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:10.257838 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:10.304742 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-aca2d2ef-b166-4472-b93c-c7081a27aad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2594c01ef2411382c22e89e8fe4dc7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:10.319051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-aca2d2ef-b166-4472-b93c-c7081a27aad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2594c01ef2411382c22e89e8fe4dc7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:10.376261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1168/2344] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:09 2022] DELETE /identity/v3/users/6f03d4b299a94a01b00136a0dc38581f => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:10.480724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-aca2d2ef-b166-4472-b93c-c7081a27aad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2594c01ef2411382c22e89e8fe4dc7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:10.489347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-aca2d2ef-b166-4472-b93c-c7081a27aad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2594c01ef2411382c22e89e8fe4dc7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:10.490100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-aca2d2ef-b166-4472-b93c-c7081a27aad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2594c01ef2411382c22e89e8fe4dc7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:10.496554 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1177/2345] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:09 2022] DELETE /identity/v3/users/8c2594c01ef2411382c22e89e8fe4dc7 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:45:10.997700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f03149-805a-4ef9-87fb-3a636d9f9646 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:11.002463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-15f03149-805a-4ef9-87fb-3a636d9f9646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:11.095541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2d2ef-b166-4472-b93c-c7081a27aad5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:11.100259 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-aca2d2ef-b166-4472-b93c-c7081a27aad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:11.113738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f03149-805a-4ef9-87fb-3a636d9f9646 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:11.190248 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2d2ef-b166-4472-b93c-c7081a27aad5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:11.197772 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:11.198414 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:11.198830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:11.199572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] PATH_INFO: `/v3/projects/8b370153f34a4619af92b63c2a01e063` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:11.201417 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b370153f34a4619af92b63c2a01e063)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:11.203346 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:11.203491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:11.211557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de534938-fb9f-4ca1-93ed-5498ed19bdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:11.212379 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de534938-fb9f-4ca1-93ed-5498ed19bdfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:11.212894 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de534938-fb9f-4ca1-93ed-5498ed19bdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:11.215674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de534938-fb9f-4ca1-93ed-5498ed19bdfa admin admin] PATH_INFO: `/v3/projects/5c7fbf39f9604c5e81f1743aecc44b48` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:11.215674 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de534938-fb9f-4ca1-93ed-5498ed19bdfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7fbf39f9604c5e81f1743aecc44b48)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:11.217045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de534938-fb9f-4ca1-93ed-5498ed19bdfa admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:11.315040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b370153f34a4619af92b63c2a01e063', 'request_id': 'req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:11.331418 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-de534938-fb9f-4ca1-93ed-5498ed19bdfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7fbf39f9604c5e81f1743aecc44b48', 'request_id': 'req-de534938-fb9f-4ca1-93ed-5498ed19bdfa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:11.418168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b370153f34a4619af92b63c2a01e063', 'request_id': 'req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:11.426601 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b370153f34a4619af92b63c2a01e063', 'request_id': 'req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:11.443897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] The token cache is being invalidate because project 8b370153f34a4619af92b63c2a01e063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:11.444273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:11.445324 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:11.447362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1178/2346] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:11 2022] DELETE /identity/v3/projects/8b370153f34a4619af92b63c2a01e063 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:45:11.452196 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:11.454233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:11.474869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-de534938-fb9f-4ca1-93ed-5498ed19bdfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7fbf39f9604c5e81f1743aecc44b48', 'request_id': 'req-de534938-fb9f-4ca1-93ed-5498ed19bdfa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:11.485999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-de534938-fb9f-4ca1-93ed-5498ed19bdfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7fbf39f9604c5e81f1743aecc44b48', 'request_id': 'req-de534938-fb9f-4ca1-93ed-5498ed19bdfa'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:11.501435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-de534938-fb9f-4ca1-93ed-5498ed19bdfa admin admin] The token cache is being invalidate because project 5c7fbf39f9604c5e81f1743aecc44b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:11.501435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-de534938-fb9f-4ca1-93ed-5498ed19bdfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:11.501435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-de534938-fb9f-4ca1-93ed-5498ed19bdfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:11.503486 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1169/2347] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:10 2022] DELETE /identity/v3/projects/5c7fbf39f9604c5e81f1743aecc44b48 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:45:11.511752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0989327-396f-4020-b068-e19040531a77 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:11.512286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0989327-396f-4020-b068-e19040531a77 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:11.512958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0989327-396f-4020-b068-e19040531a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:11.535522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960ff09-8df3-464d-bb3a-17b4ae7d2dca admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:11.540382 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d0989327-396f-4020-b068-e19040531a77 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:11.542679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d0989327-396f-4020-b068-e19040531a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:11.594056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:11.611691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b8fb9-1e8b-492f-9c7c-c112be4ed03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:11.613022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b8fb9-1e8b-492f-9c7c-c112be4ed03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:11.613420 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b8fb9-1e8b-492f-9c7c-c112be4ed03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:11.613839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b8fb9-1e8b-492f-9c7c-c112be4ed03f admin admin] PATH_INFO: `/v3/users/46ce8cd368df453ca514f2ff55a5c2f7` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:11.615489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b8fb9-1e8b-492f-9c7c-c112be4ed03f admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ce8cd368df453ca514f2ff55a5c2f7)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:11.618310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b8fb9-1e8b-492f-9c7c-c112be4ed03f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:11.620119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1170/2348] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:11.640427 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614c065-3c1e-435d-96e0-99b25bd6cf19 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:11.640711 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614c065-3c1e-435d-96e0-99b25bd6cf19 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:11.641417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614c065-3c1e-435d-96e0-99b25bd6cf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:11.662778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-6614c065-3c1e-435d-96e0-99b25bd6cf19 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:11.663671 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-6614c065-3c1e-435d-96e0-99b25bd6cf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:11.673026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1171/2349] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:11.677470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614c065-3c1e-435d-96e0-99b25bd6cf19 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:11.687395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614c065-3c1e-435d-96e0-99b25bd6cf19 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:11.692435 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaecc6f-28e6-4005-a95d-29d44787d301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:11.693039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaecc6f-28e6-4005-a95d-29d44787d301 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:11.693417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaecc6f-28e6-4005-a95d-29d44787d301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:11.693693 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaecc6f-28e6-4005-a95d-29d44787d301 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:11.694366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaecc6f-28e6-4005-a95d-29d44787d301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:45:11.694668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaecc6f-28e6-4005-a95d-29d44787d301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:11.696380 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaecc6f-28e6-4005-a95d-29d44787d301 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:11.708266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1172/2350] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:45:11.712504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaecc6f-28e6-4005-a95d-29d44787d301 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:11.722807 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaecc6f-28e6-4005-a95d-29d44787d301 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:11.727348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25d5c0-a5fa-4b79-9506-30a95c2c5eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:11.727907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25d5c0-a5fa-4b79-9506-30a95c2c5eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:11.728183 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25d5c0-a5fa-4b79-9506-30a95c2c5eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:11.728450 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25d5c0-a5fa-4b79-9506-30a95c2c5eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:11.729062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25d5c0-a5fa-4b79-9506-30a95c2c5eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:11.730951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25d5c0-a5fa-4b79-9506-30a95c2c5eaa admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:11.861126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-eb0b8fb9-1e8b-492f-9c7c-c112be4ed03f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ce8cd368df453ca514f2ff55a5c2f7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:11.861327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1173/2351] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:45:11 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:45:11.861327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25d5c0-a5fa-4b79-9506-30a95c2c5eaa admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:11.878118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-eb0b8fb9-1e8b-492f-9c7c-c112be4ed03f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ce8cd368df453ca514f2ff55a5c2f7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:11.942963 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25d5c0-a5fa-4b79-9506-30a95c2c5eaa admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:11.947736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe53949-d6d1-4963-bdb1-67d1958b4d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:11.948356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53949-d6d1-4963-bdb1-67d1958b4d53 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:11.948656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53949-d6d1-4963-bdb1-67d1958b4d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:11.948920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53949-d6d1-4963-bdb1-67d1958b4d53 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:11.949582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe53949-d6d1-4963-bdb1-67d1958b4d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:11.951818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe53949-d6d1-4963-bdb1-67d1958b4d53 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:11.994763 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-eb0b8fb9-1e8b-492f-9c7c-c112be4ed03f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ce8cd368df453ca514f2ff55a5c2f7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:12.002551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-eb0b8fb9-1e8b-492f-9c7c-c112be4ed03f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ce8cd368df453ca514f2ff55a5c2f7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:12.003553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-eb0b8fb9-1e8b-492f-9c7c-c112be4ed03f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ce8cd368df453ca514f2ff55a5c2f7'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:12.009029 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1179/2352] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:11 2022] DELETE /identity/v3/users/46ce8cd368df453ca514f2ff55a5c2f7 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:12.032955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1174/2353] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:45:11 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:45:12.034560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b8fb9-1e8b-492f-9c7c-c112be4ed03f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:12.035977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-eb0b8fb9-1e8b-492f-9c7c-c112be4ed03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:12.105049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b8fb9-1e8b-492f-9c7c-c112be4ed03f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:12.109979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb951f-ce71-4c62-9d66-8bc354523083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:12.110588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb951f-ce71-4c62-9d66-8bc354523083 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:12.110867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb951f-ce71-4c62-9d66-8bc354523083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:12.111139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb951f-ce71-4c62-9d66-8bc354523083 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:12.111783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb951f-ce71-4c62-9d66-8bc354523083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:12.113551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb951f-ce71-4c62-9d66-8bc354523083 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:12.123476 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1180/2354] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:45:12.127678 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe53949-d6d1-4963-bdb1-67d1958b4d53 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:12.139195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe53949-d6d1-4963-bdb1-67d1958b4d53 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:12.145643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b55da8-6a48-48ca-92e4-fb40a88061b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:12.146263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55da8-6a48-48ca-92e4-fb40a88061b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:12.146741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55da8-6a48-48ca-92e4-fb40a88061b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:12.147014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55da8-6a48-48ca-92e4-fb40a88061b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:12.148057 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b55da8-6a48-48ca-92e4-fb40a88061b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:12.150416 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b55da8-6a48-48ca-92e4-fb40a88061b5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:12.168362 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1175/2355] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:45:12.169941 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb951f-ce71-4c62-9d66-8bc354523083 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:12.180504 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb951f-ce71-4c62-9d66-8bc354523083 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:12.190686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062879ea-5411-49dd-9a57-9049c7d31212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:12.191521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062879ea-5411-49dd-9a57-9049c7d31212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:12.191877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062879ea-5411-49dd-9a57-9049c7d31212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:12.192229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062879ea-5411-49dd-9a57-9049c7d31212 admin admin] PATH_INFO: `/v3/projects/9bc5356846b54cd9a7a6066fffe031bb/users/1445f70643164be9b5d6a3c9f0e9d451/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:12.212287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062879ea-5411-49dd-9a57-9049c7d31212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc5356846b54cd9a7a6066fffe031bb, user_id=1445f70643164be9b5d6a3c9f0e9d451, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:12.215097 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062879ea-5411-49dd-9a57-9049c7d31212 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:12.317608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1181/2356] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:45:12 2022] PUT /identity/v3/projects/9bc5356846b54cd9a7a6066fffe031bb/users/1445f70643164be9b5d6a3c9f0e9d451/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:45:12.328210 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce1358-e018-4edc-8946-7ab19b9aa52b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:12.328583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce1358-e018-4edc-8946-7ab19b9aa52b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:12.328912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce1358-e018-4edc-8946-7ab19b9aa52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:12.360736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-45ce1358-e018-4edc-8946-7ab19b9aa52b None None] MFA Rules not processed for user `1445f70643164be9b5d6a3c9f0e9d451`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:12.362174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-45ce1358-e018-4edc-8946-7ab19b9aa52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:12.444964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1176/2357] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:12.445147 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062879ea-5411-49dd-9a57-9049c7d31212 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:12.513917 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062879ea-5411-49dd-9a57-9049c7d31212 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:12.519790 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cc669-58af-47ea-acb4-0bbaaccf7813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:12.520496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc669-58af-47ea-acb4-0bbaaccf7813 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:12.520881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc669-58af-47ea-acb4-0bbaaccf7813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:12.521270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc669-58af-47ea-acb4-0bbaaccf7813 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:12.522014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cc669-58af-47ea-acb4-0bbaaccf7813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:12.524521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cc669-58af-47ea-acb4-0bbaaccf7813 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:12.601673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1182/2358] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:45:12 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:45:12.605704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce1358-e018-4edc-8946-7ab19b9aa52b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:12.617859 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:12.625001 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce1358-e018-4edc-8946-7ab19b9aa52b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:12.625918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cc669-58af-47ea-acb4-0bbaaccf7813 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:12.628459 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-922cc669-58af-47ea-acb4-0bbaaccf7813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:12.740630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cc669-58af-47ea-acb4-0bbaaccf7813 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:12.749470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44940fb9-6d92-42af-b736-ed45cf39414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:12.750889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44940fb9-6d92-42af-b736-ed45cf39414f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:12.751322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44940fb9-6d92-42af-b736-ed45cf39414f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:12.751903 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44940fb9-6d92-42af-b736-ed45cf39414f admin admin] PATH_INFO: `/v3/projects/8c7b978e56e04cb1b816f3607566ce1e` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:12.754094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44940fb9-6d92-42af-b736-ed45cf39414f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7b978e56e04cb1b816f3607566ce1e)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:12.756866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44940fb9-6d92-42af-b736-ed45cf39414f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:12.771698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7417138-725a-4f0b-87d5-448f35b6bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:12.771698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7417138-725a-4f0b-87d5-448f35b6bc62 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:12.771698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7417138-725a-4f0b-87d5-448f35b6bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:12.771698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7417138-725a-4f0b-87d5-448f35b6bc62 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:12.772060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7417138-725a-4f0b-87d5-448f35b6bc62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:12.772060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7417138-725a-4f0b-87d5-448f35b6bc62 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:12.873416 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1177/2359] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:45:12 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:45:12.877428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7417138-725a-4f0b-87d5-448f35b6bc62 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:12.888383 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7417138-725a-4f0b-87d5-448f35b6bc62 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:12.894502 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfd8a6-1ad3-4f43-8707-2121708bea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:12.896215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfd8a6-1ad3-4f43-8707-2121708bea74 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:12.896215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfd8a6-1ad3-4f43-8707-2121708bea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:12.896215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfd8a6-1ad3-4f43-8707-2121708bea74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:12.908283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfd8a6-1ad3-4f43-8707-2121708bea74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:12.908283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfd8a6-1ad3-4f43-8707-2121708bea74 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:12.910637 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1178/2360] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:45:12.914305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfd8a6-1ad3-4f43-8707-2121708bea74 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:12.928053 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfd8a6-1ad3-4f43-8707-2121708bea74 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:12.933526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-44940fb9-6d92-42af-b736-ed45cf39414f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7b978e56e04cb1b816f3607566ce1e', 'request_id': 'req-44940fb9-6d92-42af-b736-ed45cf39414f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:12.978090 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:13.030890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5044c9-bf3a-4f4f-b1d9-69155191eff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:13.031512 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5044c9-bf3a-4f4f-b1d9-69155191eff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:13.031797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5044c9-bf3a-4f4f-b1d9-69155191eff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:13.032073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5044c9-bf3a-4f4f-b1d9-69155191eff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:13.032718 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5044c9-bf3a-4f4f-b1d9-69155191eff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:13.034860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-44940fb9-6d92-42af-b736-ed45cf39414f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7b978e56e04cb1b816f3607566ce1e', 'request_id': 'req-44940fb9-6d92-42af-b736-ed45cf39414f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:13.039276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5044c9-bf3a-4f4f-b1d9-69155191eff9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:13.043320 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-44940fb9-6d92-42af-b736-ed45cf39414f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7b978e56e04cb1b816f3607566ce1e', 'request_id': 'req-44940fb9-6d92-42af-b736-ed45cf39414f'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:13.047307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1179/2361] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:45:13.053327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5044c9-bf3a-4f4f-b1d9-69155191eff9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:13.069089 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-44940fb9-6d92-42af-b736-ed45cf39414f admin admin] The token cache is being invalidate because project 8c7b978e56e04cb1b816f3607566ce1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:13.069589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-44940fb9-6d92-42af-b736-ed45cf39414f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:13.071534 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-44940fb9-6d92-42af-b736-ed45cf39414f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:13.090103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5044c9-bf3a-4f4f-b1d9-69155191eff9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:13.098044 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1183/2362] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:12 2022] DELETE /identity/v3/projects/8c7b978e56e04cb1b816f3607566ce1e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:45:13.109661 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a5861-d808-489a-aee5-94895557e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:13.110336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a5861-d808-489a-aee5-94895557e950 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:13.111056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a5861-d808-489a-aee5-94895557e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:13.113028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a5861-d808-489a-aee5-94895557e950 admin admin] PATH_INFO: `/v3/projects/b483ddd82ea348a3a7bdcf7e41d76799/users/40ff878ab8d6471094243861359dd238/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:13.148933 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a5861-d808-489a-aee5-94895557e950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b483ddd82ea348a3a7bdcf7e41d76799, user_id=40ff878ab8d6471094243861359dd238, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:13.151995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a5861-d808-489a-aee5-94895557e950 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:13.248865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1180/2363] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:45:13 2022] PUT /identity/v3/projects/b483ddd82ea348a3a7bdcf7e41d76799/users/40ff878ab8d6471094243861359dd238/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:13.265983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50be3f-f880-46e3-accb-672cd9f67950 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:13.266420 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50be3f-f880-46e3-accb-672cd9f67950 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:13.266854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50be3f-f880-46e3-accb-672cd9f67950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:13.318989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fa50be3f-f880-46e3-accb-672cd9f67950 None None] MFA Rules not processed for user `40ff878ab8d6471094243861359dd238`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:13.321008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fa50be3f-f880-46e3-accb-672cd9f67950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:13.400337 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1184/2364] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:13.405149 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a5861-d808-489a-aee5-94895557e950 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:13.407047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bc8a5861-d808-489a-aee5-94895557e950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:13.478123 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a5861-d808-489a-aee5-94895557e950 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:13.489708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f5d03-9654-411c-bc9a-8631902eb05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:13.490346 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f5d03-9654-411c-bc9a-8631902eb05b admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:13.490626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f5d03-9654-411c-bc9a-8631902eb05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:13.490951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f5d03-9654-411c-bc9a-8631902eb05b admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:13.491602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f5d03-9654-411c-bc9a-8631902eb05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:13.493706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f5d03-9654-411c-bc9a-8631902eb05b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:13.566335 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:13.585549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1181/2365] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:45:13 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:45:13.589974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50be3f-f880-46e3-accb-672cd9f67950 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:13.601881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50be3f-f880-46e3-accb-672cd9f67950 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:13.665177 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05684d7-3ce9-4346-a5a8-7053a3c3d438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:13.666077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05684d7-3ce9-4346-a5a8-7053a3c3d438 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:13.666361 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05684d7-3ce9-4346-a5a8-7053a3c3d438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:13.666629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05684d7-3ce9-4346-a5a8-7053a3c3d438 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:13.667272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05684d7-3ce9-4346-a5a8-7053a3c3d438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:13.669888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05684d7-3ce9-4346-a5a8-7053a3c3d438 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:13.708873 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:13.743943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1185/2366] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:45:13 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:45:13.748520 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f5d03-9654-411c-bc9a-8631902eb05b admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:13.759333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f5d03-9654-411c-bc9a-8631902eb05b admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:13.768320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc319ee-bd15-4362-8324-bbd1eb1dc954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:13.768941 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc319ee-bd15-4362-8324-bbd1eb1dc954 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:13.769409 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc319ee-bd15-4362-8324-bbd1eb1dc954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:13.774543 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc319ee-bd15-4362-8324-bbd1eb1dc954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:13.774543 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc319ee-bd15-4362-8324-bbd1eb1dc954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:13.774543 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc319ee-bd15-4362-8324-bbd1eb1dc954 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:13.783762 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1182/2367] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:45:13.787861 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05684d7-3ce9-4346-a5a8-7053a3c3d438 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:13.800607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05684d7-3ce9-4346-a5a8-7053a3c3d438 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:13.806097 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262bf35-64a4-45d4-812f-81572aa0a384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:13.806841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262bf35-64a4-45d4-812f-81572aa0a384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:13.807212 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262bf35-64a4-45d4-812f-81572aa0a384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:13.807555 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262bf35-64a4-45d4-812f-81572aa0a384 admin admin] PATH_INFO: `/v3/projects/4c6d3164309848159fae27f17cd83d6e/users/d012725e1ef840e2aab619ff88e09a29/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:13.827399 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262bf35-64a4-45d4-812f-81572aa0a384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6d3164309848159fae27f17cd83d6e, user_id=d012725e1ef840e2aab619ff88e09a29, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:13.830442 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262bf35-64a4-45d4-812f-81572aa0a384 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:13.923179 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1186/2368] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:45:13 2022] PUT /identity/v3/projects/4c6d3164309848159fae27f17cd83d6e/users/d012725e1ef840e2aab619ff88e09a29/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:13.926979 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc319ee-bd15-4362-8324-bbd1eb1dc954 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:13.938797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc319ee-bd15-4362-8324-bbd1eb1dc954 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:14.003709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31765224-4110-4181-88ff-b5751a056dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:14.004320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31765224-4110-4181-88ff-b5751a056dfa admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:14.004599 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31765224-4110-4181-88ff-b5751a056dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:14.004870 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31765224-4110-4181-88ff-b5751a056dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:14.005546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31765224-4110-4181-88ff-b5751a056dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:14.007133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31765224-4110-4181-88ff-b5751a056dfa admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:14.020133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1183/2369] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:45:14.021353 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262bf35-64a4-45d4-812f-81572aa0a384 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:14.032219 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262bf35-64a4-45d4-812f-81572aa0a384 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:14.036924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f55f9-4f7f-42ae-b3ad-e5dde007a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:14.037618 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f55f9-4f7f-42ae-b3ad-e5dde007a485 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:14.037874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f55f9-4f7f-42ae-b3ad-e5dde007a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:14.038146 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f55f9-4f7f-42ae-b3ad-e5dde007a485 admin admin] PATH_INFO: `/v3/projects/4c6d3164309848159fae27f17cd83d6e/users/d012725e1ef840e2aab619ff88e09a29/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:14.040069 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f55f9-4f7f-42ae-b3ad-e5dde007a485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6d3164309848159fae27f17cd83d6e, user_id=d012725e1ef840e2aab619ff88e09a29, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:14.042989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f55f9-4f7f-42ae-b3ad-e5dde007a485 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:14.096705 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1187/2370] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:45:14 2022] PUT /identity/v3/projects/4c6d3164309848159fae27f17cd83d6e/users/d012725e1ef840e2aab619ff88e09a29/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:14.110544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5cf18-3844-4916-82a7-b8f535dea8fd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:14.111032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5cf18-3844-4916-82a7-b8f535dea8fd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:14.111127 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5cf18-3844-4916-82a7-b8f535dea8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:14.168068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-dec5cf18-3844-4916-82a7-b8f535dea8fd None None] MFA Rules not processed for user `d012725e1ef840e2aab619ff88e09a29`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:14.169740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dec5cf18-3844-4916-82a7-b8f535dea8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:14.255302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1184/2371] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:14.271050 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f55f9-4f7f-42ae-b3ad-e5dde007a485 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:14.273041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-258f55f9-4f7f-42ae-b3ad-e5dde007a485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:14.370437 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f55f9-4f7f-42ae-b3ad-e5dde007a485 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:14.377310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b73af6-c8b9-4386-9cac-8d67aae52e3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:14.378273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b73af6-c8b9-4386-9cac-8d67aae52e3a service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:14.378758 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b73af6-c8b9-4386-9cac-8d67aae52e3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:14.379251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b73af6-c8b9-4386-9cac-8d67aae52e3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:14.381635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b4b73af6-c8b9-4386-9cac-8d67aae52e3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:14.486255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b73af6-c8b9-4386-9cac-8d67aae52e3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:14.501686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b73af6-c8b9-4386-9cac-8d67aae52e3a service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:14.514624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1188/2372] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:14.555632 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:15.298120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:15.972277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:16.046781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:16.625365 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5cf18-3844-4916-82a7-b8f535dea8fd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:16.638242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5cf18-3844-4916-82a7-b8f535dea8fd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:16.642575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520d422-df67-4011-b535-11f8d6f898cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:16.643515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520d422-df67-4011-b535-11f8d6f898cf service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:16.643796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520d422-df67-4011-b535-11f8d6f898cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:16.644090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520d422-df67-4011-b535-11f8d6f898cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:16.718242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520d422-df67-4011-b535-11f8d6f898cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:16.719729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520d422-df67-4011-b535-11f8d6f898cf service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:16.729391 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1185/2373] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:16.960393 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:17.321675 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:18.047119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:18.182529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b73af6-c8b9-4386-9cac-8d67aae52e3a service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:18.191990 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b73af6-c8b9-4386-9cac-8d67aae52e3a service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:18.198505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0b3e7-7ad6-43c7-8e6c-59042f5d48e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:18.198505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0b3e7-7ad6-43c7-8e6c-59042f5d48e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:18.198505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0b3e7-7ad6-43c7-8e6c-59042f5d48e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:18.198505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0b3e7-7ad6-43c7-8e6c-59042f5d48e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:18.206775 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0b3e7-7ad6-43c7-8e6c-59042f5d48e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:18.208204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0b3e7-7ad6-43c7-8e6c-59042f5d48e1 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:18.222126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1189/2374] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:18.344006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:18.897823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:18.910094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520d422-df67-4011-b535-11f8d6f898cf service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:18.911618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a520d422-df67-4011-b535-11f8d6f898cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:18.960827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:18.983334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520d422-df67-4011-b535-11f8d6f898cf service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:18.988069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e8122-84f9-4c6d-aa0a-24b55a209580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:18.988690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e8122-84f9-4c6d-aa0a-24b55a209580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:18.988967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e8122-84f9-4c6d-aa0a-24b55a209580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:18.989262 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e8122-84f9-4c6d-aa0a-24b55a209580 admin admin] PATH_INFO: `/v3/users/76dc2980604e459b82a4bdc9f3d1c6d2` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:18.990383 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e8122-84f9-4c6d-aa0a-24b55a209580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76dc2980604e459b82a4bdc9f3d1c6d2)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:18.992412 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e8122-84f9-4c6d-aa0a-24b55a209580 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:19.187677 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e35e8122-84f9-4c6d-aa0a-24b55a209580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76dc2980604e459b82a4bdc9f3d1c6d2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:19.189112 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e35e8122-84f9-4c6d-aa0a-24b55a209580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76dc2980604e459b82a4bdc9f3d1c6d2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:19.204813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e35e8122-84f9-4c6d-aa0a-24b55a209580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76dc2980604e459b82a4bdc9f3d1c6d2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:19.213993 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e35e8122-84f9-4c6d-aa0a-24b55a209580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76dc2980604e459b82a4bdc9f3d1c6d2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:19.215020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e35e8122-84f9-4c6d-aa0a-24b55a209580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76dc2980604e459b82a4bdc9f3d1c6d2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:19.235607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:19.314978 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1186/2375] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:18 2022] DELETE /identity/v3/users/76dc2980604e459b82a4bdc9f3d1c6d2 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:19.321363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d7129-c4b3-43ef-ba44-0244d38d0f7d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:19.321856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d7129-c4b3-43ef-ba44-0244d38d0f7d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:19.322143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d7129-c4b3-43ef-ba44-0244d38d0f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:19.345630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-364d7129-c4b3-43ef-ba44-0244d38d0f7d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:19.347608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-364d7129-c4b3-43ef-ba44-0244d38d0f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:19.432352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1190/2376] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:19.445245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e8122-84f9-4c6d-aa0a-24b55a209580 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:19.445245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e35e8122-84f9-4c6d-aa0a-24b55a209580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:19.514629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e8122-84f9-4c6d-aa0a-24b55a209580 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:19.521168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49d9a1-ecc0-42d9-8478-811819b3bdeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:19.521822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49d9a1-ecc0-42d9-8478-811819b3bdeb service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:19.522098 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49d9a1-ecc0-42d9-8478-811819b3bdeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:19.522364 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49d9a1-ecc0-42d9-8478-811819b3bdeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:19.537683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49d9a1-ecc0-42d9-8478-811819b3bdeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:19.551217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49d9a1-ecc0-42d9-8478-811819b3bdeb service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:19.575683 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:19.592766 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1187/2377] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:20.133930 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d7129-c4b3-43ef-ba44-0244d38d0f7d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:20.135761 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-364d7129-c4b3-43ef-ba44-0244d38d0f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:20.154870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d7129-c4b3-43ef-ba44-0244d38d0f7d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:20.159198 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:20.160060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:20.160348 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:20.160626 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c admin admin] PATH_INFO: `/v3/projects/aec08fc7b49f4d9eaa1a0e74faac5385` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:20.161834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec08fc7b49f4d9eaa1a0e74faac5385)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:20.163926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:20.223483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:20.296874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec08fc7b49f4d9eaa1a0e74faac5385', 'request_id': 'req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:20.405823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec08fc7b49f4d9eaa1a0e74faac5385', 'request_id': 'req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:20.412197 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec08fc7b49f4d9eaa1a0e74faac5385', 'request_id': 'req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:20.425525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c admin admin] The token cache is being invalidate because project aec08fc7b49f4d9eaa1a0e74faac5385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:20.425818 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:20.426480 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-5c7c55aa-b67e-4cf2-acd3-c3dd7fbcd00c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:20.428191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1191/2378] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:20 2022] DELETE /identity/v3/projects/aec08fc7b49f4d9eaa1a0e74faac5385 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:20.434236 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa76c7f-e8a0-4a1d-b730-bded667c05f2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:20.434765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa76c7f-e8a0-4a1d-b730-bded667c05f2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:20.435275 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa76c7f-e8a0-4a1d-b730-bded667c05f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:20.456660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0fa76c7f-e8a0-4a1d-b730-bded667c05f2 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:20.457906 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0fa76c7f-e8a0-4a1d-b730-bded667c05f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:20.518505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1188/2379] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:20.526280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06940d2-0131-48ac-a5cf-559ba2114921 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:20.526563 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06940d2-0131-48ac-a5cf-559ba2114921 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:20.526832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06940d2-0131-48ac-a5cf-559ba2114921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:20.547171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e06940d2-0131-48ac-a5cf-559ba2114921 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:20.548391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e06940d2-0131-48ac-a5cf-559ba2114921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:20.556356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1192/2380] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:20.560740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa76c7f-e8a0-4a1d-b730-bded667c05f2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:20.570812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa76c7f-e8a0-4a1d-b730-bded667c05f2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:20.576096 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd52e2-69d7-46ec-ac0b-8334f19a60c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:20.576670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd52e2-69d7-46ec-ac0b-8334f19a60c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:20.576946 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd52e2-69d7-46ec-ac0b-8334f19a60c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:20.577353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd52e2-69d7-46ec-ac0b-8334f19a60c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:20.577965 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd52e2-69d7-46ec-ac0b-8334f19a60c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:45:20.578269 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd52e2-69d7-46ec-ac0b-8334f19a60c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:20.579850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd52e2-69d7-46ec-ac0b-8334f19a60c0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:20.593596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1189/2381] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:45:20.597963 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06940d2-0131-48ac-a5cf-559ba2114921 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:20.607547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06940d2-0131-48ac-a5cf-559ba2114921 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:20.612362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674eaea-66ea-4ccd-81b5-9f98bc9cbbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:20.612961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674eaea-66ea-4ccd-81b5-9f98bc9cbbdb admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:20.613275 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674eaea-66ea-4ccd-81b5-9f98bc9cbbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:20.613560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674eaea-66ea-4ccd-81b5-9f98bc9cbbdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:20.614198 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674eaea-66ea-4ccd-81b5-9f98bc9cbbdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:20.616156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674eaea-66ea-4ccd-81b5-9f98bc9cbbdb admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:20.634198 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:20.693547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1193/2382] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:45:20 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:45:20.697865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd52e2-69d7-46ec-ac0b-8334f19a60c0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:20.709037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd52e2-69d7-46ec-ac0b-8334f19a60c0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:20.769755 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c64ea-3606-48fe-872a-21639c38a415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:20.770381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c64ea-3606-48fe-872a-21639c38a415 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:20.770650 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c64ea-3606-48fe-872a-21639c38a415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:20.770920 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c64ea-3606-48fe-872a-21639c38a415 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:20.771570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c64ea-3606-48fe-872a-21639c38a415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:20.773518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c64ea-3606-48fe-872a-21639c38a415 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:20.834711 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1190/2383] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:45:20 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:45:20.838812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674eaea-66ea-4ccd-81b5-9f98bc9cbbdb admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:20.850805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674eaea-66ea-4ccd-81b5-9f98bc9cbbdb admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:20.856853 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d111e-416d-4836-bedc-1e04dd6af134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:20.859079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d111e-416d-4836-bedc-1e04dd6af134 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:20.859079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d111e-416d-4836-bedc-1e04dd6af134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:20.859079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d111e-416d-4836-bedc-1e04dd6af134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:20.859079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d111e-416d-4836-bedc-1e04dd6af134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:20.860472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d111e-416d-4836-bedc-1e04dd6af134 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:20.870827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1194/2384] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:45:20.875009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c64ea-3606-48fe-872a-21639c38a415 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:20.884996 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c64ea-3606-48fe-872a-21639c38a415 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:20.889878 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515648b-a6bd-482d-9efe-f98a4367bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:20.890491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515648b-a6bd-482d-9efe-f98a4367bc6c admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:20.890768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515648b-a6bd-482d-9efe-f98a4367bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:20.891040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515648b-a6bd-482d-9efe-f98a4367bc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:20.891683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515648b-a6bd-482d-9efe-f98a4367bc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:20.893648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515648b-a6bd-482d-9efe-f98a4367bc6c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:20.907395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1191/2385] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:45:20.907395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:20.910739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d111e-416d-4836-bedc-1e04dd6af134 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:20.919945 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d111e-416d-4836-bedc-1e04dd6af134 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:20.924592 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741abb26-13e1-41fd-955d-636b852324a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:20.927965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741abb26-13e1-41fd-955d-636b852324a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:20.927965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741abb26-13e1-41fd-955d-636b852324a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:20.927965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741abb26-13e1-41fd-955d-636b852324a9 admin admin] PATH_INFO: `/v3/projects/f5523f905da4462097d37e351c6caaf3/users/1432f4baa35a4a43a6e69f0691b2aefe/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:20.947951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741abb26-13e1-41fd-955d-636b852324a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5523f905da4462097d37e351c6caaf3, user_id=1432f4baa35a4a43a6e69f0691b2aefe, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:20.951281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741abb26-13e1-41fd-955d-636b852324a9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:20.955903 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:21.017902 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1195/2386] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:45:20 2022] PUT /identity/v3/projects/f5523f905da4462097d37e351c6caaf3/users/1432f4baa35a4a43a6e69f0691b2aefe/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:21.028863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844cfa5-1ad2-4b37-ae0b-8d5db26fc2d2 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:21.029317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844cfa5-1ad2-4b37-ae0b-8d5db26fc2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:21.029599 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844cfa5-1ad2-4b37-ae0b-8d5db26fc2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:21.058441 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e844cfa5-1ad2-4b37-ae0b-8d5db26fc2d2 None None] MFA Rules not processed for user `1432f4baa35a4a43a6e69f0691b2aefe`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:21.059748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e844cfa5-1ad2-4b37-ae0b-8d5db26fc2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:21.124119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1192/2387] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:21.134882 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741abb26-13e1-41fd-955d-636b852324a9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:21.136612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-741abb26-13e1-41fd-955d-636b852324a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:21.195501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:21.196863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741abb26-13e1-41fd-955d-636b852324a9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:21.201613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051452a-e380-45be-b5e9-b5b3a4a49bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:21.202293 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051452a-e380-45be-b5e9-b5b3a4a49bae service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:21.202574 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051452a-e380-45be-b5e9-b5b3a4a49bae service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:21.202846 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051452a-e380-45be-b5e9-b5b3a4a49bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:21.212140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051452a-e380-45be-b5e9-b5b3a4a49bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:21.213780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051452a-e380-45be-b5e9-b5b3a4a49bae service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:21.224430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1196/2388] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:21.235187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:21.457481 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:21.903558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:21.961042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:22.571721 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:22.691799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:23.017931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:23.114628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:23.383209 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:23.562987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844cfa5-1ad2-4b37-ae0b-8d5db26fc2d2 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:23.568827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e844cfa5-1ad2-4b37-ae0b-8d5db26fc2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:23.612304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:23.631739 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844cfa5-1ad2-4b37-ae0b-8d5db26fc2d2 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:23.636755 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69942935-7a49-4d91-ae7a-9da906cd4207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:23.637426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69942935-7a49-4d91-ae7a-9da906cd4207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:23.637708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69942935-7a49-4d91-ae7a-9da906cd4207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:23.638008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69942935-7a49-4d91-ae7a-9da906cd4207 admin admin] PATH_INFO: `/v3/users/1445f70643164be9b5d6a3c9f0e9d451` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:23.639250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69942935-7a49-4d91-ae7a-9da906cd4207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1445f70643164be9b5d6a3c9f0e9d451)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:23.641139 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69942935-7a49-4d91-ae7a-9da906cd4207 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:23.788985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:23.825076 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-69942935-7a49-4d91-ae7a-9da906cd4207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1445f70643164be9b5d6a3c9f0e9d451'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:23.825797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-69942935-7a49-4d91-ae7a-9da906cd4207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1445f70643164be9b5d6a3c9f0e9d451'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:23.838638 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-69942935-7a49-4d91-ae7a-9da906cd4207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1445f70643164be9b5d6a3c9f0e9d451'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:23.845952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-69942935-7a49-4d91-ae7a-9da906cd4207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1445f70643164be9b5d6a3c9f0e9d451'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:23.846626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-69942935-7a49-4d91-ae7a-9da906cd4207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1445f70643164be9b5d6a3c9f0e9d451'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:23.897345 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1193/2389] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:23 2022] DELETE /identity/v3/users/1445f70643164be9b5d6a3c9f0e9d451 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:23.902133 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b3974-37cb-490b-82a4-5b551fc5c23b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:23.902524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b3974-37cb-490b-82a4-5b551fc5c23b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:23.902924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b3974-37cb-490b-82a4-5b551fc5c23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:23.931256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-448b3974-37cb-490b-82a4-5b551fc5c23b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:23.932476 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-448b3974-37cb-490b-82a4-5b551fc5c23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:24.005351 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1197/2390] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:24.014829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69942935-7a49-4d91-ae7a-9da906cd4207 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:24.016482 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-69942935-7a49-4d91-ae7a-9da906cd4207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:24.052668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:24.097036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69942935-7a49-4d91-ae7a-9da906cd4207 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:24.100688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c08b4-77ef-4592-88a6-f942138e1969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:24.101313 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c08b4-77ef-4592-88a6-f942138e1969 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:24.101589 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c08b4-77ef-4592-88a6-f942138e1969 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:24.101856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c08b4-77ef-4592-88a6-f942138e1969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:24.111092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c08b4-77ef-4592-88a6-f942138e1969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:24.114486 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c08b4-77ef-4592-88a6-f942138e1969 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:24.121725 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1194/2391] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:24.423462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:24.590489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b3974-37cb-490b-82a4-5b551fc5c23b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:24.592907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-448b3974-37cb-490b-82a4-5b551fc5c23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:24.606843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:24.608215 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b3974-37cb-490b-82a4-5b551fc5c23b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:24.612817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:24.613486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:24.613764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:24.614034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] PATH_INFO: `/v3/projects/9bc5356846b54cd9a7a6066fffe031bb` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:24.615347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc5356846b54cd9a7a6066fffe031bb)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:24.617404 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:24.744934 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc5356846b54cd9a7a6066fffe031bb', 'request_id': 'req-7c14a9e5-35ca-4739-b950-c792e8559561'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:24.834432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc5356846b54cd9a7a6066fffe031bb', 'request_id': 'req-7c14a9e5-35ca-4739-b950-c792e8559561'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:24.841070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc5356846b54cd9a7a6066fffe031bb', 'request_id': 'req-7c14a9e5-35ca-4739-b950-c792e8559561'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:24.860745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] The token cache is being invalidate because project 9bc5356846b54cd9a7a6066fffe031bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:24.861044 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:24.863264 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:24.865130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1198/2392] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:24 2022] DELETE /identity/v3/projects/9bc5356846b54cd9a7a6066fffe031bb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:24.869105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c08b4-77ef-4592-88a6-f942138e1969 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:24.880008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c08b4-77ef-4592-88a6-f942138e1969 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:24.947558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a0c49-999c-4cc2-a477-a9c2b80e4bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:24.947558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a0c49-999c-4cc2-a477-a9c2b80e4bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:24.947558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a0c49-999c-4cc2-a477-a9c2b80e4bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:24.947558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a0c49-999c-4cc2-a477-a9c2b80e4bee admin admin] PATH_INFO: `/v3/users/40ff878ab8d6471094243861359dd238` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:24.947876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a0c49-999c-4cc2-a477-a9c2b80e4bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ff878ab8d6471094243861359dd238)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:24.951607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a0c49-999c-4cc2-a477-a9c2b80e4bee admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:24.978242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:25.080638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:25.156668 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-018a0c49-999c-4cc2-a477-a9c2b80e4bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ff878ab8d6471094243861359dd238'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:25.157432 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-018a0c49-999c-4cc2-a477-a9c2b80e4bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ff878ab8d6471094243861359dd238'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:25.170298 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-018a0c49-999c-4cc2-a477-a9c2b80e4bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ff878ab8d6471094243861359dd238'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:25.177474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:25.179476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-018a0c49-999c-4cc2-a477-a9c2b80e4bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ff878ab8d6471094243861359dd238'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:25.180228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-018a0c49-999c-4cc2-a477-a9c2b80e4bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ff878ab8d6471094243861359dd238'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:25.247330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1195/2393] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:24 2022] DELETE /identity/v3/users/40ff878ab8d6471094243861359dd238 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:25.876115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:25.877579 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:25.890632 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14a9e5-35ca-4739-b950-c792e8559561 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:25.920712 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:25.957629 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:25.958454 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:25.958799 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:25.959176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] PATH_INFO: `/v3/projects/b483ddd82ea348a3a7bdcf7e41d76799` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:25.960567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b483ddd82ea348a3a7bdcf7e41d76799)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:25.963003 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:25.966610 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:26.090268 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b483ddd82ea348a3a7bdcf7e41d76799', 'request_id': 'req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:26.160843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b483ddd82ea348a3a7bdcf7e41d76799', 'request_id': 'req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:26.170816 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b483ddd82ea348a3a7bdcf7e41d76799', 'request_id': 'req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:26.182090 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] The token cache is being invalidate because project b483ddd82ea348a3a7bdcf7e41d76799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:26.182597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:26.186095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:26.189393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1199/2394] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:25 2022] DELETE /identity/v3/projects/b483ddd82ea348a3a7bdcf7e41d76799 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:26.193626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a0c49-999c-4cc2-a477-a9c2b80e4bee admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:26.195425 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-018a0c49-999c-4cc2-a477-a9c2b80e4bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:26.209821 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a0c49-999c-4cc2-a477-a9c2b80e4bee admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:26.283360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f583835-922b-4667-a195-f99274d92080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:26.284178 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f583835-922b-4667-a195-f99274d92080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:26.284708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f583835-922b-4667-a195-f99274d92080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:26.285225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f583835-922b-4667-a195-f99274d92080 admin admin] PATH_INFO: `/v3/users/d012725e1ef840e2aab619ff88e09a29` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:26.286586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f583835-922b-4667-a195-f99274d92080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d012725e1ef840e2aab619ff88e09a29)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:26.288613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f583835-922b-4667-a195-f99274d92080 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:26.478478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9f583835-922b-4667-a195-f99274d92080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd012725e1ef840e2aab619ff88e09a29'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:26.479077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9f583835-922b-4667-a195-f99274d92080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd012725e1ef840e2aab619ff88e09a29'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:26.493627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9f583835-922b-4667-a195-f99274d92080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd012725e1ef840e2aab619ff88e09a29'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:26.501979 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9f583835-922b-4667-a195-f99274d92080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd012725e1ef840e2aab619ff88e09a29'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:26.502716 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-9f583835-922b-4667-a195-f99274d92080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd012725e1ef840e2aab619ff88e09a29'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:26.578528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1196/2395] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:26 2022] DELETE /identity/v3/users/d012725e1ef840e2aab619ff88e09a29 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:45:26.670785 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:26.943468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:27.086375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:27.086375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:27.117156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47443b-71bb-4ecd-9c8c-bf0a161e3738 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:27.234398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5275030-e194-4981-9754-ab538b648f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:27.234963 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5275030-e194-4981-9754-ab538b648f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:27.235396 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5275030-e194-4981-9754-ab538b648f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:27.235861 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5275030-e194-4981-9754-ab538b648f72 admin admin] PATH_INFO: `/v3/projects/4c6d3164309848159fae27f17cd83d6e` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:27.237229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5275030-e194-4981-9754-ab538b648f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6d3164309848159fae27f17cd83d6e)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:27.239676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5275030-e194-4981-9754-ab538b648f72 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:27.395616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a5275030-e194-4981-9754-ab538b648f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6d3164309848159fae27f17cd83d6e', 'request_id': 'req-a5275030-e194-4981-9754-ab538b648f72'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:27.445593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a5275030-e194-4981-9754-ab538b648f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6d3164309848159fae27f17cd83d6e', 'request_id': 'req-a5275030-e194-4981-9754-ab538b648f72'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:27.452682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a5275030-e194-4981-9754-ab538b648f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6d3164309848159fae27f17cd83d6e', 'request_id': 'req-a5275030-e194-4981-9754-ab538b648f72'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:27.466377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a5275030-e194-4981-9754-ab538b648f72 admin admin] The token cache is being invalidate because project 4c6d3164309848159fae27f17cd83d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:27.466806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a5275030-e194-4981-9754-ab538b648f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:27.467636 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a5275030-e194-4981-9754-ab538b648f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:27.469127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1200/2396] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:27 2022] DELETE /identity/v3/projects/4c6d3164309848159fae27f17cd83d6e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:27.524272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:27.545234 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:28.024203 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:28.114579 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:33.141632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f583835-922b-4667-a195-f99274d92080 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:33.143200 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9f583835-922b-4667-a195-f99274d92080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:33.159013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f583835-922b-4667-a195-f99274d92080 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:33.218847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d2944-8a82-4603-99d9-83d22c4503b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:33.219393 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d2944-8a82-4603-99d9-83d22c4503b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:33.219673 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d2944-8a82-4603-99d9-83d22c4503b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:33.219947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d2944-8a82-4603-99d9-83d22c4503b2 admin admin] PATH_INFO: `/v3/users/1432f4baa35a4a43a6e69f0691b2aefe` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:33.221089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d2944-8a82-4603-99d9-83d22c4503b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1432f4baa35a4a43a6e69f0691b2aefe)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:33.223072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d2944-8a82-4603-99d9-83d22c4503b2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:33.379484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a82d2944-8a82-4603-99d9-83d22c4503b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1432f4baa35a4a43a6e69f0691b2aefe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:33.380141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a82d2944-8a82-4603-99d9-83d22c4503b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1432f4baa35a4a43a6e69f0691b2aefe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:33.392469 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a82d2944-8a82-4603-99d9-83d22c4503b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1432f4baa35a4a43a6e69f0691b2aefe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:33.399505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a82d2944-8a82-4603-99d9-83d22c4503b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1432f4baa35a4a43a6e69f0691b2aefe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:33.403535 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a82d2944-8a82-4603-99d9-83d22c4503b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1432f4baa35a4a43a6e69f0691b2aefe'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:33.485611 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1197/2397] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:33 2022] DELETE /identity/v3/users/1432f4baa35a4a43a6e69f0691b2aefe => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:33.490019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0a9d0-0e27-491a-b00d-b855dadffb71 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:33.490503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0a9d0-0e27-491a-b00d-b855dadffb71 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:33.490628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0a9d0-0e27-491a-b00d-b855dadffb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:33.510402 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ecb0a9d0-0e27-491a-b00d-b855dadffb71 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:33.512500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ecb0a9d0-0e27-491a-b00d-b855dadffb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:33.578113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1201/2398] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:33.587914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d2944-8a82-4603-99d9-83d22c4503b2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:33.589397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a82d2944-8a82-4603-99d9-83d22c4503b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:33.650460 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d2944-8a82-4603-99d9-83d22c4503b2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:33.654109 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469a6b1-477b-4c50-939e-3eabb2797d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:33.655374 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469a6b1-477b-4c50-939e-3eabb2797d06 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:33.655665 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469a6b1-477b-4c50-939e-3eabb2797d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:33.655937 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469a6b1-477b-4c50-939e-3eabb2797d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:33.664840 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469a6b1-477b-4c50-939e-3eabb2797d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:33.666549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469a6b1-477b-4c50-939e-3eabb2797d06 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:33.676692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1198/2399] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:34.069421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc9e67-647f-4ae5-b816-a0e3f9434482 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:34.069694 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc9e67-647f-4ae5-b816-a0e3f9434482 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:34.069970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc9e67-647f-4ae5-b816-a0e3f9434482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:34.099795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-40dc9e67-647f-4ae5-b816-a0e3f9434482 None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:34.100913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-40dc9e67-647f-4ae5-b816-a0e3f9434482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:34.104538 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469a6b1-477b-4c50-939e-3eabb2797d06 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:34.106186 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7469a6b1-477b-4c50-939e-3eabb2797d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:34.124632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469a6b1-477b-4c50-939e-3eabb2797d06 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:34.129732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ee12f-674f-4b22-b5d3-15b734611f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:34.130364 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ee12f-674f-4b22-b5d3-15b734611f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:34.130640 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ee12f-674f-4b22-b5d3-15b734611f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:34.130906 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ee12f-674f-4b22-b5d3-15b734611f87 admin admin] PATH_INFO: `/v3/projects/f5523f905da4462097d37e351c6caaf3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:34.132172 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ee12f-674f-4b22-b5d3-15b734611f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5523f905da4462097d37e351c6caaf3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:34.135784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ee12f-674f-4b22-b5d3-15b734611f87 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:34.147754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:34.181163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1202/2400] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:45:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:34.229941 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc9e67-647f-4ae5-b816-a0e3f9434482 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:34.231493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-40dc9e67-647f-4ae5-b816-a0e3f9434482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:34.305010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc9e67-647f-4ae5-b816-a0e3f9434482 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:34.310076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eea8a6-c798-4f9b-8338-b06c5efbb903 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:34.311327 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea8a6-c798-4f9b-8338-b06c5efbb903 service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:34.311645 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea8a6-c798-4f9b-8338-b06c5efbb903 service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:34.311886 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea8a6-c798-4f9b-8338-b06c5efbb903 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:34.320542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eea8a6-c798-4f9b-8338-b06c5efbb903 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:34.322146 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eea8a6-c798-4f9b-8338-b06c5efbb903 service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:34.327976 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a24ee12f-674f-4b22-b5d3-15b734611f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5523f905da4462097d37e351c6caaf3', 'request_id': 'req-a24ee12f-674f-4b22-b5d3-15b734611f87'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:34.331249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1203/2401] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:45:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 04:45:34.355927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d23a3e-cfeb-4c11-813d-7e0b696ed828 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:34.356312 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d23a3e-cfeb-4c11-813d-7e0b696ed828 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:34.356499 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d23a3e-cfeb-4c11-813d-7e0b696ed828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:34.377936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-06d23a3e-cfeb-4c11-813d-7e0b696ed828 None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:34.379202 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-06d23a3e-cfeb-4c11-813d-7e0b696ed828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:34.413546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a24ee12f-674f-4b22-b5d3-15b734611f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5523f905da4462097d37e351c6caaf3', 'request_id': 'req-a24ee12f-674f-4b22-b5d3-15b734611f87'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:34.417181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:34.427009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a24ee12f-674f-4b22-b5d3-15b734611f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5523f905da4462097d37e351c6caaf3', 'request_id': 'req-a24ee12f-674f-4b22-b5d3-15b734611f87'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:34.446590 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a24ee12f-674f-4b22-b5d3-15b734611f87 admin admin] The token cache is being invalidate because project f5523f905da4462097d37e351c6caaf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:34.447003 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a24ee12f-674f-4b22-b5d3-15b734611f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:34.448798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a24ee12f-674f-4b22-b5d3-15b734611f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:34.455332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1199/2402] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:34 2022] DELETE /identity/v3/projects/f5523f905da4462097d37e351c6caaf3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:45:34.457316 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7b488-c74d-4c16-84db-1d21378b9692 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:34.457844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7b488-c74d-4c16-84db-1d21378b9692 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:34.458354 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7b488-c74d-4c16-84db-1d21378b9692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:34.462285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1204/2403] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:45:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:45:34.479495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d23a3e-cfeb-4c11-813d-7e0b696ed828 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:34.483006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-06d23a3e-cfeb-4c11-813d-7e0b696ed828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:34.483619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-14a7b488-c74d-4c16-84db-1d21378b9692 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:34.484892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-14a7b488-c74d-4c16-84db-1d21378b9692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:34.578889 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1200/2404] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:34.587428 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d23a3e-cfeb-4c11-813d-7e0b696ed828 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:34.587949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e55605-3521-4f8e-8ad9-ec15680cf6d1 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:34.588935 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e55605-3521-4f8e-8ad9-ec15680cf6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:34.589240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e55605-3521-4f8e-8ad9-ec15680cf6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:34.599152 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed348998-9d28-48df-a04e-e6702d5bb440 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:34.600024 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed348998-9d28-48df-a04e-e6702d5bb440 service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:34.600415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed348998-9d28-48df-a04e-e6702d5bb440 service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:34.600572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed348998-9d28-48df-a04e-e6702d5bb440 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:34.612726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed348998-9d28-48df-a04e-e6702d5bb440 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:34.614398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed348998-9d28-48df-a04e-e6702d5bb440 service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:34.617087 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-84e55605-3521-4f8e-8ad9-ec15680cf6d1 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:34.618892 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-84e55605-3521-4f8e-8ad9-ec15680cf6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:34.624561 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1205/2405] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:45:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 04:45:34.630744 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1201/2406] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:34.636135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed348998-9d28-48df-a04e-e6702d5bb440 service swift] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:34.649560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed348998-9d28-48df-a04e-e6702d5bb440 service swift] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:34.657184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfa448-db52-4c43-a9c7-4e9cd10b9b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:34.658214 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfa448-db52-4c43-a9c7-4e9cd10b9b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:34.659130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfa448-db52-4c43-a9c7-4e9cd10b9b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:34.659667 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfa448-db52-4c43-a9c7-4e9cd10b9b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:34.660488 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfa448-db52-4c43-a9c7-4e9cd10b9b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:45:34.660946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfa448-db52-4c43-a9c7-4e9cd10b9b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:34.663053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfa448-db52-4c43-a9c7-4e9cd10b9b91 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:34.683150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1206/2407] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:45:34.688896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e55605-3521-4f8e-8ad9-ec15680cf6d1 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:34.700596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e55605-3521-4f8e-8ad9-ec15680cf6d1 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:34.707582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e285fef-bf39-41b6-a92a-bec5010feae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:34.708467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e285fef-bf39-41b6-a92a-bec5010feae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:34.708928 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e285fef-bf39-41b6-a92a-bec5010feae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:34.709453 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e285fef-bf39-41b6-a92a-bec5010feae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:34.710305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e285fef-bf39-41b6-a92a-bec5010feae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:34.712288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e285fef-bf39-41b6-a92a-bec5010feae5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:34.805270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1202/2408] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:45:34 2022] POST /identity/v3/projects => generated 397 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:45:34.807403 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfa448-db52-4c43-a9c7-4e9cd10b9b91 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:34.819824 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfa448-db52-4c43-a9c7-4e9cd10b9b91 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:34.893215 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7a809-9458-42e9-9099-d7e2f0e4dda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:34.893914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7a809-9458-42e9-9099-d7e2f0e4dda9 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:34.894301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7a809-9458-42e9-9099-d7e2f0e4dda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:34.894659 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7a809-9458-42e9-9099-d7e2f0e4dda9 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:34.895395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7a809-9458-42e9-9099-d7e2f0e4dda9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:34.897604 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7a809-9458-42e9-9099-d7e2f0e4dda9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:35.003647 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1207/2409] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:45:34 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:45:35.007526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e285fef-bf39-41b6-a92a-bec5010feae5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:35.019350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e285fef-bf39-41b6-a92a-bec5010feae5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:35.024926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a5cc6-4a92-4e75-b818-242ead462db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:35.025590 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a5cc6-4a92-4e75-b818-242ead462db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:35.025921 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a5cc6-4a92-4e75-b818-242ead462db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:35.026196 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a5cc6-4a92-4e75-b818-242ead462db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:35.026926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a5cc6-4a92-4e75-b818-242ead462db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:35.028572 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a5cc6-4a92-4e75-b818-242ead462db6 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:35.040636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1203/2410] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:45:35.045702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7a809-9458-42e9-9099-d7e2f0e4dda9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:35.058265 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7a809-9458-42e9-9099-d7e2f0e4dda9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:35.064560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcd4a6-bf6d-4f9e-83f9-c57a6438d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:35.065184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcd4a6-bf6d-4f9e-83f9-c57a6438d775 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:35.065538 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcd4a6-bf6d-4f9e-83f9-c57a6438d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:35.066033 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcd4a6-bf6d-4f9e-83f9-c57a6438d775 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:35.066970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcd4a6-bf6d-4f9e-83f9-c57a6438d775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:35.068661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcd4a6-bf6d-4f9e-83f9-c57a6438d775 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:35.090034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1208/2411] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:45:35.093342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a5cc6-4a92-4e75-b818-242ead462db6 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:35.104212 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a5cc6-4a92-4e75-b818-242ead462db6 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:35.110197 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4933b-dd27-4740-a3fb-99a3ad9e7b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:35.110905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4933b-dd27-4740-a3fb-99a3ad9e7b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:35.113333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4933b-dd27-4740-a3fb-99a3ad9e7b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:35.113333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4933b-dd27-4740-a3fb-99a3ad9e7b40 admin admin] PATH_INFO: `/v3/projects/1a1e3ee93dc1437eb3b356725e1a5b74/users/c71734641d8d4e9eb0477853b6182d18/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:35.131514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4933b-dd27-4740-a3fb-99a3ad9e7b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1e3ee93dc1437eb3b356725e1a5b74, user_id=c71734641d8d4e9eb0477853b6182d18, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:35.134399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4933b-dd27-4740-a3fb-99a3ad9e7b40 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:35.207389 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1204/2412] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:45:35 2022] PUT /identity/v3/projects/1a1e3ee93dc1437eb3b356725e1a5b74/users/c71734641d8d4e9eb0477853b6182d18/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:45:35.218877 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487442-4ad1-4107-84b9-2e00151bd170 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:35.219174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487442-4ad1-4107-84b9-2e00151bd170 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:35.219457 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487442-4ad1-4107-84b9-2e00151bd170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:35.253691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-a0487442-4ad1-4107-84b9-2e00151bd170 None None] MFA Rules not processed for user `c71734641d8d4e9eb0477853b6182d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:35.254974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a0487442-4ad1-4107-84b9-2e00151bd170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:35.281822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:35.346727 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1209/2413] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:35.370908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4933b-dd27-4740-a3fb-99a3ad9e7b40 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:35.373300 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b1a4933b-dd27-4740-a3fb-99a3ad9e7b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:35.432630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:35.455417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4933b-dd27-4740-a3fb-99a3ad9e7b40 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:35.459853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd2cbe-a132-42b9-b855-cdb895681e78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:35.460666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd2cbe-a132-42b9-b855-cdb895681e78 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:35.461136 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd2cbe-a132-42b9-b855-cdb895681e78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:35.461576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd2cbe-a132-42b9-b855-cdb895681e78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:35.473140 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd2cbe-a132-42b9-b855-cdb895681e78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:35.474931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd2cbe-a132-42b9-b855-cdb895681e78 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:35.489711 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1205/2414] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:35 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:35.921187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f87c7-bd90-4ab6-b0b2-7417228e4d20 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:35.921187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f87c7-bd90-4ab6-b0b2-7417228e4d20 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:35.938126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f87c7-bd90-4ab6-b0b2-7417228e4d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:35.952652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-940f87c7-bd90-4ab6-b0b2-7417228e4d20 None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:35.955334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-940f87c7-bd90-4ab6-b0b2-7417228e4d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:36.044255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1210/2415] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 31 04:45:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:36.057980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd2cbe-a132-42b9-b855-cdb895681e78 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:36.181449 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd2cbe-a132-42b9-b855-cdb895681e78 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:36.190724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b63f6-645f-4586-a2ac-4b5d7d5f3620 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:36.191332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b63f6-645f-4586-a2ac-4b5d7d5f3620 service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:36.191616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b63f6-645f-4586-a2ac-4b5d7d5f3620 service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:36.191889 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b63f6-645f-4586-a2ac-4b5d7d5f3620 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:36.208026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b63f6-645f-4586-a2ac-4b5d7d5f3620 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:36.210867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b63f6-645f-4586-a2ac-4b5d7d5f3620 service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:36.226303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1206/2416] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:45:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:37.006638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124353c-7075-45fd-a4cd-a0c6f6e48177 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:37.007258 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124353c-7075-45fd-a4cd-a0c6f6e48177 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:37.007426 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124353c-7075-45fd-a4cd-a0c6f6e48177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:37.032834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3124353c-7075-45fd-a4cd-a0c6f6e48177 None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:37.034726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3124353c-7075-45fd-a4cd-a0c6f6e48177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:37.043770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1211/2417] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:45:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:45:37.058804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b63f6-645f-4586-a2ac-4b5d7d5f3620 service swift] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:37.072925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b63f6-645f-4586-a2ac-4b5d7d5f3620 service swift] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:37.080308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c26648-4a05-4c9c-9d06-429bd979c3aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:37.086028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c26648-4a05-4c9c-9d06-429bd979c3aa service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:37.086028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c26648-4a05-4c9c-9d06-429bd979c3aa service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:37.086028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c26648-4a05-4c9c-9d06-429bd979c3aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:37.092595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c26648-4a05-4c9c-9d06-429bd979c3aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:37.094483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c26648-4a05-4c9c-9d06-429bd979c3aa service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:37.108749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1207/2418] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:45:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:37.795661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0627a91-5dfc-4a3d-bf31-b137e74700ae None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:37.795947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0627a91-5dfc-4a3d-bf31-b137e74700ae None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:37.796223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0627a91-5dfc-4a3d-bf31-b137e74700ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:37.817093 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c0627a91-5dfc-4a3d-bf31-b137e74700ae None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:37.818340 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c0627a91-5dfc-4a3d-bf31-b137e74700ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:37.831737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1212/2419] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 31 04:45:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:37.843173 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c26648-4a05-4c9c-9d06-429bd979c3aa service swift] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:37.854720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c26648-4a05-4c9c-9d06-429bd979c3aa service swift] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:37.879542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44caae-3de4-410b-87da-47642bc44dd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:37.880457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44caae-3de4-410b-87da-47642bc44dd1 service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:37.881170 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44caae-3de4-410b-87da-47642bc44dd1 service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:37.881971 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44caae-3de4-410b-87da-47642bc44dd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:37.898417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44caae-3de4-410b-87da-47642bc44dd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:37.900133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44caae-3de4-410b-87da-47642bc44dd1 service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:37.910660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1208/2420] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:45:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:40.892541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0627a91-5dfc-4a3d-bf31-b137e74700ae None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:40.902339 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c0627a91-5dfc-4a3d-bf31-b137e74700ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:41.087413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0627a91-5dfc-4a3d-bf31-b137e74700ae None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:41.092923 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a46aa-260a-4aca-a1cc-962a3c4688b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:41.093623 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a46aa-260a-4aca-a1cc-962a3c4688b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:41.093912 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a46aa-260a-4aca-a1cc-962a3c4688b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:41.094187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a46aa-260a-4aca-a1cc-962a3c4688b1 admin admin] PATH_INFO: `/v3/users/228a98c7d9b44f26b8afdac5a9badf1a` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:41.095542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a46aa-260a-4aca-a1cc-962a3c4688b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=228a98c7d9b44f26b8afdac5a9badf1a)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:41.098448 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a46aa-260a-4aca-a1cc-962a3c4688b1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:41.313909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9f2a46aa-260a-4aca-a1cc-962a3c4688b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228a98c7d9b44f26b8afdac5a9badf1a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:41.318858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:41.331906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9f2a46aa-260a-4aca-a1cc-962a3c4688b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228a98c7d9b44f26b8afdac5a9badf1a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:41.389377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9f2a46aa-260a-4aca-a1cc-962a3c4688b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228a98c7d9b44f26b8afdac5a9badf1a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:41.397598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9f2a46aa-260a-4aca-a1cc-962a3c4688b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228a98c7d9b44f26b8afdac5a9badf1a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:41.398262 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-9f2a46aa-260a-4aca-a1cc-962a3c4688b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228a98c7d9b44f26b8afdac5a9badf1a'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:41.404759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1213/2421] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:40 2022] DELETE /identity/v3/users/228a98c7d9b44f26b8afdac5a9badf1a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:41.409101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b67b-46d6-4c75-baa4-2d9298c36f55 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:41.409665 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b67b-46d6-4c75-baa4-2d9298c36f55 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:41.409665 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b67b-46d6-4c75-baa4-2d9298c36f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:41.432361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2476b67b-46d6-4c75-baa4-2d9298c36f55 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:41.433933 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2476b67b-46d6-4c75-baa4-2d9298c36f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:41.505840 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1209/2422] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:41.516438 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a46aa-260a-4aca-a1cc-962a3c4688b1 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:41.518079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9f2a46aa-260a-4aca-a1cc-962a3c4688b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:41.577761 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a46aa-260a-4aca-a1cc-962a3c4688b1 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:41.581419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54487dcd-6f0e-4c9d-9d31-3dadc0f78e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:41.582028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54487dcd-6f0e-4c9d-9d31-3dadc0f78e24 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:41.582344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54487dcd-6f0e-4c9d-9d31-3dadc0f78e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:41.582596 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54487dcd-6f0e-4c9d-9d31-3dadc0f78e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:41.594014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54487dcd-6f0e-4c9d-9d31-3dadc0f78e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:41.595515 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54487dcd-6f0e-4c9d-9d31-3dadc0f78e24 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:41.605770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1214/2423] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:41.885124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476b67b-46d6-4c75-baa4-2d9298c36f55 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:41.885124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2476b67b-46d6-4c75-baa4-2d9298c36f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:41.895916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476b67b-46d6-4c75-baa4-2d9298c36f55 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:41.901086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2a1ba-052c-42e4-9a91-b212610deac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:41.901654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a1ba-052c-42e4-9a91-b212610deac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:41.902109 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a1ba-052c-42e4-9a91-b212610deac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:41.905444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a1ba-052c-42e4-9a91-b212610deac4 admin admin] PATH_INFO: `/v3/projects/67678a0aa5ee4f6d96e9589c50c967fd` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:41.905444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2a1ba-052c-42e4-9a91-b212610deac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67678a0aa5ee4f6d96e9589c50c967fd)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:41.905958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2a1ba-052c-42e4-9a91-b212610deac4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:42.042685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54487dcd-6f0e-4c9d-9d31-3dadc0f78e24 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:42.052857 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-54487dcd-6f0e-4c9d-9d31-3dadc0f78e24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:42.068043 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:42.069489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54487dcd-6f0e-4c9d-9d31-3dadc0f78e24 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:42.099177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-03f2a1ba-052c-42e4-9a91-b212610deac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67678a0aa5ee4f6d96e9589c50c967fd', 'request_id': 'req-03f2a1ba-052c-42e4-9a91-b212610deac4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:42.161140 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e20bc-cd0e-45a4-b21e-9b42a09f4eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:42.162138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e20bc-cd0e-45a4-b21e-9b42a09f4eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:42.162435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e20bc-cd0e-45a4-b21e-9b42a09f4eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:42.162713 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e20bc-cd0e-45a4-b21e-9b42a09f4eeb admin admin] PATH_INFO: `/v3/users/c71734641d8d4e9eb0477853b6182d18` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:42.164065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e20bc-cd0e-45a4-b21e-9b42a09f4eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71734641d8d4e9eb0477853b6182d18)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:42.166721 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e20bc-cd0e-45a4-b21e-9b42a09f4eeb admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:42.172478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-03f2a1ba-052c-42e4-9a91-b212610deac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67678a0aa5ee4f6d96e9589c50c967fd', 'request_id': 'req-03f2a1ba-052c-42e4-9a91-b212610deac4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:42.181244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-03f2a1ba-052c-42e4-9a91-b212610deac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67678a0aa5ee4f6d96e9589c50c967fd', 'request_id': 'req-03f2a1ba-052c-42e4-9a91-b212610deac4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:42.205638 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-03f2a1ba-052c-42e4-9a91-b212610deac4 admin admin] The token cache is being invalidate because project 67678a0aa5ee4f6d96e9589c50c967fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:42.209572 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-03f2a1ba-052c-42e4-9a91-b212610deac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:42.210341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-03f2a1ba-052c-42e4-9a91-b212610deac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:42.219671 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1210/2424] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:41 2022] DELETE /identity/v3/projects/67678a0aa5ee4f6d96e9589c50c967fd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:42.346890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-151e20bc-cd0e-45a4-b21e-9b42a09f4eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71734641d8d4e9eb0477853b6182d18'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:42.374602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-151e20bc-cd0e-45a4-b21e-9b42a09f4eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71734641d8d4e9eb0477853b6182d18'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:42.447309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-151e20bc-cd0e-45a4-b21e-9b42a09f4eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71734641d8d4e9eb0477853b6182d18'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:42.452716 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:42.463310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-151e20bc-cd0e-45a4-b21e-9b42a09f4eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71734641d8d4e9eb0477853b6182d18'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:42.464611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-151e20bc-cd0e-45a4-b21e-9b42a09f4eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71734641d8d4e9eb0477853b6182d18'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:42.499774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1215/2425] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:42 2022] DELETE /identity/v3/users/c71734641d8d4e9eb0477853b6182d18 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:42.501799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cc19d-93e8-4310-9a84-123a62041999 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:42.502349 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cc19d-93e8-4310-9a84-123a62041999 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:42.502880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cc19d-93e8-4310-9a84-123a62041999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:42.540851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-eb7cc19d-93e8-4310-9a84-123a62041999 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:42.542962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eb7cc19d-93e8-4310-9a84-123a62041999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:42.631245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1211/2426] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:42.641872 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e20bc-cd0e-45a4-b21e-9b42a09f4eeb admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:42.643635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-151e20bc-cd0e-45a4-b21e-9b42a09f4eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:42.732721 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e20bc-cd0e-45a4-b21e-9b42a09f4eeb admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:42.736609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc651590-f2bb-42f8-800f-57778e76e993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:42.737321 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc651590-f2bb-42f8-800f-57778e76e993 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:42.737783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc651590-f2bb-42f8-800f-57778e76e993 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:42.738115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc651590-f2bb-42f8-800f-57778e76e993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:42.751459 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc651590-f2bb-42f8-800f-57778e76e993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:42.753101 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc651590-f2bb-42f8-800f-57778e76e993 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:42.766867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1216/2427] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:45:43.328383 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cc19d-93e8-4310-9a84-123a62041999 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:43.330143 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eb7cc19d-93e8-4310-9a84-123a62041999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:43.355038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cc19d-93e8-4310-9a84-123a62041999 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:43.366221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:43.366882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:43.367133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:43.367407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] PATH_INFO: `/v3/projects/1a1e3ee93dc1437eb3b356725e1a5b74` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:43.368570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1e3ee93dc1437eb3b356725e1a5b74)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:43.370547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:43.477597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1e3ee93dc1437eb3b356725e1a5b74', 'request_id': 'req-64562afd-36fe-4149-a249-deb24cf28267'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:43.543725 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1e3ee93dc1437eb3b356725e1a5b74', 'request_id': 'req-64562afd-36fe-4149-a249-deb24cf28267'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:43.552560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1e3ee93dc1437eb3b356725e1a5b74', 'request_id': 'req-64562afd-36fe-4149-a249-deb24cf28267'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:43.567546 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] The token cache is being invalidate because project 1a1e3ee93dc1437eb3b356725e1a5b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:43.567856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:43.568704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:43.577312 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1212/2428] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:43 2022] DELETE /identity/v3/projects/1a1e3ee93dc1437eb3b356725e1a5b74 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:51.879589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8622b-9301-43e2-9881-62d3b84e5129 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:51.880121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8622b-9301-43e2-9881-62d3b84e5129 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:51.880121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8622b-9301-43e2-9881-62d3b84e5129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:51.899557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f2b8622b-9301-43e2-9881-62d3b84e5129 None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:51.900771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f2b8622b-9301-43e2-9881-62d3b84e5129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:51.956508 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1217/2429] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 31 04:45:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:51.969088 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:51.970524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:52.019014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:52.038544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64562afd-36fe-4149-a249-deb24cf28267 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:52.043789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ea046-74e0-4443-9381-3ba65963c8c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:52.044390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea046-74e0-4443-9381-3ba65963c8c3 service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:52.045161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea046-74e0-4443-9381-3ba65963c8c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:52.045632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea046-74e0-4443-9381-3ba65963c8c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:52.053734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ea046-74e0-4443-9381-3ba65963c8c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:52.055311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ea046-74e0-4443-9381-3ba65963c8c3 service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:52.064522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1213/2430] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:45:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:45:54.835291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8622b-9301-43e2-9881-62d3b84e5129 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:54.836863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f2b8622b-9301-43e2-9881-62d3b84e5129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:54.909353 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8622b-9301-43e2-9881-62d3b84e5129 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:54.916230 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025d823-0655-4d0c-a396-687ced89a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:54.917134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d823-0655-4d0c-a396-687ced89a631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:54.921853 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d823-0655-4d0c-a396-687ced89a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:54.921853 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d823-0655-4d0c-a396-687ced89a631 admin admin] PATH_INFO: `/v3/users/e91b32ab25854882af7bc313fdd342b2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:54.921853 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025d823-0655-4d0c-a396-687ced89a631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91b32ab25854882af7bc313fdd342b2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:54.921853 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025d823-0655-4d0c-a396-687ced89a631 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:55.065966 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:55.070860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a025d823-0655-4d0c-a396-687ced89a631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91b32ab25854882af7bc313fdd342b2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:55.083206 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a025d823-0655-4d0c-a396-687ced89a631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91b32ab25854882af7bc313fdd342b2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:55.159789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a025d823-0655-4d0c-a396-687ced89a631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91b32ab25854882af7bc313fdd342b2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:55.167499 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a025d823-0655-4d0c-a396-687ced89a631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91b32ab25854882af7bc313fdd342b2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:55.169440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a025d823-0655-4d0c-a396-687ced89a631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91b32ab25854882af7bc313fdd342b2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:55.174092 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1218/2431] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:45:54 2022] DELETE /identity/v3/users/e91b32ab25854882af7bc313fdd342b2 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:55.435472 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ea046-74e0-4443-9381-3ba65963c8c3 service swift] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:55.446967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ea046-74e0-4443-9381-3ba65963c8c3 service swift] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:55.505048 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d9cd9-9793-48d5-a146-dd639af3abfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:55.505741 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9cd9-9793-48d5-a146-dd639af3abfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:55.506027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9cd9-9793-48d5-a146-dd639af3abfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:55.506302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9cd9-9793-48d5-a146-dd639af3abfc admin admin] PATH_INFO: `/v3/projects/2285f4d7bd174616aa0b9f7de08ca7f9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:55.507454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d9cd9-9793-48d5-a146-dd639af3abfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2285f4d7bd174616aa0b9f7de08ca7f9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:55.509476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d9cd9-9793-48d5-a146-dd639af3abfc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:55.611962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ef3d9cd9-9793-48d5-a146-dd639af3abfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2285f4d7bd174616aa0b9f7de08ca7f9', 'request_id': 'req-ef3d9cd9-9793-48d5-a146-dd639af3abfc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:55.656837 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ef3d9cd9-9793-48d5-a146-dd639af3abfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2285f4d7bd174616aa0b9f7de08ca7f9', 'request_id': 'req-ef3d9cd9-9793-48d5-a146-dd639af3abfc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:55.662596 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ef3d9cd9-9793-48d5-a146-dd639af3abfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2285f4d7bd174616aa0b9f7de08ca7f9', 'request_id': 'req-ef3d9cd9-9793-48d5-a146-dd639af3abfc'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:55.673806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ef3d9cd9-9793-48d5-a146-dd639af3abfc admin admin] The token cache is being invalidate because project 2285f4d7bd174616aa0b9f7de08ca7f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:45:55.674090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ef3d9cd9-9793-48d5-a146-dd639af3abfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:55.674718 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ef3d9cd9-9793-48d5-a146-dd639af3abfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:45:55.676192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1214/2432] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:45:55 2022] DELETE /identity/v3/projects/2285f4d7bd174616aa0b9f7de08ca7f9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:45:55.681238 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc9a03-6de3-4db2-9981-e26da43d4a82 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:55.681474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc9a03-6de3-4db2-9981-e26da43d4a82 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:55.681748 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc9a03-6de3-4db2-9981-e26da43d4a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:55.700890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-71fc9a03-6de3-4db2-9981-e26da43d4a82 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:55.702101 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-71fc9a03-6de3-4db2-9981-e26da43d4a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:55.759696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1219/2433] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:55.768759 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac82f5-b671-4888-a39a-9f0715c34e4c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:55.769050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac82f5-b671-4888-a39a-9f0715c34e4c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:55.769361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac82f5-b671-4888-a39a-9f0715c34e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:55.789807 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1bac82f5-b671-4888-a39a-9f0715c34e4c None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:55.791032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1bac82f5-b671-4888-a39a-9f0715c34e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:55.799297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1215/2434] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:55.803482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc9a03-6de3-4db2-9981-e26da43d4a82 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:55.813703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc9a03-6de3-4db2-9981-e26da43d4a82 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:55.818251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36ef8c-a90a-40fc-aeb9-71d6f1efc666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:55.818840 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ef8c-a90a-40fc-aeb9-71d6f1efc666 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:55.819120 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ef8c-a90a-40fc-aeb9-71d6f1efc666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:55.819394 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ef8c-a90a-40fc-aeb9-71d6f1efc666 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:55.820044 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36ef8c-a90a-40fc-aeb9-71d6f1efc666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:45:55.820374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36ef8c-a90a-40fc-aeb9-71d6f1efc666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:55.822011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36ef8c-a90a-40fc-aeb9-71d6f1efc666 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:55.834357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1220/2435] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:45:55.838346 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac82f5-b671-4888-a39a-9f0715c34e4c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:55.848138 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac82f5-b671-4888-a39a-9f0715c34e4c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:55.852710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe32de0-0bf5-4afe-b0e6-077b9e0da6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:55.853329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe32de0-0bf5-4afe-b0e6-077b9e0da6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:55.853605 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe32de0-0bf5-4afe-b0e6-077b9e0da6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:55.853876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe32de0-0bf5-4afe-b0e6-077b9e0da6f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:55.854505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe32de0-0bf5-4afe-b0e6-077b9e0da6f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:55.856460 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe32de0-0bf5-4afe-b0e6-077b9e0da6f9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:55.944078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1216/2436] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:45:55 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:45:55.948189 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36ef8c-a90a-40fc-aeb9-71d6f1efc666 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:55.959572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36ef8c-a90a-40fc-aeb9-71d6f1efc666 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:56.016372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fa3e1-b173-4133-8835-49824cd142ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:56.016958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fa3e1-b173-4133-8835-49824cd142ba admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:56.017373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fa3e1-b173-4133-8835-49824cd142ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:56.017646 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fa3e1-b173-4133-8835-49824cd142ba admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:56.018277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fa3e1-b173-4133-8835-49824cd142ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:56.020163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fa3e1-b173-4133-8835-49824cd142ba admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:56.100538 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1221/2437] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:45:55 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:45:56.101806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe32de0-0bf5-4afe-b0e6-077b9e0da6f9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:56.112732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe32de0-0bf5-4afe-b0e6-077b9e0da6f9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:56.117908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69429f03-f1f4-4832-9f9a-ae835d4cc96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:56.118548 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69429f03-f1f4-4832-9f9a-ae835d4cc96d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:56.118829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69429f03-f1f4-4832-9f9a-ae835d4cc96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:56.119104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69429f03-f1f4-4832-9f9a-ae835d4cc96d admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:56.119840 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69429f03-f1f4-4832-9f9a-ae835d4cc96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:56.121614 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69429f03-f1f4-4832-9f9a-ae835d4cc96d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:56.133158 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1217/2438] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:45:56.137362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fa3e1-b173-4133-8835-49824cd142ba admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:56.148454 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fa3e1-b173-4133-8835-49824cd142ba admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:56.153225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a15c7-4ad1-4a2f-833f-42f5e422df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:56.153845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a15c7-4ad1-4a2f-833f-42f5e422df0b admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:56.154131 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a15c7-4ad1-4a2f-833f-42f5e422df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:56.154408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a15c7-4ad1-4a2f-833f-42f5e422df0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:56.155088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a15c7-4ad1-4a2f-833f-42f5e422df0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:56.156783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a15c7-4ad1-4a2f-833f-42f5e422df0b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:56.168147 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1222/2439] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:45:56.172556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69429f03-f1f4-4832-9f9a-ae835d4cc96d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:56.183168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69429f03-f1f4-4832-9f9a-ae835d4cc96d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:56.188876 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8060ec-f7f6-4eb3-85ff-f0352fc0ce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:56.189568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8060ec-f7f6-4eb3-85ff-f0352fc0ce63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:56.189851 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8060ec-f7f6-4eb3-85ff-f0352fc0ce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:56.190125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8060ec-f7f6-4eb3-85ff-f0352fc0ce63 admin admin] PATH_INFO: `/v3/projects/c3c0813cce70476b8b92ecf6d1187dbe/users/b9c5c73acb51409ba8a866895be48722/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:56.205915 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8060ec-f7f6-4eb3-85ff-f0352fc0ce63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c0813cce70476b8b92ecf6d1187dbe, user_id=b9c5c73acb51409ba8a866895be48722, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:56.208462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8060ec-f7f6-4eb3-85ff-f0352fc0ce63 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:56.283586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1218/2440] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:45:56 2022] PUT /identity/v3/projects/c3c0813cce70476b8b92ecf6d1187dbe/users/b9c5c73acb51409ba8a866895be48722/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:45:56.295362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88035-3e25-4b97-b6b2-64afa564e935 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:56.295651 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88035-3e25-4b97-b6b2-64afa564e935 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:56.298459 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88035-3e25-4b97-b6b2-64afa564e935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:56.326626 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b6a88035-3e25-4b97-b6b2-64afa564e935 None None] MFA Rules not processed for user `b9c5c73acb51409ba8a866895be48722`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:45:56.327855 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b6a88035-3e25-4b97-b6b2-64afa564e935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:56.339282 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:56.394035 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1223/2441] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:45:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:45:56.405756 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8060ec-f7f6-4eb3-85ff-f0352fc0ce63 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:45:56.407460 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ef8060ec-f7f6-4eb3-85ff-f0352fc0ce63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:45:56.414050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:45:56.465060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8060ec-f7f6-4eb3-85ff-f0352fc0ce63 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:45:56.469190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6356c-b331-421f-ac18-565e5e256760 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526760ad8a04bf486d1e7e74e9ffbe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:45:56.469813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6356c-b331-421f-ac18-565e5e256760 service glance] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:45:56.470088 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6356c-b331-421f-ac18-565e5e256760 service glance] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:45:56.470355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6356c-b331-421f-ac18-565e5e256760 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:45:56.478644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6356c-b331-421f-ac18-565e5e256760 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:45:56.480869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6356c-b331-421f-ac18-565e5e256760 service glance] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:45:56.490442 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1219/2442] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:45:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:46:06.399570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=21 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:06.508499 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=24 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:15.311149 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a88035-3e25-4b97-b6b2-64afa564e935 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:46:15.312807 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b6a88035-3e25-4b97-b6b2-64afa564e935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:46:15.385795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a88035-3e25-4b97-b6b2-64afa564e935 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:46:15.390953 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9494e3f-c753-440c-b9c3-f0ea5e4340e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ad954bbb7749ee8861e8da98619006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:46:15.391591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9494e3f-c753-440c-b9c3-f0ea5e4340e3 service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:15.392005 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9494e3f-c753-440c-b9c3-f0ea5e4340e3 service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:15.392268 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9494e3f-c753-440c-b9c3-f0ea5e4340e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:15.394878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-a9494e3f-c753-440c-b9c3-f0ea5e4340e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:46:15.407252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9494e3f-c753-440c-b9c3-f0ea5e4340e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:46:15.415169 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9494e3f-c753-440c-b9c3-f0ea5e4340e3 service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:46:15.419795 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1224/2443] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:46:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:46:20.458886 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218615a-3ef7-4105-9c1b-48c4f2930498 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:20.459390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218615a-3ef7-4105-9c1b-48c4f2930498 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:20.459390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218615a-3ef7-4105-9c1b-48c4f2930498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:20.480543 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8218615a-3ef7-4105-9c1b-48c4f2930498 None None] MFA Rules not processed for user `1224284a60e64f07ba98d80901091550`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:46:20.481780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8218615a-3ef7-4105-9c1b-48c4f2930498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:46:20.538302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1220/2444] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:46:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:46:20.800065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9494e3f-c753-440c-b9c3-f0ea5e4340e3 service placement] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:46:20.865503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9494e3f-c753-440c-b9c3-f0ea5e4340e3 service placement] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:46:20.870249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e1c49-979c-42e7-9e30-08b9b2ec4566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:46:20.870873 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e1c49-979c-42e7-9e30-08b9b2ec4566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:20.871160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e1c49-979c-42e7-9e30-08b9b2ec4566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:20.871432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e1c49-979c-42e7-9e30-08b9b2ec4566 admin admin] PATH_INFO: `/v3/users/b9c5c73acb51409ba8a866895be48722` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:20.872559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e1c49-979c-42e7-9e30-08b9b2ec4566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c5c73acb51409ba8a866895be48722)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:46:20.874502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e1c49-979c-42e7-9e30-08b9b2ec4566 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:46:21.031996 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b32e1c49-979c-42e7-9e30-08b9b2ec4566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c5c73acb51409ba8a866895be48722'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:21.045958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b32e1c49-979c-42e7-9e30-08b9b2ec4566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c5c73acb51409ba8a866895be48722'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:21.114431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b32e1c49-979c-42e7-9e30-08b9b2ec4566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c5c73acb51409ba8a866895be48722'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:21.121958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b32e1c49-979c-42e7-9e30-08b9b2ec4566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c5c73acb51409ba8a866895be48722'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:21.122615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-b32e1c49-979c-42e7-9e30-08b9b2ec4566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c5c73acb51409ba8a866895be48722'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:21.128895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1225/2445] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:46:20 2022] DELETE /identity/v3/users/b9c5c73acb51409ba8a866895be48722 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:46:21.134115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df7c0c-ef36-492e-9f91-e2ecb44d5a4f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:21.134406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df7c0c-ef36-492e-9f91-e2ecb44d5a4f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:21.134686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df7c0c-ef36-492e-9f91-e2ecb44d5a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:21.154730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-38df7c0c-ef36-492e-9f91-e2ecb44d5a4f None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:46:21.155929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-38df7c0c-ef36-492e-9f91-e2ecb44d5a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:46:21.214171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1221/2446] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:46:21.224442 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e1c49-979c-42e7-9e30-08b9b2ec4566 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:46:21.225927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b32e1c49-979c-42e7-9e30-08b9b2ec4566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:46:21.237158 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:21.303247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e1c49-979c-42e7-9e30-08b9b2ec4566 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:46:21.307097 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fbbc9-9070-4e8e-9043-da95a2ce2dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:46:21.307710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fbbc9-9070-4e8e-9043-da95a2ce2dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:21.307989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fbbc9-9070-4e8e-9043-da95a2ce2dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:21.308434 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fbbc9-9070-4e8e-9043-da95a2ce2dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:21.318926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fbbc9-9070-4e8e-9043-da95a2ce2dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:46:21.320394 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fbbc9-9070-4e8e-9043-da95a2ce2dc0 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:46:21.331297 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1226/2447] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:46:21.869813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df7c0c-ef36-492e-9f91-e2ecb44d5a4f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:46:21.871354 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-38df7c0c-ef36-492e-9f91-e2ecb44d5a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:46:21.888265 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df7c0c-ef36-492e-9f91-e2ecb44d5a4f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:46:21.895089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04cd39-88d2-4d9e-8b80-232672b23cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:46:21.895754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04cd39-88d2-4d9e-8b80-232672b23cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:21.896035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04cd39-88d2-4d9e-8b80-232672b23cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:21.896434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04cd39-88d2-4d9e-8b80-232672b23cc3 admin admin] PATH_INFO: `/v3/projects/c3c0813cce70476b8b92ecf6d1187dbe` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:21.897525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04cd39-88d2-4d9e-8b80-232672b23cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c0813cce70476b8b92ecf6d1187dbe)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:46:21.899381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04cd39-88d2-4d9e-8b80-232672b23cc3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:46:22.035093 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1e04cd39-88d2-4d9e-8b80-232672b23cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c0813cce70476b8b92ecf6d1187dbe', 'request_id': 'req-1e04cd39-88d2-4d9e-8b80-232672b23cc3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:22.108231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1e04cd39-88d2-4d9e-8b80-232672b23cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c0813cce70476b8b92ecf6d1187dbe', 'request_id': 'req-1e04cd39-88d2-4d9e-8b80-232672b23cc3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:22.114759 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1e04cd39-88d2-4d9e-8b80-232672b23cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c0813cce70476b8b92ecf6d1187dbe', 'request_id': 'req-1e04cd39-88d2-4d9e-8b80-232672b23cc3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:22.125955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1e04cd39-88d2-4d9e-8b80-232672b23cc3 admin admin] The token cache is being invalidate because project c3c0813cce70476b8b92ecf6d1187dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:46:22.126240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1e04cd39-88d2-4d9e-8b80-232672b23cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:22.126863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-1e04cd39-88d2-4d9e-8b80-232672b23cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:22.128389 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1222/2448] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:46:21 2022] DELETE /identity/v3/projects/c3c0813cce70476b8b92ecf6d1187dbe => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:46:22.134019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132163d0-66b0-41d4-8912-e2750d1bf7af None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:22.135070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132163d0-66b0-41d4-8912-e2750d1bf7af None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:22.135070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132163d0-66b0-41d4-8912-e2750d1bf7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:22.154106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-132163d0-66b0-41d4-8912-e2750d1bf7af None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:46:22.155293 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-132163d0-66b0-41d4-8912-e2750d1bf7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:46:22.215823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1227/2449] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:46:22.224591 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686ecc0-d278-4829-916a-8b7e72f2fd87 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:22.224871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686ecc0-d278-4829-916a-8b7e72f2fd87 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:22.225161 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686ecc0-d278-4829-916a-8b7e72f2fd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:22.245930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a686ecc0-d278-4829-916a-8b7e72f2fd87 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:46:22.247144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a686ecc0-d278-4829-916a-8b7e72f2fd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:46:22.255173 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1223/2450] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:46:22.259397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132163d0-66b0-41d4-8912-e2750d1bf7af None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:46:22.269226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132163d0-66b0-41d4-8912-e2750d1bf7af None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:46:22.274051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce44965-4f80-4d05-85cd-b247441c6543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:46:22.274641 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce44965-4f80-4d05-85cd-b247441c6543 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:22.274931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce44965-4f80-4d05-85cd-b247441c6543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:22.275188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce44965-4f80-4d05-85cd-b247441c6543 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:22.275829 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce44965-4f80-4d05-85cd-b247441c6543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:46:22.276127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce44965-4f80-4d05-85cd-b247441c6543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:46:22.277749 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce44965-4f80-4d05-85cd-b247441c6543 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:46:22.290191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1228/2451] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:46:22.294666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686ecc0-d278-4829-916a-8b7e72f2fd87 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:46:22.307129 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686ecc0-d278-4829-916a-8b7e72f2fd87 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:46:22.312930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99406283-70d9-4034-9b7f-b75500b9861f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:46:22.313566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99406283-70d9-4034-9b7f-b75500b9861f admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:22.313904 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99406283-70d9-4034-9b7f-b75500b9861f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:22.314202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99406283-70d9-4034-9b7f-b75500b9861f admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:22.314847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99406283-70d9-4034-9b7f-b75500b9861f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:46:22.317464 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99406283-70d9-4034-9b7f-b75500b9861f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:46:22.377694 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:22.384453 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1224/2452] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:46:22 2022] POST /identity/v3/projects => generated 389 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:46:22.388731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce44965-4f80-4d05-85cd-b247441c6543 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:46:22.401476 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce44965-4f80-4d05-85cd-b247441c6543 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:46:22.465904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da085-9262-4f5e-8cbd-8ad980f6f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:46:22.468087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da085-9262-4f5e-8cbd-8ad980f6f1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:22.468087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da085-9262-4f5e-8cbd-8ad980f6f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:22.468087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da085-9262-4f5e-8cbd-8ad980f6f1b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:22.468087 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76da085-9262-4f5e-8cbd-8ad980f6f1b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:46:22.469638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76da085-9262-4f5e-8cbd-8ad980f6f1b5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:46:22.571245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1229/2453] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:46:22 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:46:22.576053 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99406283-70d9-4034-9b7f-b75500b9861f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:46:22.587039 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99406283-70d9-4034-9b7f-b75500b9861f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:46:22.597503 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59786908-eb88-492f-a89c-fd5a7f08e57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:46:22.598844 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59786908-eb88-492f-a89c-fd5a7f08e57a admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:22.599215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59786908-eb88-492f-a89c-fd5a7f08e57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:22.599529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59786908-eb88-492f-a89c-fd5a7f08e57a admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:22.600240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59786908-eb88-492f-a89c-fd5a7f08e57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:46:22.601965 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59786908-eb88-492f-a89c-fd5a7f08e57a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:46:22.612390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1225/2454] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:46:22.618081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da085-9262-4f5e-8cbd-8ad980f6f1b5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:46:22.628727 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da085-9262-4f5e-8cbd-8ad980f6f1b5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:46:22.633605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0e269-711b-440c-a29f-9ab26a407340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:46:22.634216 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0e269-711b-440c-a29f-9ab26a407340 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:22.634496 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0e269-711b-440c-a29f-9ab26a407340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:22.634770 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0e269-711b-440c-a29f-9ab26a407340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:22.635414 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0e269-711b-440c-a29f-9ab26a407340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:46:22.637001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0e269-711b-440c-a29f-9ab26a407340 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:46:22.651938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1230/2455] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:46:22.656629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59786908-eb88-492f-a89c-fd5a7f08e57a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:46:22.667514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59786908-eb88-492f-a89c-fd5a7f08e57a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:46:22.672095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ab2b9-d8bc-4c70-b8ff-64e36de876cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:46:22.672736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ab2b9-d8bc-4c70-b8ff-64e36de876cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:22.673011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ab2b9-d8bc-4c70-b8ff-64e36de876cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:22.673313 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ab2b9-d8bc-4c70-b8ff-64e36de876cf admin admin] PATH_INFO: `/v3/projects/0bfb86a5e46440bb85efc2afd4274c4a/users/a485127e0baf4e8599740884f5bcf30d/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:22.689639 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ab2b9-d8bc-4c70-b8ff-64e36de876cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bfb86a5e46440bb85efc2afd4274c4a, user_id=a485127e0baf4e8599740884f5bcf30d, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:46:22.694048 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ab2b9-d8bc-4c70-b8ff-64e36de876cf admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:46:22.777182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1226/2456] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:46:22 2022] PUT /identity/v3/projects/0bfb86a5e46440bb85efc2afd4274c4a/users/a485127e0baf4e8599740884f5bcf30d/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:46:22.848860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e45bd1-601a-4b9a-938d-0664e1ce0408 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:22.849145 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e45bd1-601a-4b9a-938d-0664e1ce0408 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:22.849454 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e45bd1-601a-4b9a-938d-0664e1ce0408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:22.876710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c7e45bd1-601a-4b9a-938d-0664e1ce0408 None None] MFA Rules not processed for user `a485127e0baf4e8599740884f5bcf30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:46:22.877957 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c7e45bd1-601a-4b9a-938d-0664e1ce0408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:46:22.883715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:22.942584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1231/2457] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:46:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:46:22.953957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ab2b9-d8bc-4c70-b8ff-64e36de876cf admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:46:22.955735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-357ab2b9-d8bc-4c70-b8ff-64e36de876cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:46:23.014261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ab2b9-d8bc-4c70-b8ff-64e36de876cf admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:46:23.018019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04ae0a-def1-49cb-b7ad-03f66ba23cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:46:23.018626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04ae0a-def1-49cb-b7ad-03f66ba23cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:23.018907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04ae0a-def1-49cb-b7ad-03f66ba23cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:23.019180 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04ae0a-def1-49cb-b7ad-03f66ba23cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:23.028723 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04ae0a-def1-49cb-b7ad-03f66ba23cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:46:23.030300 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04ae0a-def1-49cb-b7ad-03f66ba23cd2 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:46:23.039617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1227/2458] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:46:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:46:32.982452 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=24 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:33.035473 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:34.612869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e45bd1-601a-4b9a-938d-0664e1ce0408 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:46:34.690912 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e45bd1-601a-4b9a-938d-0664e1ce0408 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:46:34.695602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c0ed-579b-4ef5-b59b-55c47894ee9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:46:34.696147 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c0ed-579b-4ef5-b59b-55c47894ee9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:34.696427 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c0ed-579b-4ef5-b59b-55c47894ee9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:34.696697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c0ed-579b-4ef5-b59b-55c47894ee9c admin admin] PATH_INFO: `/v3/users/a485127e0baf4e8599740884f5bcf30d` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:34.697853 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c0ed-579b-4ef5-b59b-55c47894ee9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a485127e0baf4e8599740884f5bcf30d)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:46:34.699783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c0ed-579b-4ef5-b59b-55c47894ee9c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:46:34.892589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-af71c0ed-579b-4ef5-b59b-55c47894ee9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a485127e0baf4e8599740884f5bcf30d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:34.905082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-af71c0ed-579b-4ef5-b59b-55c47894ee9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a485127e0baf4e8599740884f5bcf30d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:35.004810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-af71c0ed-579b-4ef5-b59b-55c47894ee9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a485127e0baf4e8599740884f5bcf30d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:35.012211 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-af71c0ed-579b-4ef5-b59b-55c47894ee9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a485127e0baf4e8599740884f5bcf30d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:35.012839 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-af71c0ed-579b-4ef5-b59b-55c47894ee9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a485127e0baf4e8599740884f5bcf30d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:35.018678 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1232/2459] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:46:34 2022] DELETE /identity/v3/users/a485127e0baf4e8599740884f5bcf30d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:46:35.023719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cca9c6-5fb1-41b6-9f9f-0bdf4f60c1fd None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:35.024302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cca9c6-5fb1-41b6-9f9f-0bdf4f60c1fd None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:35.024567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cca9c6-5fb1-41b6-9f9f-0bdf4f60c1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:35.045071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-59cca9c6-5fb1-41b6-9f9f-0bdf4f60c1fd None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:46:35.046311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-59cca9c6-5fb1-41b6-9f9f-0bdf4f60c1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:46:35.105556 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1228/2460] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:46:35.115133 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c0ed-579b-4ef5-b59b-55c47894ee9c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:46:35.116562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-af71c0ed-579b-4ef5-b59b-55c47894ee9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:46:35.176217 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c0ed-579b-4ef5-b59b-55c47894ee9c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:46:35.179951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118c7c8-6ebe-4e7a-b284-6a78e5748f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:46:35.180611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c7c8-6ebe-4e7a-b284-6a78e5748f69 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:35.180930 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c7c8-6ebe-4e7a-b284-6a78e5748f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:35.181283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c7c8-6ebe-4e7a-b284-6a78e5748f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:35.190117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118c7c8-6ebe-4e7a-b284-6a78e5748f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:46:35.191546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118c7c8-6ebe-4e7a-b284-6a78e5748f69 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:46:35.200889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1233/2461] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:46:35.618893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cca9c6-5fb1-41b6-9f9f-0bdf4f60c1fd None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:46:35.620475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-59cca9c6-5fb1-41b6-9f9f-0bdf4f60c1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:46:35.633770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cca9c6-5fb1-41b6-9f9f-0bdf4f60c1fd None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:46:35.639139 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ad386-9fd9-4caa-88d7-632af9b10857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:46:35.639780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ad386-9fd9-4caa-88d7-632af9b10857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:35.640199 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ad386-9fd9-4caa-88d7-632af9b10857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:35.640479 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ad386-9fd9-4caa-88d7-632af9b10857 admin admin] PATH_INFO: `/v3/projects/0bfb86a5e46440bb85efc2afd4274c4a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:35.641796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ad386-9fd9-4caa-88d7-632af9b10857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bfb86a5e46440bb85efc2afd4274c4a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:46:35.643791 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ad386-9fd9-4caa-88d7-632af9b10857 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:46:35.792547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-471ad386-9fd9-4caa-88d7-632af9b10857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bfb86a5e46440bb85efc2afd4274c4a', 'request_id': 'req-471ad386-9fd9-4caa-88d7-632af9b10857'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:35.869352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-471ad386-9fd9-4caa-88d7-632af9b10857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bfb86a5e46440bb85efc2afd4274c4a', 'request_id': 'req-471ad386-9fd9-4caa-88d7-632af9b10857'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:35.875740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-471ad386-9fd9-4caa-88d7-632af9b10857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bfb86a5e46440bb85efc2afd4274c4a', 'request_id': 'req-471ad386-9fd9-4caa-88d7-632af9b10857'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:35.888242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-471ad386-9fd9-4caa-88d7-632af9b10857 admin admin] The token cache is being invalidate because project 0bfb86a5e46440bb85efc2afd4274c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:46:35.888778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-471ad386-9fd9-4caa-88d7-632af9b10857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:35.889517 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-471ad386-9fd9-4caa-88d7-632af9b10857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:46:35.891256 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1229/2462] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:46:35 2022] DELETE /identity/v3/projects/0bfb86a5e46440bb85efc2afd4274c4a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:46:37.034128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f33f0-f2ac-41cc-ab38-337666c804dd None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:46:37.034632 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f33f0-f2ac-41cc-ab38-337666c804dd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:46:37.034718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f33f0-f2ac-41cc-ab38-337666c804dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:46:37.055818 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-486f33f0-f2ac-41cc-ab38-337666c804dd None None] MFA Rules not processed for user `75d4111e41a743bfa5016241e48bc9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:46:37.057251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-486f33f0-f2ac-41cc-ab38-337666c804dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:46:37.083383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:37.146126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1234/2463] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:46:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:46:45.884918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:46:47.239477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=15 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:47:34.684977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2baef4-7350-4f2c-9453-842f4c69eaaf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:34.685563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2baef4-7350-4f2c-9453-842f4c69eaaf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:34.685670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2baef4-7350-4f2c-9453-842f4c69eaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:34.705023 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5c2baef4-7350-4f2c-9453-842f4c69eaaf None None] MFA Rules not processed for user `1224284a60e64f07ba98d80901091550`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:47:34.706258 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5c2baef4-7350-4f2c-9453-842f4c69eaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:47:34.763048 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1230/2464] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:47:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:47:44.755645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=25 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:47:44.868169 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f33f0-f2ac-41cc-ab38-337666c804dd None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:47:44.877083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-486f33f0-f2ac-41cc-ab38-337666c804dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:47:44.983764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f33f0-f2ac-41cc-ab38-337666c804dd None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:47:44.988644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bd947-f161-4253-bad1-c84d9ddb6e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:47:44.989625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bd947-f161-4253-bad1-c84d9ddb6e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:44.989977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bd947-f161-4253-bad1-c84d9ddb6e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:44.990323 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bd947-f161-4253-bad1-c84d9ddb6e30 admin admin] PATH_INFO: `/v3/users/75d4111e41a743bfa5016241e48bc9ed` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:44.991561 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bd947-f161-4253-bad1-c84d9ddb6e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d4111e41a743bfa5016241e48bc9ed)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:47:44.993669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bd947-f161-4253-bad1-c84d9ddb6e30 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:47:45.219501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-605bd947-f161-4253-bad1-c84d9ddb6e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d4111e41a743bfa5016241e48bc9ed'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:47:45.236104 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-605bd947-f161-4253-bad1-c84d9ddb6e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d4111e41a743bfa5016241e48bc9ed'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:47:45.306168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-605bd947-f161-4253-bad1-c84d9ddb6e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d4111e41a743bfa5016241e48bc9ed'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:47:45.319027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-605bd947-f161-4253-bad1-c84d9ddb6e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d4111e41a743bfa5016241e48bc9ed'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:47:45.319027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-605bd947-f161-4253-bad1-c84d9ddb6e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d4111e41a743bfa5016241e48bc9ed'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:47:45.324634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1235/2465] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:47:44 2022] DELETE /identity/v3/users/75d4111e41a743bfa5016241e48bc9ed => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:47:45.661519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f5c70-f813-42b5-9546-cdceb560ca76 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:45.661823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f5c70-f813-42b5-9546-cdceb560ca76 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:45.662079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f5c70-f813-42b5-9546-cdceb560ca76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:45.679730 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bd947-f161-4253-bad1-c84d9ddb6e30 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:47:45.681226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-605bd947-f161-4253-bad1-c84d9ddb6e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:47:45.683759 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-fa1f5c70-f813-42b5-9546-cdceb560ca76 None None] MFA Rules not processed for user `5b584800b7f0409bb1d3069718397c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:47:45.684932 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fa1f5c70-f813-42b5-9546-cdceb560ca76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:47:45.765249 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1231/2466] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:47:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:47:45.781144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bd947-f161-4253-bad1-c84d9ddb6e30 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:47:45.786864 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9047a7-305a-46b6-9db4-fbe24234cf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:47:45.787575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9047a7-305a-46b6-9db4-fbe24234cf09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:45.787926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9047a7-305a-46b6-9db4-fbe24234cf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:45.788734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9047a7-305a-46b6-9db4-fbe24234cf09 admin admin] PATH_INFO: `/v3/projects/4420a16aa5054f6a86030a239c84b6e7` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:45.789731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9047a7-305a-46b6-9db4-fbe24234cf09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4420a16aa5054f6a86030a239c84b6e7)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:47:45.792013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9047a7-305a-46b6-9db4-fbe24234cf09 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:47:45.824711 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:47:45.911106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2d9047a7-305a-46b6-9db4-fbe24234cf09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4420a16aa5054f6a86030a239c84b6e7', 'request_id': 'req-2d9047a7-305a-46b6-9db4-fbe24234cf09'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:47:46.021049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2d9047a7-305a-46b6-9db4-fbe24234cf09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4420a16aa5054f6a86030a239c84b6e7', 'request_id': 'req-2d9047a7-305a-46b6-9db4-fbe24234cf09'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:47:46.028244 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2d9047a7-305a-46b6-9db4-fbe24234cf09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4420a16aa5054f6a86030a239c84b6e7', 'request_id': 'req-2d9047a7-305a-46b6-9db4-fbe24234cf09'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:47:46.044811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2d9047a7-305a-46b6-9db4-fbe24234cf09 admin admin] The token cache is being invalidate because project 4420a16aa5054f6a86030a239c84b6e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:47:46.045105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2d9047a7-305a-46b6-9db4-fbe24234cf09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:47:46.045896 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-2d9047a7-305a-46b6-9db4-fbe24234cf09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:47:46.054336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff62e4f-24b1-42ee-afbf-8ffd97622ebc None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:46.054336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff62e4f-24b1-42ee-afbf-8ffd97622ebc None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:46.054336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff62e4f-24b1-42ee-afbf-8ffd97622ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:46.056127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1236/2467] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:47:45 2022] DELETE /identity/v3/projects/4420a16aa5054f6a86030a239c84b6e7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:47:46.077600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-4ff62e4f-24b1-42ee-afbf-8ffd97622ebc None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:47:46.079117 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-4ff62e4f-24b1-42ee-afbf-8ffd97622ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:47:46.145034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1232/2468] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:47:46.152703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82134383-2398-4f99-a719-74cd524ed852 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:46.152897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82134383-2398-4f99-a719-74cd524ed852 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:46.153165 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82134383-2398-4f99-a719-74cd524ed852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:46.174334 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-82134383-2398-4f99-a719-74cd524ed852 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:47:46.175564 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-82134383-2398-4f99-a719-74cd524ed852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:47:46.188071 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1237/2469] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:47:46.189229 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff62e4f-24b1-42ee-afbf-8ffd97622ebc None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:47:46.200212 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff62e4f-24b1-42ee-afbf-8ffd97622ebc None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:47:46.205111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47b10d-7555-4b60-954e-54481cf07407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:47:46.205811 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47b10d-7555-4b60-954e-54481cf07407 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:46.206090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47b10d-7555-4b60-954e-54481cf07407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:46.206361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47b10d-7555-4b60-954e-54481cf07407 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:46.207028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47b10d-7555-4b60-954e-54481cf07407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:47:46.207329 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47b10d-7555-4b60-954e-54481cf07407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:47:46.208941 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47b10d-7555-4b60-954e-54481cf07407 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:47:46.223195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1233/2470] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:47:46.227824 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82134383-2398-4f99-a719-74cd524ed852 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:47:46.238088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82134383-2398-4f99-a719-74cd524ed852 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:47:46.242910 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda2254-d447-4125-acf7-198b732d77c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:47:46.243532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda2254-d447-4125-acf7-198b732d77c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:46.243815 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda2254-d447-4125-acf7-198b732d77c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:46.244091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda2254-d447-4125-acf7-198b732d77c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:46.245570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda2254-d447-4125-acf7-198b732d77c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:47:46.247511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda2254-d447-4125-acf7-198b732d77c5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:47:46.352509 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1238/2471] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:47:46 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:47:46.357355 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47b10d-7555-4b60-954e-54481cf07407 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:47:46.367588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47b10d-7555-4b60-954e-54481cf07407 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:47:46.425951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ed9d0-d649-42ee-9390-fc4ee9651172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:47:46.426470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ed9d0-d649-42ee-9390-fc4ee9651172 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:46.426748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ed9d0-d649-42ee-9390-fc4ee9651172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:46.427019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ed9d0-d649-42ee-9390-fc4ee9651172 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:46.427810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ed9d0-d649-42ee-9390-fc4ee9651172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:47:46.429732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ed9d0-d649-42ee-9390-fc4ee9651172 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:47:46.565541 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1234/2472] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:47:46 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:47:46.566726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda2254-d447-4125-acf7-198b732d77c5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:47:46.577511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda2254-d447-4125-acf7-198b732d77c5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:47:46.582096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428a9e9-a6ad-449a-bb34-84888e7f472e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:47:46.582692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428a9e9-a6ad-449a-bb34-84888e7f472e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:46.582971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428a9e9-a6ad-449a-bb34-84888e7f472e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:46.583244 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428a9e9-a6ad-449a-bb34-84888e7f472e admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:46.583920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428a9e9-a6ad-449a-bb34-84888e7f472e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:47:46.585549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428a9e9-a6ad-449a-bb34-84888e7f472e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:47:46.596690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1239/2473] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:47:46.600541 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ed9d0-d649-42ee-9390-fc4ee9651172 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:47:46.610735 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ed9d0-d649-42ee-9390-fc4ee9651172 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:47:46.615407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf0905-84ce-4ce0-90ad-1bbf6bfcb245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:47:46.617755 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf0905-84ce-4ce0-90ad-1bbf6bfcb245 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:46.617755 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf0905-84ce-4ce0-90ad-1bbf6bfcb245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:46.617755 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf0905-84ce-4ce0-90ad-1bbf6bfcb245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:46.617755 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf0905-84ce-4ce0-90ad-1bbf6bfcb245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:47:46.618794 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf0905-84ce-4ce0-90ad-1bbf6bfcb245 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:47:46.629323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1235/2474] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:47:46.633358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428a9e9-a6ad-449a-bb34-84888e7f472e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:47:46.644004 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428a9e9-a6ad-449a-bb34-84888e7f472e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:47:46.648532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32322320-6343-4e6c-95dc-68114c664f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:47:46.649168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32322320-6343-4e6c-95dc-68114c664f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:46.649476 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32322320-6343-4e6c-95dc-68114c664f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:46.649749 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32322320-6343-4e6c-95dc-68114c664f37 admin admin] PATH_INFO: `/v3/projects/de47b37419894d1382d63efffab00ded/users/a22e284af0b94f9ea41e0c8e64a27a25/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:46.664982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32322320-6343-4e6c-95dc-68114c664f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de47b37419894d1382d63efffab00ded, user_id=a22e284af0b94f9ea41e0c8e64a27a25, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:47:46.668060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32322320-6343-4e6c-95dc-68114c664f37 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:47:46.758023 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1240/2475] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:47:46 2022] PUT /identity/v3/projects/de47b37419894d1382d63efffab00ded/users/a22e284af0b94f9ea41e0c8e64a27a25/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:47:46.763975 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c01596-be90-4c58-baba-be2ff205a9bb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:46.764319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c01596-be90-4c58-baba-be2ff205a9bb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:46.764655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c01596-be90-4c58-baba-be2ff205a9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:46.789619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-43c01596-be90-4c58-baba-be2ff205a9bb None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:47:46.791967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-43c01596-be90-4c58-baba-be2ff205a9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:47:46.797728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:47:46.854266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1236/2476] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:47:46.863741 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32322320-6343-4e6c-95dc-68114c664f37 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:47:46.865553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-32322320-6343-4e6c-95dc-68114c664f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:47:46.928072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32322320-6343-4e6c-95dc-68114c664f37 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:47:46.931912 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858eaa8-dad9-47d3-8e7a-88d1ce7d57a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:47:46.932602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858eaa8-dad9-47d3-8e7a-88d1ce7d57a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:46.932890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858eaa8-dad9-47d3-8e7a-88d1ce7d57a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:46.933168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858eaa8-dad9-47d3-8e7a-88d1ce7d57a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:46.942610 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858eaa8-dad9-47d3-8e7a-88d1ce7d57a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:47:46.944039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858eaa8-dad9-47d3-8e7a-88d1ce7d57a2 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:47:46.956130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1241/2477] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:47:54.774072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b629f-2903-49c0-a125-8ee19f5e0b98 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:54.774559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b629f-2903-49c0-a125-8ee19f5e0b98 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:54.774655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b629f-2903-49c0-a125-8ee19f5e0b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:54.807294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ce8b629f-2903-49c0-a125-8ee19f5e0b98 None None] MFA Rules not processed for user `a22e284af0b94f9ea41e0c8e64a27a25`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:47:54.808948 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ce8b629f-2903-49c0-a125-8ee19f5e0b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:47:54.895446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1237/2478] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:47:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:47:54.904349 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858eaa8-dad9-47d3-8e7a-88d1ce7d57a2 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:47:54.906572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0858eaa8-dad9-47d3-8e7a-88d1ce7d57a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:47:54.973759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:47:55.002550 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858eaa8-dad9-47d3-8e7a-88d1ce7d57a2 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:47:55.008746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ce8e9-e258-49d1-a42b-ebd1baa0d20f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:47:55.009652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ce8e9-e258-49d1-a42b-ebd1baa0d20f service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:55.010142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ce8e9-e258-49d1-a42b-ebd1baa0d20f service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:55.010572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ce8e9-e258-49d1-a42b-ebd1baa0d20f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:55.022030 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ce8e9-e258-49d1-a42b-ebd1baa0d20f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:47:55.024784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ce8e9-e258-49d1-a42b-ebd1baa0d20f service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:47:55.037759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1242/2479] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:47:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:47:57.651279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d3d07-bf60-4e63-9c3f-f499aec02069 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:47:57.651825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d3d07-bf60-4e63-9c3f-f499aec02069 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:47:57.651934 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d3d07-bf60-4e63-9c3f-f499aec02069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:47:57.671583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-da9d3d07-bf60-4e63-9c3f-f499aec02069 None None] MFA Rules not processed for user `a22e284af0b94f9ea41e0c8e64a27a25`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:47:57.672777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-da9d3d07-bf60-4e63-9c3f-f499aec02069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:47:57.679815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1238/2480] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:47:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:48:05.064314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=12 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:05.385664 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ce8e9-e258-49d1-a42b-ebd1baa0d20f service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:05.395175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ce8e9-e258-49d1-a42b-ebd1baa0d20f service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:05.398853 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d723922-46a7-4ebe-9b67-727f4fbd6989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:05.399445 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d723922-46a7-4ebe-9b67-727f4fbd6989 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:05.399724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d723922-46a7-4ebe-9b67-727f4fbd6989 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:05.400000 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d723922-46a7-4ebe-9b67-727f4fbd6989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:05.401809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9d723922-46a7-4ebe-9b67-727f4fbd6989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:05.414935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d723922-46a7-4ebe-9b67-727f4fbd6989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:05.416344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d723922-46a7-4ebe-9b67-727f4fbd6989 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:05.427959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1243/2481] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:48:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:48:06.611059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d3d07-bf60-4e63-9c3f-f499aec02069 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:06.612487 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-da9d3d07-bf60-4e63-9c3f-f499aec02069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:06.625059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d3d07-bf60-4e63-9c3f-f499aec02069 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:06.628566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a1317-2757-4134-b8c2-2a3f847807a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:06.629154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1317-2757-4134-b8c2-2a3f847807a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:06.629466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1317-2757-4134-b8c2-2a3f847807a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:06.629733 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1317-2757-4134-b8c2-2a3f847807a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:06.631395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dc9a1317-2757-4134-b8c2-2a3f847807a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:06.645094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a1317-2757-4134-b8c2-2a3f847807a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:06.646526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a1317-2757-4134-b8c2-2a3f847807a9 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:06.658141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1239/2482] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:48:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:48:15.423287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=6 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:16.652738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=63 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:30.176879 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d723922-46a7-4ebe-9b67-727f4fbd6989 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:30.178325 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9d723922-46a7-4ebe-9b67-727f4fbd6989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:30.192549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d723922-46a7-4ebe-9b67-727f4fbd6989 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:30.198352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04689182-3b2d-43ff-83ad-0c2b29392704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:30.198943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04689182-3b2d-43ff-83ad-0c2b29392704 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:30.199281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04689182-3b2d-43ff-83ad-0c2b29392704 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:30.199556 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04689182-3b2d-43ff-83ad-0c2b29392704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:30.201313 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-04689182-3b2d-43ff-83ad-0c2b29392704 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:30.261432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04689182-3b2d-43ff-83ad-0c2b29392704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:30.263050 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04689182-3b2d-43ff-83ad-0c2b29392704 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:30.272053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1244/2483] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:48:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:48:39.513246 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a1317-2757-4134-b8c2-2a3f847807a9 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:39.525326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a1317-2757-4134-b8c2-2a3f847807a9 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:39.536424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee57b26-ce4c-4053-ade3-2ad8e16fce65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:39.536424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee57b26-ce4c-4053-ade3-2ad8e16fce65 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:39.536424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee57b26-ce4c-4053-ade3-2ad8e16fce65 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:39.536424 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee57b26-ce4c-4053-ade3-2ad8e16fce65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:39.536897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cee57b26-ce4c-4053-ade3-2ad8e16fce65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:39.550989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee57b26-ce4c-4053-ade3-2ad8e16fce65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:39.552683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee57b26-ce4c-4053-ade3-2ad8e16fce65 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:39.565147 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1240/2484] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:48:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:48:40.267785 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=28 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:46.349454 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04689182-3b2d-43ff-83ad-0c2b29392704 service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:46.359130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04689182-3b2d-43ff-83ad-0c2b29392704 service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:46.362868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530ec25-ea8c-49a0-862c-853238271ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:46.363541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530ec25-ea8c-49a0-862c-853238271ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:46.363828 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530ec25-ea8c-49a0-862c-853238271ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:46.364119 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530ec25-ea8c-49a0-862c-853238271ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:46.365947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6530ec25-ea8c-49a0-862c-853238271ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:46.378591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530ec25-ea8c-49a0-862c-853238271ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:46.380008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530ec25-ea8c-49a0-862c-853238271ed1 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:46.390342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1245/2485] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:48:49.559762 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:50.083027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee57b26-ce4c-4053-ade3-2ad8e16fce65 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:50.084781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cee57b26-ce4c-4053-ade3-2ad8e16fce65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:50.162726 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee57b26-ce4c-4053-ade3-2ad8e16fce65 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:50.168905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c30f38-715d-4072-a9a0-a610799eab29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ad954bbb7749ee8861e8da98619006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:50.169602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c30f38-715d-4072-a9a0-a610799eab29 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:50.169878 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c30f38-715d-4072-a9a0-a610799eab29 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:50.170144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c30f38-715d-4072-a9a0-a610799eab29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:50.171865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-19c30f38-715d-4072-a9a0-a610799eab29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:50.183020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c30f38-715d-4072-a9a0-a610799eab29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:50.184576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c30f38-715d-4072-a9a0-a610799eab29 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:50.195139 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1241/2486] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:48:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:48:50.240333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530ec25-ea8c-49a0-862c-853238271ed1 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:50.242363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6530ec25-ea8c-49a0-862c-853238271ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:50.260633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530ec25-ea8c-49a0-862c-853238271ed1 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:50.261971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16a8ab-cec5-48aa-9157-587302458f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:50.262598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16a8ab-cec5-48aa-9157-587302458f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:50.262878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16a8ab-cec5-48aa-9157-587302458f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:50.263148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16a8ab-cec5-48aa-9157-587302458f99 admin admin] PATH_INFO: `/v3/users/1224284a60e64f07ba98d80901091550` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:50.264269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16a8ab-cec5-48aa-9157-587302458f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1224284a60e64f07ba98d80901091550)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:50.266227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16a8ab-cec5-48aa-9157-587302458f99 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:50.528280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1c16a8ab-cec5-48aa-9157-587302458f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1224284a60e64f07ba98d80901091550'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:50.539995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1c16a8ab-cec5-48aa-9157-587302458f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1224284a60e64f07ba98d80901091550'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:50.622977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1c16a8ab-cec5-48aa-9157-587302458f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1224284a60e64f07ba98d80901091550'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:50.630845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1c16a8ab-cec5-48aa-9157-587302458f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1224284a60e64f07ba98d80901091550'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:50.631497 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1c16a8ab-cec5-48aa-9157-587302458f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1224284a60e64f07ba98d80901091550'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:50.639125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1246/2487] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:48:50 2022] DELETE /identity/v3/users/1224284a60e64f07ba98d80901091550 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:48:50.919506 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c30f38-715d-4072-a9a0-a610799eab29 service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:50.931598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c30f38-715d-4072-a9a0-a610799eab29 service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:50.990938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:50.991487 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:50.991769 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:50.992049 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45 admin admin] PATH_INFO: `/v3/projects/b6c53d59763d49aab80daeac0737a244` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:50.993175 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c53d59763d49aab80daeac0737a244)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:50.995116 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:51.096311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c53d59763d49aab80daeac0737a244', 'request_id': 'req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:51.190707 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c53d59763d49aab80daeac0737a244', 'request_id': 'req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:51.200304 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c53d59763d49aab80daeac0737a244', 'request_id': 'req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:51.211959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45 admin admin] The token cache is being invalidate because project b6c53d59763d49aab80daeac0737a244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:48:51.212241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:51.212884 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-07145b3b-2408-4cbd-80e7-dd47dc9b7e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:51.215010 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1242/2488] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:48:50 2022] DELETE /identity/v3/projects/b6c53d59763d49aab80daeac0737a244 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:48:51.219965 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d231b56-cca8-4b7d-af5e-19947ba249d0 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:51.220251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d231b56-cca8-4b7d-af5e-19947ba249d0 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:51.220521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d231b56-cca8-4b7d-af5e-19947ba249d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:51.240315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-8d231b56-cca8-4b7d-af5e-19947ba249d0 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:48:51.245667 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8d231b56-cca8-4b7d-af5e-19947ba249d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:51.301811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1247/2489] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:48:51.311032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0e7ed-4fa2-4695-87ed-6358f6d464fa None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:51.311313 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0e7ed-4fa2-4695-87ed-6358f6d464fa None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:51.311581 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0e7ed-4fa2-4695-87ed-6358f6d464fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:51.331763 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8fb0e7ed-4fa2-4695-87ed-6358f6d464fa None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:48:51.332962 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8fb0e7ed-4fa2-4695-87ed-6358f6d464fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:51.341154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1243/2490] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:48:51.345456 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d231b56-cca8-4b7d-af5e-19947ba249d0 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:51.355559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d231b56-cca8-4b7d-af5e-19947ba249d0 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:51.364097 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186d474-39c2-4b1a-a012-6413d9bd4ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:51.364708 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186d474-39c2-4b1a-a012-6413d9bd4ffd admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:51.364984 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186d474-39c2-4b1a-a012-6413d9bd4ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:51.365286 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186d474-39c2-4b1a-a012-6413d9bd4ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:51.365944 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186d474-39c2-4b1a-a012-6413d9bd4ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:48:51.366248 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186d474-39c2-4b1a-a012-6413d9bd4ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:51.367968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186d474-39c2-4b1a-a012-6413d9bd4ffd admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:51.380946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1248/2491] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:48:51.385368 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0e7ed-4fa2-4695-87ed-6358f6d464fa None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:51.395627 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0e7ed-4fa2-4695-87ed-6358f6d464fa None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:51.400207 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c35a69-acd3-4031-8018-5278d0d847f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:51.400827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c35a69-acd3-4031-8018-5278d0d847f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:51.401103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c35a69-acd3-4031-8018-5278d0d847f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:51.401400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c35a69-acd3-4031-8018-5278d0d847f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:51.402201 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c35a69-acd3-4031-8018-5278d0d847f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:51.404285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c35a69-acd3-4031-8018-5278d0d847f8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:51.415413 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:51.516726 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1244/2492] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:48:51 2022] POST /identity/v3/projects => generated 405 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:48:51.520979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186d474-39c2-4b1a-a012-6413d9bd4ffd admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:51.531632 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186d474-39c2-4b1a-a012-6413d9bd4ffd admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:51.578040 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:51.590574 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898e879-07e4-4787-a6dc-b57d49990451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:51.591206 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898e879-07e4-4787-a6dc-b57d49990451 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:51.591494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898e879-07e4-4787-a6dc-b57d49990451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:51.591766 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898e879-07e4-4787-a6dc-b57d49990451 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:51.592449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898e879-07e4-4787-a6dc-b57d49990451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:51.594467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898e879-07e4-4787-a6dc-b57d49990451 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:51.697119 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1249/2493] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:48:51 2022] POST /identity/v3/users => generated 303 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:48:51.698500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c35a69-acd3-4031-8018-5278d0d847f8 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:51.709896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c35a69-acd3-4031-8018-5278d0d847f8 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:51.714727 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20449136-c315-499a-9d87-28636ebb1332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:51.715431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20449136-c315-499a-9d87-28636ebb1332 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:51.715698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20449136-c315-499a-9d87-28636ebb1332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:51.715977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20449136-c315-499a-9d87-28636ebb1332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:51.716610 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20449136-c315-499a-9d87-28636ebb1332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:51.718244 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20449136-c315-499a-9d87-28636ebb1332 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:51.728306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1245/2494] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:48:51.733505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898e879-07e4-4787-a6dc-b57d49990451 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:51.744889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898e879-07e4-4787-a6dc-b57d49990451 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:51.750358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01e4eb-7fa2-4e93-92f6-053f32deb241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:51.751055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01e4eb-7fa2-4e93-92f6-053f32deb241 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:51.751421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01e4eb-7fa2-4e93-92f6-053f32deb241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:51.751699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01e4eb-7fa2-4e93-92f6-053f32deb241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:51.752332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01e4eb-7fa2-4e93-92f6-053f32deb241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:51.754076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01e4eb-7fa2-4e93-92f6-053f32deb241 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:51.765143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1250/2495] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:48:51.769683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20449136-c315-499a-9d87-28636ebb1332 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:51.779980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20449136-c315-499a-9d87-28636ebb1332 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:51.784693 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf2037-3f4e-4f2d-aecd-ca517b5f210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:51.785377 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2037-3f4e-4f2d-aecd-ca517b5f210e admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:51.785655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2037-3f4e-4f2d-aecd-ca517b5f210e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:51.785923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf2037-3f4e-4f2d-aecd-ca517b5f210e admin admin] PATH_INFO: `/v3/projects/b5d714d93848472a93b1669a9348e5d5/users/60d65a02c336443aa83c8c711f27b6f7/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:51.816204 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf2037-3f4e-4f2d-aecd-ca517b5f210e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d714d93848472a93b1669a9348e5d5, user_id=60d65a02c336443aa83c8c711f27b6f7, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:51.819190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf2037-3f4e-4f2d-aecd-ca517b5f210e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:51.915791 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1246/2496] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:48:51 2022] PUT /identity/v3/projects/b5d714d93848472a93b1669a9348e5d5/users/60d65a02c336443aa83c8c711f27b6f7/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:48:51.928006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e0bc7-25a7-4d71-835b-160c747ce421 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:51.928631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e0bc7-25a7-4d71-835b-160c747ce421 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:51.929299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e0bc7-25a7-4d71-835b-160c747ce421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:51.978150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-8f9e0bc7-25a7-4d71-835b-160c747ce421 None None] MFA Rules not processed for user `60d65a02c336443aa83c8c711f27b6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:48:51.980524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8f9e0bc7-25a7-4d71-835b-160c747ce421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:52.053074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1251/2497] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:48:51 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:48:52.057661 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf2037-3f4e-4f2d-aecd-ca517b5f210e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:52.122423 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf2037-3f4e-4f2d-aecd-ca517b5f210e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:52.127112 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4391a-7ad8-4b3d-b311-7495fa6bb59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:52.127714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4391a-7ad8-4b3d-b311-7495fa6bb59c admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:52.127993 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4391a-7ad8-4b3d-b311-7495fa6bb59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:52.128262 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4391a-7ad8-4b3d-b311-7495fa6bb59c admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:52.128891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4391a-7ad8-4b3d-b311-7495fa6bb59c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:52.130813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4391a-7ad8-4b3d-b311-7495fa6bb59c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:52.221910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1247/2498] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:48:52 2022] POST /identity/v3/projects => generated 405 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:48:52.223081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e0bc7-25a7-4d71-835b-160c747ce421 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:52.235082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e0bc7-25a7-4d71-835b-160c747ce421 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:52.296112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950330e-9db3-434d-bda6-8461aec9f7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:52.296734 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950330e-9db3-434d-bda6-8461aec9f7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:52.296993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950330e-9db3-434d-bda6-8461aec9f7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:52.297302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950330e-9db3-434d-bda6-8461aec9f7f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:52.297940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950330e-9db3-434d-bda6-8461aec9f7f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:52.299848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950330e-9db3-434d-bda6-8461aec9f7f4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:52.405792 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1252/2499] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:48:52 2022] POST /identity/v3/users => generated 309 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:48:52.405903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4391a-7ad8-4b3d-b311-7495fa6bb59c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:52.415327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4391a-7ad8-4b3d-b311-7495fa6bb59c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:52.420960 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceedfc-bc78-44e6-bc5e-c523a769c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:52.421603 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceedfc-bc78-44e6-bc5e-c523a769c842 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:52.421879 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceedfc-bc78-44e6-bc5e-c523a769c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:52.422145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceedfc-bc78-44e6-bc5e-c523a769c842 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:52.422776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bceedfc-bc78-44e6-bc5e-c523a769c842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:52.424348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bceedfc-bc78-44e6-bc5e-c523a769c842 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:52.442397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1248/2500] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:48:52.443546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950330e-9db3-434d-bda6-8461aec9f7f4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:52.454936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950330e-9db3-434d-bda6-8461aec9f7f4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:52.459885 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b746b44-5a74-438e-b063-cf57c109c88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:52.460548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b746b44-5a74-438e-b063-cf57c109c88a admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:52.460831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b746b44-5a74-438e-b063-cf57c109c88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:52.461139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b746b44-5a74-438e-b063-cf57c109c88a admin admin] PATH_INFO: `/v3/projects/098eb7a8c07a467d8100efd03a866c2f/users/636004d7bd2d4fb0b7da2ab91428827b/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:52.478809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b746b44-5a74-438e-b063-cf57c109c88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=098eb7a8c07a467d8100efd03a866c2f, user_id=636004d7bd2d4fb0b7da2ab91428827b, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:52.490339 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b746b44-5a74-438e-b063-cf57c109c88a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:52.562728 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1253/2501] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:48:52 2022] PUT /identity/v3/projects/098eb7a8c07a467d8100efd03a866c2f/users/636004d7bd2d4fb0b7da2ab91428827b/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:48:52.566797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceedfc-bc78-44e6-bc5e-c523a769c842 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:52.580999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceedfc-bc78-44e6-bc5e-c523a769c842 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:52.637907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f829031-6388-4bad-9cba-ee4ca65a4fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:52.638509 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f829031-6388-4bad-9cba-ee4ca65a4fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:52.638786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f829031-6388-4bad-9cba-ee4ca65a4fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:52.639081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f829031-6388-4bad-9cba-ee4ca65a4fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:52.639716 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f829031-6388-4bad-9cba-ee4ca65a4fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:52.641412 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f829031-6388-4bad-9cba-ee4ca65a4fe3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:52.651035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1249/2502] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:48:52.655718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b746b44-5a74-438e-b063-cf57c109c88a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:52.666359 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b746b44-5a74-438e-b063-cf57c109c88a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:52.672108 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53c103-7b2b-4423-b35d-9635e87953a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:52.672759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53c103-7b2b-4423-b35d-9635e87953a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:52.673039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53c103-7b2b-4423-b35d-9635e87953a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:52.673347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53c103-7b2b-4423-b35d-9635e87953a1 admin admin] PATH_INFO: `/v3/projects/098eb7a8c07a467d8100efd03a866c2f/users/636004d7bd2d4fb0b7da2ab91428827b/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:52.675424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53c103-7b2b-4423-b35d-9635e87953a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098eb7a8c07a467d8100efd03a866c2f, user_id=636004d7bd2d4fb0b7da2ab91428827b, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:52.678088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53c103-7b2b-4423-b35d-9635e87953a1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:52.691299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1254/2503] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:48:52 2022] PUT /identity/v3/projects/098eb7a8c07a467d8100efd03a866c2f/users/636004d7bd2d4fb0b7da2ab91428827b/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:48:52.703757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25a7cc-7b36-470c-8e91-795c4341e904 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:52.704040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25a7cc-7b36-470c-8e91-795c4341e904 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:52.704311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25a7cc-7b36-470c-8e91-795c4341e904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:52.732562 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-dd25a7cc-7b36-470c-8e91-795c4341e904 None None] MFA Rules not processed for user `636004d7bd2d4fb0b7da2ab91428827b`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:48:52.733915 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-dd25a7cc-7b36-470c-8e91-795c4341e904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:52.746614 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:52.806027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1250/2504] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:48:52 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:48:52.817587 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53c103-7b2b-4423-b35d-9635e87953a1 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:52.819274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8a53c103-7b2b-4423-b35d-9635e87953a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:52.830191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:52.879866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53c103-7b2b-4423-b35d-9635e87953a1 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:52.883634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf38fd-37ae-45da-9df2-e5ef0553e305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:52.884241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf38fd-37ae-45da-9df2-e5ef0553e305 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:52.884517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf38fd-37ae-45da-9df2-e5ef0553e305 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:52.884788 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf38fd-37ae-45da-9df2-e5ef0553e305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:52.895764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf38fd-37ae-45da-9df2-e5ef0553e305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:52.897223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf38fd-37ae-45da-9df2-e5ef0553e305 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:52.907547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1255/2505] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:48:52 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:48:53.059253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25a7cc-7b36-470c-8e91-795c4341e904 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:53.124553 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25a7cc-7b36-470c-8e91-795c4341e904 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:53.129298 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324faf0-38e4-4ff1-85a3-51e5422652ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:53.130062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324faf0-38e4-4ff1-85a3-51e5422652ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:53.130344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324faf0-38e4-4ff1-85a3-51e5422652ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:53.130617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324faf0-38e4-4ff1-85a3-51e5422652ad admin admin] PATH_INFO: `/v3/users/60d65a02c336443aa83c8c711f27b6f7` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:53.131746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324faf0-38e4-4ff1-85a3-51e5422652ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d65a02c336443aa83c8c711f27b6f7)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:53.133692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324faf0-38e4-4ff1-85a3-51e5422652ad admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:53.300684 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3324faf0-38e4-4ff1-85a3-51e5422652ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d65a02c336443aa83c8c711f27b6f7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:53.301374 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3324faf0-38e4-4ff1-85a3-51e5422652ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d65a02c336443aa83c8c711f27b6f7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:53.313585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3324faf0-38e4-4ff1-85a3-51e5422652ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d65a02c336443aa83c8c711f27b6f7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:53.320349 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3324faf0-38e4-4ff1-85a3-51e5422652ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d65a02c336443aa83c8c711f27b6f7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:53.320984 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3324faf0-38e4-4ff1-85a3-51e5422652ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d65a02c336443aa83c8c711f27b6f7'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:53.402311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1251/2506] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:48:53 2022] DELETE /identity/v3/users/60d65a02c336443aa83c8c711f27b6f7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:48:53.407063 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81c686-ee29-46bd-9442-86888ca98b36 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:53.407597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81c686-ee29-46bd-9442-86888ca98b36 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:53.407597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81c686-ee29-46bd-9442-86888ca98b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:53.427864 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4d81c686-ee29-46bd-9442-86888ca98b36 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:48:53.429090 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4d81c686-ee29-46bd-9442-86888ca98b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:53.487695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1256/2507] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:48:53.497642 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324faf0-38e4-4ff1-85a3-51e5422652ad admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:53.499054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3324faf0-38e4-4ff1-85a3-51e5422652ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:53.535104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:53.559279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324faf0-38e4-4ff1-85a3-51e5422652ad admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:53.563035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7701f-2229-46a7-886d-b6a9ddfd645d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:53.563653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7701f-2229-46a7-886d-b6a9ddfd645d service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:53.563910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7701f-2229-46a7-886d-b6a9ddfd645d service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:53.564182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7701f-2229-46a7-886d-b6a9ddfd645d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:53.574173 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7701f-2229-46a7-886d-b6a9ddfd645d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:53.580104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7701f-2229-46a7-886d-b6a9ddfd645d service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:53.584979 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1252/2508] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:48:54.015310 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81c686-ee29-46bd-9442-86888ca98b36 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:54.016860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4d81c686-ee29-46bd-9442-86888ca98b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:54.030028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81c686-ee29-46bd-9442-86888ca98b36 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:54.039855 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:54.040502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:54.040779 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:54.041049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] PATH_INFO: `/v3/projects/b5d714d93848472a93b1669a9348e5d5` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:54.043016 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d714d93848472a93b1669a9348e5d5)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:54.045157 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:54.182450 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d714d93848472a93b1669a9348e5d5', 'request_id': 'req-7f245820-1f4b-4b47-b0b8-59b42384ef8d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:54.239480 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d714d93848472a93b1669a9348e5d5', 'request_id': 'req-7f245820-1f4b-4b47-b0b8-59b42384ef8d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:54.247182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d714d93848472a93b1669a9348e5d5', 'request_id': 'req-7f245820-1f4b-4b47-b0b8-59b42384ef8d'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:54.259342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] The token cache is being invalidate because project b5d714d93848472a93b1669a9348e5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:48:54.259632 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:54.260279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:54.262022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1257/2509] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:48:54 2022] DELETE /identity/v3/projects/b5d714d93848472a93b1669a9348e5d5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:48:54.266088 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7701f-2229-46a7-886d-b6a9ddfd645d service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:54.275767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7701f-2229-46a7-886d-b6a9ddfd645d service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:54.333494 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89152b08-0688-48ef-acc5-25c3bbe978e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:54.334124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89152b08-0688-48ef-acc5-25c3bbe978e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:54.334434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89152b08-0688-48ef-acc5-25c3bbe978e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:54.334673 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89152b08-0688-48ef-acc5-25c3bbe978e9 admin admin] PATH_INFO: `/v3/users/636004d7bd2d4fb0b7da2ab91428827b` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:54.335795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89152b08-0688-48ef-acc5-25c3bbe978e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=636004d7bd2d4fb0b7da2ab91428827b)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:54.337740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89152b08-0688-48ef-acc5-25c3bbe978e9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:54.566977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-89152b08-0688-48ef-acc5-25c3bbe978e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636004d7bd2d4fb0b7da2ab91428827b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:54.567653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-89152b08-0688-48ef-acc5-25c3bbe978e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636004d7bd2d4fb0b7da2ab91428827b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:54.579443 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-89152b08-0688-48ef-acc5-25c3bbe978e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636004d7bd2d4fb0b7da2ab91428827b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:54.586303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-89152b08-0688-48ef-acc5-25c3bbe978e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636004d7bd2d4fb0b7da2ab91428827b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:54.586959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-89152b08-0688-48ef-acc5-25c3bbe978e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636004d7bd2d4fb0b7da2ab91428827b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:54.656687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1253/2510] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:48:54 2022] DELETE /identity/v3/users/636004d7bd2d4fb0b7da2ab91428827b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:48:55.071831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:55.071831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:55.087476 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f245820-1f4b-4b47-b0b8-59b42384ef8d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:55.123259 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:55.154999 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff4124-3007-4993-a15a-5ee36ab45081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:55.155638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff4124-3007-4993-a15a-5ee36ab45081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:55.161587 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff4124-3007-4993-a15a-5ee36ab45081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:55.161905 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff4124-3007-4993-a15a-5ee36ab45081 admin admin] PATH_INFO: `/v3/projects/098eb7a8c07a467d8100efd03a866c2f` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:55.163137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff4124-3007-4993-a15a-5ee36ab45081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=098eb7a8c07a467d8100efd03a866c2f)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:55.165226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff4124-3007-4993-a15a-5ee36ab45081 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:55.263823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-31ff4124-3007-4993-a15a-5ee36ab45081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098eb7a8c07a467d8100efd03a866c2f', 'request_id': 'req-31ff4124-3007-4993-a15a-5ee36ab45081'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:55.338512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-31ff4124-3007-4993-a15a-5ee36ab45081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098eb7a8c07a467d8100efd03a866c2f', 'request_id': 'req-31ff4124-3007-4993-a15a-5ee36ab45081'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:55.344541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-31ff4124-3007-4993-a15a-5ee36ab45081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098eb7a8c07a467d8100efd03a866c2f', 'request_id': 'req-31ff4124-3007-4993-a15a-5ee36ab45081'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:55.355874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-31ff4124-3007-4993-a15a-5ee36ab45081 admin admin] The token cache is being invalidate because project 098eb7a8c07a467d8100efd03a866c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:48:55.356172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-31ff4124-3007-4993-a15a-5ee36ab45081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:55.356869 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-31ff4124-3007-4993-a15a-5ee36ab45081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:48:55.358443 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1258/2511] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:48:55 2022] DELETE /identity/v3/projects/098eb7a8c07a467d8100efd03a866c2f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:48:55.364182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295914-38b6-4e9c-a2ea-bf61c5584f7f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:55.364641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295914-38b6-4e9c-a2ea-bf61c5584f7f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:55.364756 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295914-38b6-4e9c-a2ea-bf61c5584f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:55.384990 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-79295914-38b6-4e9c-a2ea-bf61c5584f7f None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:48:55.387062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-79295914-38b6-4e9c-a2ea-bf61c5584f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:55.438838 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:55.451689 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1254/2512] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:48:55.459449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda28f2-1c38-41e6-a694-27014e393623 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:55.459733 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda28f2-1c38-41e6-a694-27014e393623 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:55.460006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda28f2-1c38-41e6-a694-27014e393623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:55.480936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-cbda28f2-1c38-41e6-a694-27014e393623 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:48:55.482178 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cbda28f2-1c38-41e6-a694-27014e393623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:55.490826 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1259/2513] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:48:55.495214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79295914-38b6-4e9c-a2ea-bf61c5584f7f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:55.505527 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79295914-38b6-4e9c-a2ea-bf61c5584f7f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:55.512462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8d1b5-6726-4864-a3db-413c75cdf6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:55.512982 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d1b5-6726-4864-a3db-413c75cdf6ab admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:55.513361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d1b5-6726-4864-a3db-413c75cdf6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:55.517910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d1b5-6726-4864-a3db-413c75cdf6ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:55.517910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8d1b5-6726-4864-a3db-413c75cdf6ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:48:55.517910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8d1b5-6726-4864-a3db-413c75cdf6ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:55.517910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8d1b5-6726-4864-a3db-413c75cdf6ab admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:55.537093 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1255/2514] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:48:55.540343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda28f2-1c38-41e6-a694-27014e393623 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:55.552788 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda28f2-1c38-41e6-a694-27014e393623 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:55.557584 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a2e46-537a-4716-9ede-a255d7da4560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:55.558236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a2e46-537a-4716-9ede-a255d7da4560 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:55.558511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a2e46-537a-4716-9ede-a255d7da4560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:55.558901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a2e46-537a-4716-9ede-a255d7da4560 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:55.559571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a2e46-537a-4716-9ede-a255d7da4560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:55.561506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a2e46-537a-4716-9ede-a255d7da4560 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:55.648350 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1260/2515] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:48:55 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:48:55.652966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8d1b5-6726-4864-a3db-413c75cdf6ab admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:55.663218 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8d1b5-6726-4864-a3db-413c75cdf6ab admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:55.723817 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea366c66-b6f4-40ed-a037-629aabafb13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:55.724422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea366c66-b6f4-40ed-a037-629aabafb13f admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:55.724706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea366c66-b6f4-40ed-a037-629aabafb13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:55.724970 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea366c66-b6f4-40ed-a037-629aabafb13f admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:55.725667 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea366c66-b6f4-40ed-a037-629aabafb13f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:55.727570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea366c66-b6f4-40ed-a037-629aabafb13f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:55.830144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1256/2516] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:48:55 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:48:55.831345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a2e46-537a-4716-9ede-a255d7da4560 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:55.847804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a2e46-537a-4716-9ede-a255d7da4560 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:55.853039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0d67e-726d-484b-9088-77042dd8d357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:55.853936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d67e-726d-484b-9088-77042dd8d357 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:55.854147 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d67e-726d-484b-9088-77042dd8d357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:55.854436 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d67e-726d-484b-9088-77042dd8d357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:55.855369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0d67e-726d-484b-9088-77042dd8d357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:55.857062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0d67e-726d-484b-9088-77042dd8d357 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:55.869710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1261/2517] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:48:55.876205 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea366c66-b6f4-40ed-a037-629aabafb13f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:55.889531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea366c66-b6f4-40ed-a037-629aabafb13f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:55.894666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a7c7d-cfa5-45b5-b846-40943b6c9d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:55.895673 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a7c7d-cfa5-45b5-b846-40943b6c9d52 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:55.896011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a7c7d-cfa5-45b5-b846-40943b6c9d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:55.904663 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a7c7d-cfa5-45b5-b846-40943b6c9d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:55.904663 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a7c7d-cfa5-45b5-b846-40943b6c9d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:55.910064 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a7c7d-cfa5-45b5-b846-40943b6c9d52 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:55.924793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1257/2518] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:48:55.929383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0d67e-726d-484b-9088-77042dd8d357 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:55.946833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0d67e-726d-484b-9088-77042dd8d357 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:55.953832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0488798-e99f-4d87-a955-36921058c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:55.954724 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0488798-e99f-4d87-a955-36921058c9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:55.962148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0488798-e99f-4d87-a955-36921058c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:55.962148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0488798-e99f-4d87-a955-36921058c9c2 admin admin] PATH_INFO: `/v3/projects/f728de9d756640a6b40fb1b305e4e681/users/6b056057f62b49c198c5594cbcafcc23/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:55.983277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0488798-e99f-4d87-a955-36921058c9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f728de9d756640a6b40fb1b305e4e681, user_id=6b056057f62b49c198c5594cbcafcc23, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:55.986236 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0488798-e99f-4d87-a955-36921058c9c2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:56.050549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1262/2519] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:48:55 2022] PUT /identity/v3/projects/f728de9d756640a6b40fb1b305e4e681/users/6b056057f62b49c198c5594cbcafcc23/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:48:56.061858 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd04a2-02eb-43cc-89f8-a6f3f8e80f21 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:56.062229 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd04a2-02eb-43cc-89f8-a6f3f8e80f21 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:56.062576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd04a2-02eb-43cc-89f8-a6f3f8e80f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:56.093118 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-eafd04a2-02eb-43cc-89f8-a6f3f8e80f21 None None] MFA Rules not processed for user `6b056057f62b49c198c5594cbcafcc23`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:48:56.094705 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-eafd04a2-02eb-43cc-89f8-a6f3f8e80f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:56.168470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1258/2520] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:48:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:48:56.173341 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0488798-e99f-4d87-a955-36921058c9c2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:56.242441 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0488798-e99f-4d87-a955-36921058c9c2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:56.248159 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe51df-736d-46e2-89f0-186f7bd66b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:56.248863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe51df-736d-46e2-89f0-186f7bd66b89 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:56.249269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe51df-736d-46e2-89f0-186f7bd66b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:56.249457 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe51df-736d-46e2-89f0-186f7bd66b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:56.250095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe51df-736d-46e2-89f0-186f7bd66b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:56.252019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe51df-736d-46e2-89f0-186f7bd66b89 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:56.257126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:56.365001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1263/2521] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:48:56 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:48:56.369697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd04a2-02eb-43cc-89f8-a6f3f8e80f21 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:56.381287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd04a2-02eb-43cc-89f8-a6f3f8e80f21 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:56.437099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:56.450941 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8713a3-7363-44a4-a9f4-bc54bdb4ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:56.451617 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8713a3-7363-44a4-a9f4-bc54bdb4ee56 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:56.451895 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8713a3-7363-44a4-a9f4-bc54bdb4ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:56.452168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8713a3-7363-44a4-a9f4-bc54bdb4ee56 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:56.452821 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8713a3-7363-44a4-a9f4-bc54bdb4ee56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:56.454880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8713a3-7363-44a4-a9f4-bc54bdb4ee56 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:56.568238 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1259/2522] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:48:56 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:48:56.572389 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe51df-736d-46e2-89f0-186f7bd66b89 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:56.595736 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe51df-736d-46e2-89f0-186f7bd66b89 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:56.600600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af84845-3ab7-4413-b84c-c66201f05a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:56.601242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84845-3ab7-4413-b84c-c66201f05a3f admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:56.601532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84845-3ab7-4413-b84c-c66201f05a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:56.607865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84845-3ab7-4413-b84c-c66201f05a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:56.607865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af84845-3ab7-4413-b84c-c66201f05a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:56.607865 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af84845-3ab7-4413-b84c-c66201f05a3f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:56.615343 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1264/2523] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:48:56.619532 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8713a3-7363-44a4-a9f4-bc54bdb4ee56 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:56.630722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8713a3-7363-44a4-a9f4-bc54bdb4ee56 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:56.635477 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fdcfc-9c60-4984-8fbf-5cef3c820a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:56.637134 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fdcfc-9c60-4984-8fbf-5cef3c820a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:56.637485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fdcfc-9c60-4984-8fbf-5cef3c820a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:56.637766 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fdcfc-9c60-4984-8fbf-5cef3c820a41 admin admin] PATH_INFO: `/v3/projects/8671a4a5a4a14cac9d21ffcb6959c05c/users/692f54329db2422e95f2db5d70504ae0/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:56.654446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fdcfc-9c60-4984-8fbf-5cef3c820a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8671a4a5a4a14cac9d21ffcb6959c05c, user_id=692f54329db2422e95f2db5d70504ae0, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:56.657295 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fdcfc-9c60-4984-8fbf-5cef3c820a41 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:56.751457 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1260/2524] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:48:56 2022] PUT /identity/v3/projects/8671a4a5a4a14cac9d21ffcb6959c05c/users/692f54329db2422e95f2db5d70504ae0/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:48:56.755606 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af84845-3ab7-4413-b84c-c66201f05a3f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:56.766827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af84845-3ab7-4413-b84c-c66201f05a3f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:56.843328 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41850778-2264-4937-b13f-351a9e7a665d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:56.843963 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41850778-2264-4937-b13f-351a9e7a665d admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:56.844233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41850778-2264-4937-b13f-351a9e7a665d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:56.844510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41850778-2264-4937-b13f-351a9e7a665d admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:56.845159 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41850778-2264-4937-b13f-351a9e7a665d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:56.846796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41850778-2264-4937-b13f-351a9e7a665d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:56.861231 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1265/2525] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:48:56.862716 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fdcfc-9c60-4984-8fbf-5cef3c820a41 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:56.878911 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fdcfc-9c60-4984-8fbf-5cef3c820a41 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:56.886466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb15c28-f9a2-44cf-95d7-afbaf1d3a7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:56.887261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb15c28-f9a2-44cf-95d7-afbaf1d3a7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:56.887540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb15c28-f9a2-44cf-95d7-afbaf1d3a7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:56.887938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb15c28-f9a2-44cf-95d7-afbaf1d3a7f3 admin admin] PATH_INFO: `/v3/projects/8671a4a5a4a14cac9d21ffcb6959c05c/users/692f54329db2422e95f2db5d70504ae0/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:56.890048 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb15c28-f9a2-44cf-95d7-afbaf1d3a7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8671a4a5a4a14cac9d21ffcb6959c05c, user_id=692f54329db2422e95f2db5d70504ae0, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:56.892665 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb15c28-f9a2-44cf-95d7-afbaf1d3a7f3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:56.904330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1261/2526] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:48:56 2022] PUT /identity/v3/projects/8671a4a5a4a14cac9d21ffcb6959c05c/users/692f54329db2422e95f2db5d70504ae0/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:48:56.915723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd920ae-323b-4da6-8bd2-c74c5dcda52c None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:56.916008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd920ae-323b-4da6-8bd2-c74c5dcda52c None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:56.916294 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd920ae-323b-4da6-8bd2-c74c5dcda52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:56.945692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-afd920ae-323b-4da6-8bd2-c74c5dcda52c None None] MFA Rules not processed for user `692f54329db2422e95f2db5d70504ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:48:56.946857 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-afd920ae-323b-4da6-8bd2-c74c5dcda52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:57.018170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1266/2527] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:48:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:48:57.031406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb15c28-f9a2-44cf-95d7-afbaf1d3a7f3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:57.032625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9bb15c28-f9a2-44cf-95d7-afbaf1d3a7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:48:57.095787 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb15c28-f9a2-44cf-95d7-afbaf1d3a7f3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:57.099490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d92d4f-c1e7-47a6-9306-d1137e656215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:57.100092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d92d4f-c1e7-47a6-9306-d1137e656215 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:57.100469 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d92d4f-c1e7-47a6-9306-d1137e656215 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:57.100699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d92d4f-c1e7-47a6-9306-d1137e656215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:57.110557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d92d4f-c1e7-47a6-9306-d1137e656215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:57.111972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d92d4f-c1e7-47a6-9306-d1137e656215 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:57.122524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1262/2528] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:48:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:48:57.378393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd920ae-323b-4da6-8bd2-c74c5dcda52c None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:48:57.388404 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd920ae-323b-4da6-8bd2-c74c5dcda52c None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:48:57.392015 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511cbb9-861d-42cb-875d-061879d1aaba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:48:57.392681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511cbb9-861d-42cb-875d-061879d1aaba service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:48:57.392988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511cbb9-861d-42cb-875d-061879d1aaba service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:48:57.393298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511cbb9-861d-42cb-875d-061879d1aaba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:48:57.448113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:48:57.452115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511cbb9-861d-42cb-875d-061879d1aaba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:48:57.453598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511cbb9-861d-42cb-875d-061879d1aaba service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:48:57.462983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1267/2529] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:48:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:04.992032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bee70-b7bf-4dd9-b397-0e67973ee464 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:04.992518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bee70-b7bf-4dd9-b397-0e67973ee464 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:04.992632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bee70-b7bf-4dd9-b397-0e67973ee464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:05.012402 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-764bee70-b7bf-4dd9-b397-0e67973ee464 None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:05.013784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-764bee70-b7bf-4dd9-b397-0e67973ee464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:05.104056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1263/2530] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:49:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:05.252261 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511cbb9-861d-42cb-875d-061879d1aaba service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:05.254595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d511cbb9-861d-42cb-875d-061879d1aaba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:05.333669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511cbb9-861d-42cb-875d-061879d1aaba service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:05.338938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722d1d1-f6d3-404b-9806-a96d49f5b265 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:05.339565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722d1d1-f6d3-404b-9806-a96d49f5b265 service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:05.339848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722d1d1-f6d3-404b-9806-a96d49f5b265 service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:05.340123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722d1d1-f6d3-404b-9806-a96d49f5b265 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:05.348725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722d1d1-f6d3-404b-9806-a96d49f5b265 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:05.350630 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722d1d1-f6d3-404b-9806-a96d49f5b265 service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:05.359721 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1268/2531] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:49:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:49:06.317550 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bee70-b7bf-4dd9-b397-0e67973ee464 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:06.463330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722d1d1-f6d3-404b-9806-a96d49f5b265 service swift] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:06.464805 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0722d1d1-f6d3-404b-9806-a96d49f5b265 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:06.503220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:06.559136 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bee70-b7bf-4dd9-b397-0e67973ee464 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:06.570373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f99de-daaf-4344-807c-7ecbcfa3a047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:06.571322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f99de-daaf-4344-807c-7ecbcfa3a047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:06.571958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f99de-daaf-4344-807c-7ecbcfa3a047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:06.572455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f99de-daaf-4344-807c-7ecbcfa3a047 admin admin] PATH_INFO: `/v3/users/6b056057f62b49c198c5594cbcafcc23` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:06.574159 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f99de-daaf-4344-807c-7ecbcfa3a047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b056057f62b49c198c5594cbcafcc23)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:06.577705 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f99de-daaf-4344-807c-7ecbcfa3a047 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:06.592753 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722d1d1-f6d3-404b-9806-a96d49f5b265 service swift] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:06.606383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98974a6f-98db-4290-9442-9e41f3868385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:06.607014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98974a6f-98db-4290-9442-9e41f3868385 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:06.607296 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98974a6f-98db-4290-9442-9e41f3868385 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:06.607570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98974a6f-98db-4290-9442-9e41f3868385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:06.612272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-98974a6f-98db-4290-9442-9e41f3868385 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:06.642500 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98974a6f-98db-4290-9442-9e41f3868385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:06.646722 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98974a6f-98db-4290-9442-9e41f3868385 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:06.670918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1269/2532] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:49:06.672003 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98974a6f-98db-4290-9442-9e41f3868385 service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:06.673575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-98974a6f-98db-4290-9442-9e41f3868385 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:06.688999 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98974a6f-98db-4290-9442-9e41f3868385 service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:06.694699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f046e-93bf-40de-a3fb-69b129fff66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:06.695507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f046e-93bf-40de-a3fb-69b129fff66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:06.695934 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f046e-93bf-40de-a3fb-69b129fff66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:06.696380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f046e-93bf-40de-a3fb-69b129fff66f admin admin] PATH_INFO: `/v3/users/5b584800b7f0409bb1d3069718397c2e` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:06.697841 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f046e-93bf-40de-a3fb-69b129fff66f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b584800b7f0409bb1d3069718397c2e)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:06.699905 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f046e-93bf-40de-a3fb-69b129fff66f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:06.786180 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f04f99de-daaf-4344-807c-7ecbcfa3a047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b056057f62b49c198c5594cbcafcc23'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:06.787180 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f04f99de-daaf-4344-807c-7ecbcfa3a047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b056057f62b49c198c5594cbcafcc23'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:06.807728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f04f99de-daaf-4344-807c-7ecbcfa3a047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b056057f62b49c198c5594cbcafcc23'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:06.818580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f04f99de-daaf-4344-807c-7ecbcfa3a047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b056057f62b49c198c5594cbcafcc23'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:06.819472 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f04f99de-daaf-4344-807c-7ecbcfa3a047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b056057f62b49c198c5594cbcafcc23'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:06.867959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4b0f046e-93bf-40de-a3fb-69b129fff66f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b584800b7f0409bb1d3069718397c2e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:06.880008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1264/2533] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:49:06 2022] DELETE /identity/v3/users/6b056057f62b49c198c5594cbcafcc23 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:06.883358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:06.884515 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4b0f046e-93bf-40de-a3fb-69b129fff66f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b584800b7f0409bb1d3069718397c2e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:06.886382 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa82f92-81cc-434a-acb3-821b517a202e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:06.886984 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa82f92-81cc-434a-acb3-821b517a202e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:06.887483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa82f92-81cc-434a-acb3-821b517a202e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:06.911211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5fa82f92-81cc-434a-acb3-821b517a202e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:06.912937 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5fa82f92-81cc-434a-acb3-821b517a202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:06.973106 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4b0f046e-93bf-40de-a3fb-69b129fff66f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b584800b7f0409bb1d3069718397c2e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:06.982509 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4b0f046e-93bf-40de-a3fb-69b129fff66f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b584800b7f0409bb1d3069718397c2e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:06.983942 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4b0f046e-93bf-40de-a3fb-69b129fff66f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b584800b7f0409bb1d3069718397c2e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:06.990769 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1270/2534] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:49:06 2022] DELETE /identity/v3/users/5b584800b7f0409bb1d3069718397c2e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:07.007170 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1265/2535] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:07.019505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f046e-93bf-40de-a3fb-69b129fff66f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:07.021369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4b0f046e-93bf-40de-a3fb-69b129fff66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:07.228091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f046e-93bf-40de-a3fb-69b129fff66f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:07.228091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e574b09-f486-4fec-91e4-3cc5696f5c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:07.228091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e574b09-f486-4fec-91e4-3cc5696f5c42 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:07.228091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e574b09-f486-4fec-91e4-3cc5696f5c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:07.229495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e574b09-f486-4fec-91e4-3cc5696f5c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:07.266979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e574b09-f486-4fec-91e4-3cc5696f5c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:07.268719 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e574b09-f486-4fec-91e4-3cc5696f5c42 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:07.282946 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1271/2536] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:07.465619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa82f92-81cc-434a-acb3-821b517a202e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:07.468960 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5fa82f92-81cc-434a-acb3-821b517a202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:07.485168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa82f92-81cc-434a-acb3-821b517a202e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:07.491947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:07.492076 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:07.492300 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:07.492581 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] PATH_INFO: `/v3/projects/0ae08e291863440f88582fdbde3c0237` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:07.493928 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae08e291863440f88582fdbde3c0237)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:07.495882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:07.683547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae08e291863440f88582fdbde3c0237', 'request_id': 'req-fd005459-2a19-416d-ab0d-8c30686c8ff2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:07.782974 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae08e291863440f88582fdbde3c0237', 'request_id': 'req-fd005459-2a19-416d-ab0d-8c30686c8ff2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:07.788990 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:07.792249 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae08e291863440f88582fdbde3c0237', 'request_id': 'req-fd005459-2a19-416d-ab0d-8c30686c8ff2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:07.818601 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] The token cache is being invalidate because project 0ae08e291863440f88582fdbde3c0237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:49:07.821338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:07.821338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:07.824644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1266/2537] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:49:07 2022] DELETE /identity/v3/projects/0ae08e291863440f88582fdbde3c0237 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:07.826511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeb635-4f26-42dc-94a8-f1cbee960b9f None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:07.827576 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeb635-4f26-42dc-94a8-f1cbee960b9f None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:07.828018 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeb635-4f26-42dc-94a8-f1cbee960b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:07.897972 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-75eeb635-4f26-42dc-94a8-f1cbee960b9f None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:07.899270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-75eeb635-4f26-42dc-94a8-f1cbee960b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:07.964664 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:07.965489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:08.008274 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1272/2538] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:08.016676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af42f-a0a6-41bc-960d-feaf67730c0a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:08.017105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af42f-a0a6-41bc-960d-feaf67730c0a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:08.017406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af42f-a0a6-41bc-960d-feaf67730c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:08.037439 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-3b2af42f-a0a6-41bc-960d-feaf67730c0a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:08.039468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3b2af42f-a0a6-41bc-960d-feaf67730c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:08.055943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1273/2539] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:08.055943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2af42f-a0a6-41bc-960d-feaf67730c0a None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:08.064032 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd005459-2a19-416d-ab0d-8c30686c8ff2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:08.066524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2af42f-a0a6-41bc-960d-feaf67730c0a None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:08.069356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:08.070097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:08.070459 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:08.073358 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] PATH_INFO: `/v3/projects/f728de9d756640a6b40fb1b305e4e681` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:08.079462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18133069-2163-4b31-a264-4bec8e7ab2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:08.079462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18133069-2163-4b31-a264-4bec8e7ab2ca admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:08.079462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18133069-2163-4b31-a264-4bec8e7ab2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:08.079462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18133069-2163-4b31-a264-4bec8e7ab2ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:08.079821 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f728de9d756640a6b40fb1b305e4e681)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:08.079928 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18133069-2163-4b31-a264-4bec8e7ab2ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:49:08.079928 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18133069-2163-4b31-a264-4bec8e7ab2ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:08.083330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:08.083901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18133069-2163-4b31-a264-4bec8e7ab2ca admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:08.111642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1274/2540] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:49:08.112759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18133069-2163-4b31-a264-4bec8e7ab2ca admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:08.125249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18133069-2163-4b31-a264-4bec8e7ab2ca admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:08.139820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966a52e-34b2-4a64-9910-25354c664dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:08.139820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966a52e-34b2-4a64-9910-25354c664dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:08.139820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966a52e-34b2-4a64-9910-25354c664dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:08.139820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966a52e-34b2-4a64-9910-25354c664dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:08.140223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966a52e-34b2-4a64-9910-25354c664dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:08.140223 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966a52e-34b2-4a64-9910-25354c664dbb admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:08.147000 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:08.209115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f728de9d756640a6b40fb1b305e4e681', 'request_id': 'req-c0358f0a-802e-487a-8236-5551cc1f03c1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:08.235680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1275/2541] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:49:08 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:49:08.237221 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966a52e-34b2-4a64-9910-25354c664dbb admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:08.283588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f728de9d756640a6b40fb1b305e4e681', 'request_id': 'req-c0358f0a-802e-487a-8236-5551cc1f03c1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:08.293778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f728de9d756640a6b40fb1b305e4e681', 'request_id': 'req-c0358f0a-802e-487a-8236-5551cc1f03c1'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:08.318034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] The token cache is being invalidate because project f728de9d756640a6b40fb1b305e4e681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:49:08.318501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:08.319259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:08.320917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1267/2542] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:49:07 2022] DELETE /identity/v3/projects/f728de9d756640a6b40fb1b305e4e681 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:49:08.324796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:08.326644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:08.329431 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966a52e-34b2-4a64-9910-25354c664dbb admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:08.335531 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a969a-af44-48d3-afad-a8b59ff666c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:08.336645 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a969a-af44-48d3-afad-a8b59ff666c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:08.336927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a969a-af44-48d3-afad-a8b59ff666c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:08.337303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a969a-af44-48d3-afad-a8b59ff666c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:08.338023 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a969a-af44-48d3-afad-a8b59ff666c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:08.340088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a969a-af44-48d3-afad-a8b59ff666c9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:08.408396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0358f0a-802e-487a-8236-5551cc1f03c1 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:08.413759 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b672b5-cd3a-4950-89d1-4f1b10ae169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:08.414660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b672b5-cd3a-4950-89d1-4f1b10ae169f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:08.415107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b672b5-cd3a-4950-89d1-4f1b10ae169f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:08.415551 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b672b5-cd3a-4950-89d1-4f1b10ae169f admin admin] PATH_INFO: `/v3/users/692f54329db2422e95f2db5d70504ae0` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:08.418343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b672b5-cd3a-4950-89d1-4f1b10ae169f admin admin] RBAC: Authorizing `identity:delete_user(user_id=692f54329db2422e95f2db5d70504ae0)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:08.420696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b672b5-cd3a-4950-89d1-4f1b10ae169f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:08.429790 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1276/2543] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:49:08 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:08.433823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a969a-af44-48d3-afad-a8b59ff666c9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:08.439603 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5f7a969a-af44-48d3-afad-a8b59ff666c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:08.453825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:08.460374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a969a-af44-48d3-afad-a8b59ff666c9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:08.465788 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd518f3f-8a30-4299-84f1-f341c56d3556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:08.466487 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd518f3f-8a30-4299-84f1-f341c56d3556 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:08.466836 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd518f3f-8a30-4299-84f1-f341c56d3556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:08.467179 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd518f3f-8a30-4299-84f1-f341c56d3556 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:08.469495 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd518f3f-8a30-4299-84f1-f341c56d3556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:08.471198 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd518f3f-8a30-4299-84f1-f341c56d3556 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:08.485325 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1277/2544] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:08.489678 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd518f3f-8a30-4299-84f1-f341c56d3556 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:08.500420 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd518f3f-8a30-4299-84f1-f341c56d3556 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:08.505333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a40235-7841-4c7d-84f1-98d38f85071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:08.506128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a40235-7841-4c7d-84f1-98d38f85071e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:08.506407 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a40235-7841-4c7d-84f1-98d38f85071e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:08.506676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a40235-7841-4c7d-84f1-98d38f85071e admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:08.507371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a40235-7841-4c7d-84f1-98d38f85071e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:08.509028 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a40235-7841-4c7d-84f1-98d38f85071e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:08.523835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1278/2545] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:08.528283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a40235-7841-4c7d-84f1-98d38f85071e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:08.541947 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a40235-7841-4c7d-84f1-98d38f85071e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:08.550167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598ce68-67c0-4827-9a05-92caf90b70a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:08.550961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ce68-67c0-4827-9a05-92caf90b70a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:08.551241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ce68-67c0-4827-9a05-92caf90b70a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:08.551516 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ce68-67c0-4827-9a05-92caf90b70a1 admin admin] PATH_INFO: `/v3/projects/83d77b81bf634c0e9df9f1a4856b8080/users/b29c4ee64a444504b32748e5a2e9a38c/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:08.568879 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598ce68-67c0-4827-9a05-92caf90b70a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d77b81bf634c0e9df9f1a4856b8080, user_id=b29c4ee64a444504b32748e5a2e9a38c, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:08.571561 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598ce68-67c0-4827-9a05-92caf90b70a1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:08.876387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1279/2546] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:08 2022] PUT /identity/v3/projects/83d77b81bf634c0e9df9f1a4856b8080/users/b29c4ee64a444504b32748e5a2e9a38c/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:49:08.887911 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41490c8d-ae21-4b69-b2f5-e42c1753eb88 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:08.888252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41490c8d-ae21-4b69-b2f5-e42c1753eb88 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:08.888679 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41490c8d-ae21-4b69-b2f5-e42c1753eb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:08.911542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a9b672b5-cd3a-4950-89d1-4f1b10ae169f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '692f54329db2422e95f2db5d70504ae0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:08.912462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a9b672b5-cd3a-4950-89d1-4f1b10ae169f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '692f54329db2422e95f2db5d70504ae0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:08.919061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-41490c8d-ae21-4b69-b2f5-e42c1753eb88 None None] MFA Rules not processed for user `b29c4ee64a444504b32748e5a2e9a38c`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:08.920358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-41490c8d-ae21-4b69-b2f5-e42c1753eb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:08.930416 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a9b672b5-cd3a-4950-89d1-4f1b10ae169f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '692f54329db2422e95f2db5d70504ae0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:08.939686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a9b672b5-cd3a-4950-89d1-4f1b10ae169f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '692f54329db2422e95f2db5d70504ae0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:08.940714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-a9b672b5-cd3a-4950-89d1-4f1b10ae169f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '692f54329db2422e95f2db5d70504ae0'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:08.997132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1280/2547] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:49:09.002245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41490c8d-ae21-4b69-b2f5-e42c1753eb88 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:09.003660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-41490c8d-ae21-4b69-b2f5-e42c1753eb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:09.032112 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:09.061174 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1268/2548] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:49:08 2022] DELETE /identity/v3/users/692f54329db2422e95f2db5d70504ae0 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:09.120665 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41490c8d-ae21-4b69-b2f5-e42c1753eb88 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:09.197346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea55251-77c9-4104-8b12-fd399f6d43cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:09.197957 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea55251-77c9-4104-8b12-fd399f6d43cd admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:09.198243 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea55251-77c9-4104-8b12-fd399f6d43cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:09.198504 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea55251-77c9-4104-8b12-fd399f6d43cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:09.199143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea55251-77c9-4104-8b12-fd399f6d43cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:09.201149 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea55251-77c9-4104-8b12-fd399f6d43cd admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:09.322193 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1281/2549] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:49:09 2022] POST /identity/v3/projects => generated 373 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:49:09.323425 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b672b5-cd3a-4950-89d1-4f1b10ae169f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:09.340558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b672b5-cd3a-4950-89d1-4f1b10ae169f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:09.417100 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ed54-660d-403b-b60e-e61e0e0988ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:09.418885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ed54-660d-403b-b60e-e61e0e0988ae admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:09.419500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ed54-660d-403b-b60e-e61e0e0988ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:09.419943 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ed54-660d-403b-b60e-e61e0e0988ae admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:09.420776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279ed54-660d-403b-b60e-e61e0e0988ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:09.423206 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279ed54-660d-403b-b60e-e61e0e0988ae admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:09.557759 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1269/2550] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:49:09 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:49:09.559055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea55251-77c9-4104-8b12-fd399f6d43cd admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:09.571252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea55251-77c9-4104-8b12-fd399f6d43cd admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:09.580181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f238d7b-08d1-44d3-8cf5-ee0813de3d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:09.580181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f238d7b-08d1-44d3-8cf5-ee0813de3d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:09.580181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f238d7b-08d1-44d3-8cf5-ee0813de3d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:09.580181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f238d7b-08d1-44d3-8cf5-ee0813de3d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:09.580524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f238d7b-08d1-44d3-8cf5-ee0813de3d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:09.584126 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ed54-660d-403b-b60e-e61e0e0988ae admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:09.585230 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f238d7b-08d1-44d3-8cf5-ee0813de3d1a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:09.585904 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e279ed54-660d-403b-b60e-e61e0e0988ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:09.602687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ed54-660d-403b-b60e-e61e0e0988ae admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:09.604600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1282/2551] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:09.608557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e8855-bbda-4b63-9ab0-85f573524111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:09.609600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e8855-bbda-4b63-9ab0-85f573524111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:09.609729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e8855-bbda-4b63-9ab0-85f573524111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:09.609954 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e8855-bbda-4b63-9ab0-85f573524111 admin admin] PATH_INFO: `/v3/projects/8671a4a5a4a14cac9d21ffcb6959c05c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:09.611133 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e8855-bbda-4b63-9ab0-85f573524111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8671a4a5a4a14cac9d21ffcb6959c05c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:09.612982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f238d7b-08d1-44d3-8cf5-ee0813de3d1a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:09.613422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e8855-bbda-4b63-9ab0-85f573524111 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:09.629370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f238d7b-08d1-44d3-8cf5-ee0813de3d1a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:09.638054 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc409720-34a5-4986-8a6a-971feff70f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:09.638910 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc409720-34a5-4986-8a6a-971feff70f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:09.639392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc409720-34a5-4986-8a6a-971feff70f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:09.640333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc409720-34a5-4986-8a6a-971feff70f92 admin admin] PATH_INFO: `/v3/projects/c9e42d86a6064e5b83d04f0fb759b261/users/a2014deb4f2046a0a54610e264b9a005/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:09.662068 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc409720-34a5-4986-8a6a-971feff70f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e42d86a6064e5b83d04f0fb759b261, user_id=a2014deb4f2046a0a54610e264b9a005, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:09.664889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc409720-34a5-4986-8a6a-971feff70f92 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:09.780567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1283/2552] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:09 2022] PUT /identity/v3/projects/c9e42d86a6064e5b83d04f0fb759b261/users/a2014deb4f2046a0a54610e264b9a005/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:49:09.784964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc409720-34a5-4986-8a6a-971feff70f92 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:09.793092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-352e8855-bbda-4b63-9ab0-85f573524111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8671a4a5a4a14cac9d21ffcb6959c05c', 'request_id': 'req-352e8855-bbda-4b63-9ab0-85f573524111'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:09.866330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc409720-34a5-4986-8a6a-971feff70f92 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:09.869673 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-352e8855-bbda-4b63-9ab0-85f573524111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8671a4a5a4a14cac9d21ffcb6959c05c', 'request_id': 'req-352e8855-bbda-4b63-9ab0-85f573524111'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:09.873233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf6187-1bba-4535-a901-ae0c12280f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:09.874491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf6187-1bba-4535-a901-ae0c12280f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:09.874836 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf6187-1bba-4535-a901-ae0c12280f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:09.875174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf6187-1bba-4535-a901-ae0c12280f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:09.875918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf6187-1bba-4535-a901-ae0c12280f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:09.877729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf6187-1bba-4535-a901-ae0c12280f76 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:09.879202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-352e8855-bbda-4b63-9ab0-85f573524111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8671a4a5a4a14cac9d21ffcb6959c05c', 'request_id': 'req-352e8855-bbda-4b63-9ab0-85f573524111'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:09.889227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1284/2553] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:49:09.893765 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf6187-1bba-4535-a901-ae0c12280f76 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:09.894297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-352e8855-bbda-4b63-9ab0-85f573524111 admin admin] The token cache is being invalidate because project 8671a4a5a4a14cac9d21ffcb6959c05c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:49:09.894777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-352e8855-bbda-4b63-9ab0-85f573524111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:09.895783 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-352e8855-bbda-4b63-9ab0-85f573524111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:09.902326 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1270/2554] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:49:09 2022] DELETE /identity/v3/projects/8671a4a5a4a14cac9d21ffcb6959c05c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:09.904124 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501d7d-a166-4dab-850d-1eb57edafdf9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:09.904623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501d7d-a166-4dab-850d-1eb57edafdf9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:09.905636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501d7d-a166-4dab-850d-1eb57edafdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:09.906071 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf6187-1bba-4535-a901-ae0c12280f76 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:09.919528 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f41a03-3a79-4c32-84c0-ab95da898dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:09.920295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f41a03-3a79-4c32-84c0-ab95da898dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:09.921322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f41a03-3a79-4c32-84c0-ab95da898dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:09.921685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f41a03-3a79-4c32-84c0-ab95da898dbd admin admin] PATH_INFO: `/v3/projects/c9e42d86a6064e5b83d04f0fb759b261/users/a2014deb4f2046a0a54610e264b9a005/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:09.923746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f41a03-3a79-4c32-84c0-ab95da898dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e42d86a6064e5b83d04f0fb759b261, user_id=a2014deb4f2046a0a54610e264b9a005, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:09.926548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f41a03-3a79-4c32-84c0-ab95da898dbd admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:09.933183 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-52501d7d-a166-4dab-850d-1eb57edafdf9 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:09.934490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-52501d7d-a166-4dab-850d-1eb57edafdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:09.939262 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1285/2555] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:09 2022] PUT /identity/v3/projects/c9e42d86a6064e5b83d04f0fb759b261/users/a2014deb4f2046a0a54610e264b9a005/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:49:09.945407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=82,keystone:DELETE=13,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:09.950013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f1dc-546c-4206-8074-388fa0490451 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:09.950299 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f1dc-546c-4206-8074-388fa0490451 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:09.950597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f1dc-546c-4206-8074-388fa0490451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:09.959430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:09.984365 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-9053f1dc-546c-4206-8074-388fa0490451 None None] MFA Rules not processed for user `a2014deb4f2046a0a54610e264b9a005`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:09.985669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9053f1dc-546c-4206-8074-388fa0490451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:10.013289 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1271/2556] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:10.022483 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd02d4-3069-413e-8bd9-8d79a5db60e7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:10.022919 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd02d4-3069-413e-8bd9-8d79a5db60e7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:10.023506 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd02d4-3069-413e-8bd9-8d79a5db60e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:10.053037 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7dfd02d4-3069-413e-8bd9-8d79a5db60e7 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:10.054722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7dfd02d4-3069-413e-8bd9-8d79a5db60e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:10.065580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1272/2557] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:49:10.069877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd02d4-3069-413e-8bd9-8d79a5db60e7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:10.091914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd02d4-3069-413e-8bd9-8d79a5db60e7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:10.098559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1286/2558] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:49:10.101357 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ea87d-b5b5-4c68-8efa-96ffa6a3bed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:10.101357 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ea87d-b5b5-4c68-8efa-96ffa6a3bed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:10.101357 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ea87d-b5b5-4c68-8efa-96ffa6a3bed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:10.105293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ea87d-b5b5-4c68-8efa-96ffa6a3bed7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:10.106686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ea87d-b5b5-4c68-8efa-96ffa6a3bed7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:49:10.107073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ea87d-b5b5-4c68-8efa-96ffa6a3bed7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:10.110727 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ea87d-b5b5-4c68-8efa-96ffa6a3bed7 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:10.127758 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1273/2559] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:49:10.132171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053f1dc-546c-4206-8074-388fa0490451 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:10.133253 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ea87d-b5b5-4c68-8efa-96ffa6a3bed7 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:10.135372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-9053f1dc-546c-4206-8074-388fa0490451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:10.148409 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ea87d-b5b5-4c68-8efa-96ffa6a3bed7 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:10.156381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd2637-20f5-49bf-9c95-a9be138f6511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:10.158543 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd2637-20f5-49bf-9c95-a9be138f6511 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:10.158543 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd2637-20f5-49bf-9c95-a9be138f6511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:10.158543 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd2637-20f5-49bf-9c95-a9be138f6511 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:10.158543 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd2637-20f5-49bf-9c95-a9be138f6511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:10.160989 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd2637-20f5-49bf-9c95-a9be138f6511 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:10.234781 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053f1dc-546c-4206-8074-388fa0490451 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:10.238569 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b6ab8-e8d1-48d1-8f4f-4de6d2efc867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:10.250059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b6ab8-e8d1-48d1-8f4f-4de6d2efc867 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:10.250059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b6ab8-e8d1-48d1-8f4f-4de6d2efc867 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:10.250059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b6ab8-e8d1-48d1-8f4f-4de6d2efc867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:10.254851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b6ab8-e8d1-48d1-8f4f-4de6d2efc867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:10.260698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b6ab8-e8d1-48d1-8f4f-4de6d2efc867 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:10.274450 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1287/2560] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:10.290015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1274/2561] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:49:10 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:49:10.294903 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b6ab8-e8d1-48d1-8f4f-4de6d2efc867 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:10.316267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b6ab8-e8d1-48d1-8f4f-4de6d2efc867 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:10.402183 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796ce35-81a3-4bf9-9655-d19b908e3146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:10.403339 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796ce35-81a3-4bf9-9655-d19b908e3146 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:10.403880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796ce35-81a3-4bf9-9655-d19b908e3146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:10.404639 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796ce35-81a3-4bf9-9655-d19b908e3146 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:10.405513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796ce35-81a3-4bf9-9655-d19b908e3146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:10.408387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796ce35-81a3-4bf9-9655-d19b908e3146 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:10.515591 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd2637-20f5-49bf-9c95-a9be138f6511 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:10.564174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1288/2562] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:49:10 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:10.567533 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796ce35-81a3-4bf9-9655-d19b908e3146 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:10.586717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796ce35-81a3-4bf9-9655-d19b908e3146 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:10.591737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd2637-20f5-49bf-9c95-a9be138f6511 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:10.594455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484372ad-a875-4320-9c27-5a59e6ffdec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:10.595082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484372ad-a875-4320-9c27-5a59e6ffdec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:10.595353 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484372ad-a875-4320-9c27-5a59e6ffdec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:10.595628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484372ad-a875-4320-9c27-5a59e6ffdec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:10.596271 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484372ad-a875-4320-9c27-5a59e6ffdec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:10.597567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215082e-0f56-402b-8f5a-ed0c9b12439e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:10.597906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484372ad-a875-4320-9c27-5a59e6ffdec0 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:10.598507 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215082e-0f56-402b-8f5a-ed0c9b12439e service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:10.598881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215082e-0f56-402b-8f5a-ed0c9b12439e service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:10.599366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215082e-0f56-402b-8f5a-ed0c9b12439e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:10.601652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9215082e-0f56-402b-8f5a-ed0c9b12439e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:10.610010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1289/2563] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:10.614797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484372ad-a875-4320-9c27-5a59e6ffdec0 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:10.631361 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484372ad-a875-4320-9c27-5a59e6ffdec0 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:10.640156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabe211-de81-4048-975b-014bbdf3d549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:10.640850 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabe211-de81-4048-975b-014bbdf3d549 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:10.641176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabe211-de81-4048-975b-014bbdf3d549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:10.641504 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabe211-de81-4048-975b-014bbdf3d549 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:10.642371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabe211-de81-4048-975b-014bbdf3d549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:10.644083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabe211-de81-4048-975b-014bbdf3d549 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:10.646754 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:10.700757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215082e-0f56-402b-8f5a-ed0c9b12439e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:10.703439 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215082e-0f56-402b-8f5a-ed0c9b12439e service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:10.715635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1275/2564] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:49:10.809386 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1290/2565] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:10.811676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215082e-0f56-402b-8f5a-ed0c9b12439e service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:10.826311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215082e-0f56-402b-8f5a-ed0c9b12439e service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:10.831652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741c7f6-8a62-46a7-aa86-d4cf0a693036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:10.832343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741c7f6-8a62-46a7-aa86-d4cf0a693036 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:10.832619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741c7f6-8a62-46a7-aa86-d4cf0a693036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:10.832890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741c7f6-8a62-46a7-aa86-d4cf0a693036 admin admin] PATH_INFO: `/v3/projects/7289f476907f4f4bb53f62e999bbe175/users/be46ff0c4f1b4ad48ff0ddd438eb1df6/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:10.853519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741c7f6-8a62-46a7-aa86-d4cf0a693036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7289f476907f4f4bb53f62e999bbe175, user_id=be46ff0c4f1b4ad48ff0ddd438eb1df6, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:10.856275 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741c7f6-8a62-46a7-aa86-d4cf0a693036 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:10.940762 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1276/2566] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:10 2022] PUT /identity/v3/projects/7289f476907f4f4bb53f62e999bbe175/users/be46ff0c4f1b4ad48ff0ddd438eb1df6/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:49:10.942780 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70231670-d9a3-4e51-9a76-0239b8fe2db3 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:10.943332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70231670-d9a3-4e51-9a76-0239b8fe2db3 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:10.943717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70231670-d9a3-4e51-9a76-0239b8fe2db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:10.990424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-70231670-d9a3-4e51-9a76-0239b8fe2db3 None None] MFA Rules not processed for user `be46ff0c4f1b4ad48ff0ddd438eb1df6`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:10.991951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-70231670-d9a3-4e51-9a76-0239b8fe2db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:11.088369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1291/2567] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:49:11.094773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741c7f6-8a62-46a7-aa86-d4cf0a693036 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:11.101412 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:11.185390 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741c7f6-8a62-46a7-aa86-d4cf0a693036 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:11.196594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a31ec0-ff90-4497-b579-a8d309ea0f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:11.197712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a31ec0-ff90-4497-b579-a8d309ea0f12 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:11.198200 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a31ec0-ff90-4497-b579-a8d309ea0f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:11.198649 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a31ec0-ff90-4497-b579-a8d309ea0f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:11.199478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a31ec0-ff90-4497-b579-a8d309ea0f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:11.202494 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a31ec0-ff90-4497-b579-a8d309ea0f12 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:11.380575 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1277/2568] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:49:11 2022] POST /identity/v3/projects => generated 373 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:11.384855 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70231670-d9a3-4e51-9a76-0239b8fe2db3 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:11.397896 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70231670-d9a3-4e51-9a76-0239b8fe2db3 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:11.485309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57f56e-d79c-4e8a-871b-489220790cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:11.486578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57f56e-d79c-4e8a-871b-489220790cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:11.486578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57f56e-d79c-4e8a-871b-489220790cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:11.487014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57f56e-d79c-4e8a-871b-489220790cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:11.487749 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57f56e-d79c-4e8a-871b-489220790cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:11.489878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57f56e-d79c-4e8a-871b-489220790cf5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:11.606176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1292/2569] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:49:11 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:11.610073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a31ec0-ff90-4497-b579-a8d309ea0f12 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:11.621821 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a31ec0-ff90-4497-b579-a8d309ea0f12 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:11.627203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d0c8f-5b7f-4341-a5f0-a2414f809d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:11.627823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0c8f-5b7f-4341-a5f0-a2414f809d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:11.628104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0c8f-5b7f-4341-a5f0-a2414f809d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:11.628377 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0c8f-5b7f-4341-a5f0-a2414f809d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:11.629021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d0c8f-5b7f-4341-a5f0-a2414f809d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:11.633994 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d0c8f-5b7f-4341-a5f0-a2414f809d28 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:11.647619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1278/2570] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:11.651658 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57f56e-d79c-4e8a-871b-489220790cf5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:11.663101 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57f56e-d79c-4e8a-871b-489220790cf5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:11.668199 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc35d0-b93c-4afd-a224-9ab2620f9dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:11.668898 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc35d0-b93c-4afd-a224-9ab2620f9dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:11.669174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc35d0-b93c-4afd-a224-9ab2620f9dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:11.669471 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc35d0-b93c-4afd-a224-9ab2620f9dd4 admin admin] PATH_INFO: `/v3/projects/e4979fe6e406484bab0317013195581f/users/8b8204b464f147949d2830f7fadfd596/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:11.687860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc35d0-b93c-4afd-a224-9ab2620f9dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4979fe6e406484bab0317013195581f, user_id=8b8204b464f147949d2830f7fadfd596, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:11.690552 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc35d0-b93c-4afd-a224-9ab2620f9dd4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:11.754405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1293/2571] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:11 2022] PUT /identity/v3/projects/e4979fe6e406484bab0317013195581f/users/8b8204b464f147949d2830f7fadfd596/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:11.758766 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d0c8f-5b7f-4341-a5f0-a2414f809d28 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:11.770585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d0c8f-5b7f-4341-a5f0-a2414f809d28 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:11.837298 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48e281-45c2-4c26-8e5d-7d1f231d29ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:11.837966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48e281-45c2-4c26-8e5d-7d1f231d29ae admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:11.838227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48e281-45c2-4c26-8e5d-7d1f231d29ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:11.838501 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48e281-45c2-4c26-8e5d-7d1f231d29ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:11.839168 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48e281-45c2-4c26-8e5d-7d1f231d29ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:11.840879 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48e281-45c2-4c26-8e5d-7d1f231d29ae admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:11.852751 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1279/2572] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:11.857291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc35d0-b93c-4afd-a224-9ab2620f9dd4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:11.871027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc35d0-b93c-4afd-a224-9ab2620f9dd4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:11.876483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ebd46-de1b-430a-a86b-f837212f808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:11.877317 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ebd46-de1b-430a-a86b-f837212f808c admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:11.877599 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ebd46-de1b-430a-a86b-f837212f808c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:11.877874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ebd46-de1b-430a-a86b-f837212f808c admin admin] PATH_INFO: `/v3/projects/e4979fe6e406484bab0317013195581f/users/8b8204b464f147949d2830f7fadfd596/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:11.879930 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ebd46-de1b-430a-a86b-f837212f808c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4979fe6e406484bab0317013195581f, user_id=8b8204b464f147949d2830f7fadfd596, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:11.882690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ebd46-de1b-430a-a86b-f837212f808c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:11.895062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1294/2573] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:11 2022] PUT /identity/v3/projects/e4979fe6e406484bab0317013195581f/users/8b8204b464f147949d2830f7fadfd596/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:11.907682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eb73a-c465-427f-9db2-9e5cff2bac94 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:11.907967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eb73a-c465-427f-9db2-9e5cff2bac94 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:11.908240 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eb73a-c465-427f-9db2-9e5cff2bac94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:11.939019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ab6eb73a-c465-427f-9db2-9e5cff2bac94 None None] MFA Rules not processed for user `8b8204b464f147949d2830f7fadfd596`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:11.940239 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ab6eb73a-c465-427f-9db2-9e5cff2bac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:12.006105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:12.010976 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1280/2574] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:12.022352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ebd46-de1b-430a-a86b-f837212f808c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:12.066901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:12.082222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ebd46-de1b-430a-a86b-f837212f808c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:12.086008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386b79d-e835-4ca5-8218-045e184a7953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:12.086625 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386b79d-e835-4ca5-8218-045e184a7953 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:12.086904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386b79d-e835-4ca5-8218-045e184a7953 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:12.087176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386b79d-e835-4ca5-8218-045e184a7953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:12.096741 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386b79d-e835-4ca5-8218-045e184a7953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:12.098189 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386b79d-e835-4ca5-8218-045e184a7953 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:12.107355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1295/2575] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:13.386913 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6eb73a-c465-427f-9db2-9e5cff2bac94 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:13.476675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6eb73a-c465-427f-9db2-9e5cff2bac94 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:13.482177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5c45a-a369-4d08-9616-aa0697505e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:13.483268 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5c45a-a369-4d08-9616-aa0697505e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:13.483772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5c45a-a369-4d08-9616-aa0697505e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:13.484252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5c45a-a369-4d08-9616-aa0697505e0a admin admin] PATH_INFO: `/v3/users/be46ff0c4f1b4ad48ff0ddd438eb1df6` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:13.485827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5c45a-a369-4d08-9616-aa0697505e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be46ff0c4f1b4ad48ff0ddd438eb1df6)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:13.488816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5c45a-a369-4d08-9616-aa0697505e0a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:13.636156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7aa5c45a-a369-4d08-9616-aa0697505e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be46ff0c4f1b4ad48ff0ddd438eb1df6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:13.636733 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7aa5c45a-a369-4d08-9616-aa0697505e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be46ff0c4f1b4ad48ff0ddd438eb1df6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:13.653305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7aa5c45a-a369-4d08-9616-aa0697505e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be46ff0c4f1b4ad48ff0ddd438eb1df6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:13.661699 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7aa5c45a-a369-4d08-9616-aa0697505e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be46ff0c4f1b4ad48ff0ddd438eb1df6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:13.662505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-7aa5c45a-a369-4d08-9616-aa0697505e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be46ff0c4f1b4ad48ff0ddd438eb1df6'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:13.737276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1281/2576] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:49:13 2022] DELETE /identity/v3/users/be46ff0c4f1b4ad48ff0ddd438eb1df6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:13.741916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b10f26-6dda-4eb1-87d3-6a34341a4c81 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:13.742775 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b10f26-6dda-4eb1-87d3-6a34341a4c81 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:13.743052 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b10f26-6dda-4eb1-87d3-6a34341a4c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:13.765703 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-b3b10f26-6dda-4eb1-87d3-6a34341a4c81 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:13.767542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b3b10f26-6dda-4eb1-87d3-6a34341a4c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:13.840991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1296/2577] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:13.851845 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5c45a-a369-4d08-9616-aa0697505e0a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:13.853745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7aa5c45a-a369-4d08-9616-aa0697505e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:13.933722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5c45a-a369-4d08-9616-aa0697505e0a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:13.939060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0ae95-9647-4cf3-bdaa-85839dc253f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:13.940069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0ae95-9647-4cf3-bdaa-85839dc253f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:13.940445 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0ae95-9647-4cf3-bdaa-85839dc253f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:13.940817 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0ae95-9647-4cf3-bdaa-85839dc253f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:13.955007 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0ae95-9647-4cf3-bdaa-85839dc253f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:13.956867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0ae95-9647-4cf3-bdaa-85839dc253f2 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:13.968431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1282/2578] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:49:14.496273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b10f26-6dda-4eb1-87d3-6a34341a4c81 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:14.498701 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b3b10f26-6dda-4eb1-87d3-6a34341a4c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:14.522142 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0ae95-9647-4cf3-bdaa-85839dc253f2 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:14.524714 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e3c0ae95-9647-4cf3-bdaa-85839dc253f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:14.529959 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b10f26-6dda-4eb1-87d3-6a34341a4c81 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:14.536866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:14.547085 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0ae95-9647-4cf3-bdaa-85839dc253f2 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:14.550753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f75d8d-b1ea-4ab4-b973-3673b4b8cc02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:14.551464 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f75d8d-b1ea-4ab4-b973-3673b4b8cc02 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:14.551732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f75d8d-b1ea-4ab4-b973-3673b4b8cc02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:14.552060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f75d8d-b1ea-4ab4-b973-3673b4b8cc02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:14.555477 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-10f75d8d-b1ea-4ab4-b973-3673b4b8cc02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:14.567816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f75d8d-b1ea-4ab4-b973-3673b4b8cc02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:14.568811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:14.569369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:14.569567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f75d8d-b1ea-4ab4-b973-3673b4b8cc02 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:14.569683 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] PATH_INFO: `/v3/projects/7289f476907f4f4bb53f62e999bbe175` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:14.572200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7289f476907f4f4bb53f62e999bbe175)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:14.574156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:14.580227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1283/2579] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:49:14.717056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7289f476907f4f4bb53f62e999bbe175', 'request_id': 'req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:14.848728 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7289f476907f4f4bb53f62e999bbe175', 'request_id': 'req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:14.863950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7289f476907f4f4bb53f62e999bbe175', 'request_id': 'req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:14.885280 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] The token cache is being invalidate because project 7289f476907f4f4bb53f62e999bbe175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:49:14.885588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:14.887510 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:14.891656 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1297/2580] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:49:14 2022] DELETE /identity/v3/projects/7289f476907f4f4bb53f62e999bbe175 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:14.894987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f75d8d-b1ea-4ab4-b973-3673b4b8cc02 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:14.907348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f75d8d-b1ea-4ab4-b973-3673b4b8cc02 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:14.911344 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:14.998090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9add03-eca6-439a-bb69-cbea0c6e1b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:14.998802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9add03-eca6-439a-bb69-cbea0c6e1b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:14.999062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9add03-eca6-439a-bb69-cbea0c6e1b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:14.999332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9add03-eca6-439a-bb69-cbea0c6e1b1d admin admin] PATH_INFO: `/v3/users/8b8204b464f147949d2830f7fadfd596` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:15.000753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9add03-eca6-439a-bb69-cbea0c6e1b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8204b464f147949d2830f7fadfd596)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:15.006061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9add03-eca6-439a-bb69-cbea0c6e1b1d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:15.275025 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fb9add03-eca6-439a-bb69-cbea0c6e1b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8204b464f147949d2830f7fadfd596'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:15.275793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fb9add03-eca6-439a-bb69-cbea0c6e1b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8204b464f147949d2830f7fadfd596'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:15.292899 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fb9add03-eca6-439a-bb69-cbea0c6e1b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8204b464f147949d2830f7fadfd596'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:15.304810 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fb9add03-eca6-439a-bb69-cbea0c6e1b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8204b464f147949d2830f7fadfd596'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:15.305688 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-fb9add03-eca6-439a-bb69-cbea0c6e1b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8204b464f147949d2830f7fadfd596'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:15.430252 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1284/2581] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:49:14 2022] DELETE /identity/v3/users/8b8204b464f147949d2830f7fadfd596 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:16.016571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:16.018650 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:16.045042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a18e98-7d8a-4a81-a1e7-c42ad05d81ef admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:16.121873 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840f968-5911-4114-83b1-2ca7fa9695d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:16.122524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840f968-5911-4114-83b1-2ca7fa9695d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:16.122801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840f968-5911-4114-83b1-2ca7fa9695d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:16.123073 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840f968-5911-4114-83b1-2ca7fa9695d0 admin admin] PATH_INFO: `/v3/projects/e4979fe6e406484bab0317013195581f` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:16.124305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840f968-5911-4114-83b1-2ca7fa9695d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4979fe6e406484bab0317013195581f)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:16.126314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840f968-5911-4114-83b1-2ca7fa9695d0 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:16.141333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:16.296091 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d840f968-5911-4114-83b1-2ca7fa9695d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4979fe6e406484bab0317013195581f', 'request_id': 'req-d840f968-5911-4114-83b1-2ca7fa9695d0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:16.396426 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d840f968-5911-4114-83b1-2ca7fa9695d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4979fe6e406484bab0317013195581f', 'request_id': 'req-d840f968-5911-4114-83b1-2ca7fa9695d0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:16.404843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d840f968-5911-4114-83b1-2ca7fa9695d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4979fe6e406484bab0317013195581f', 'request_id': 'req-d840f968-5911-4114-83b1-2ca7fa9695d0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:16.427180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d840f968-5911-4114-83b1-2ca7fa9695d0 admin admin] The token cache is being invalidate because project e4979fe6e406484bab0317013195581f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:49:16.427180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d840f968-5911-4114-83b1-2ca7fa9695d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:16.428162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d840f968-5911-4114-83b1-2ca7fa9695d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:16.433387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1298/2582] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:49:16 2022] DELETE /identity/v3/projects/e4979fe6e406484bab0317013195581f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:16.434918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8369d2f-df7f-4b48-9437-5756e8c6cd98 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:16.440571 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8369d2f-df7f-4b48-9437-5756e8c6cd98 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:16.440571 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8369d2f-df7f-4b48-9437-5756e8c6cd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:16.467093 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f8369d2f-df7f-4b48-9437-5756e8c6cd98 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:16.469048 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f8369d2f-df7f-4b48-9437-5756e8c6cd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:16.565324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1285/2583] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:16.570972 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bca6a0-8081-4da8-8576-e1f40d25e5d2 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:16.571266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bca6a0-8081-4da8-8576-e1f40d25e5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:16.571540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bca6a0-8081-4da8-8576-e1f40d25e5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:16.598861 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f2bca6a0-8081-4da8-8576-e1f40d25e5d2 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:16.600171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f2bca6a0-8081-4da8-8576-e1f40d25e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:16.612896 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1299/2584] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:16.613749 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8369d2f-df7f-4b48-9437-5756e8c6cd98 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:16.628081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8369d2f-df7f-4b48-9437-5756e8c6cd98 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:16.633086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a58caf-8839-4fc7-9bf4-43e7a95d3056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:16.633839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a58caf-8839-4fc7-9bf4-43e7a95d3056 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:16.634325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a58caf-8839-4fc7-9bf4-43e7a95d3056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:16.634687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a58caf-8839-4fc7-9bf4-43e7a95d3056 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:16.635399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a58caf-8839-4fc7-9bf4-43e7a95d3056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:49:16.635770 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a58caf-8839-4fc7-9bf4-43e7a95d3056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:16.637510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a58caf-8839-4fc7-9bf4-43e7a95d3056 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:16.656906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bca6a0-8081-4da8-8576-e1f40d25e5d2 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:16.657302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1286/2585] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:49:16.668547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bca6a0-8081-4da8-8576-e1f40d25e5d2 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:16.674459 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041e981-97f5-4c7f-8574-a8115015c86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:16.674989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e981-97f5-4c7f-8574-a8115015c86d admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:16.675333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e981-97f5-4c7f-8574-a8115015c86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:16.675680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e981-97f5-4c7f-8574-a8115015c86d admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:16.677699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041e981-97f5-4c7f-8574-a8115015c86d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:16.678541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041e981-97f5-4c7f-8574-a8115015c86d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:16.781218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1300/2586] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:49:16 2022] POST /identity/v3/projects => generated 359 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:49:16.782504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a58caf-8839-4fc7-9bf4-43e7a95d3056 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:16.794327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a58caf-8839-4fc7-9bf4-43e7a95d3056 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:16.813907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:16.867112 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e47cc-3886-4a02-930f-b79a0933aef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:16.867909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e47cc-3886-4a02-930f-b79a0933aef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:16.868216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e47cc-3886-4a02-930f-b79a0933aef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:16.868488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e47cc-3886-4a02-930f-b79a0933aef9 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:16.869117 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e47cc-3886-4a02-930f-b79a0933aef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:16.871038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e47cc-3886-4a02-930f-b79a0933aef9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:16.974276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1287/2587] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:49:16 2022] POST /identity/v3/users => generated 280 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:16.978723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041e981-97f5-4c7f-8574-a8115015c86d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:16.989474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041e981-97f5-4c7f-8574-a8115015c86d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:16.994165 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f0043-3f6b-4a5f-b4dd-6a16fe632aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:16.994723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f0043-3f6b-4a5f-b4dd-6a16fe632aba admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:16.995163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f0043-3f6b-4a5f-b4dd-6a16fe632aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:16.995536 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f0043-3f6b-4a5f-b4dd-6a16fe632aba admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:16.996253 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f0043-3f6b-4a5f-b4dd-6a16fe632aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:16.998026 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f0043-3f6b-4a5f-b4dd-6a16fe632aba admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:17.009117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1301/2588] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:17.013237 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e47cc-3886-4a02-930f-b79a0933aef9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:17.024479 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e47cc-3886-4a02-930f-b79a0933aef9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:17.029246 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbe26e-1b90-467a-bd99-fe8fc4083dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:17.030518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbe26e-1b90-467a-bd99-fe8fc4083dbc admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:17.033815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbe26e-1b90-467a-bd99-fe8fc4083dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:17.033815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbe26e-1b90-467a-bd99-fe8fc4083dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:17.033815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbe26e-1b90-467a-bd99-fe8fc4083dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:17.033815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbe26e-1b90-467a-bd99-fe8fc4083dbc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:17.043911 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1288/2589] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:17.048300 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f0043-3f6b-4a5f-b4dd-6a16fe632aba admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:17.060027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f0043-3f6b-4a5f-b4dd-6a16fe632aba admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:17.065271 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128cf81-02be-4dd4-9f3d-30ed9a0a50b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:17.065932 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128cf81-02be-4dd4-9f3d-30ed9a0a50b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:17.066210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128cf81-02be-4dd4-9f3d-30ed9a0a50b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:17.066481 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128cf81-02be-4dd4-9f3d-30ed9a0a50b2 admin admin] PATH_INFO: `/v3/projects/7c5a615aa1914c9eaf681b6e7b32a491/users/c912fec403fa4973bb5dd14972ce185c/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:17.083913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128cf81-02be-4dd4-9f3d-30ed9a0a50b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5a615aa1914c9eaf681b6e7b32a491, user_id=c912fec403fa4973bb5dd14972ce185c, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:17.086578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128cf81-02be-4dd4-9f3d-30ed9a0a50b2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:17.162433 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1302/2590] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:17 2022] PUT /identity/v3/projects/7c5a615aa1914c9eaf681b6e7b32a491/users/c912fec403fa4973bb5dd14972ce185c/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:49:17.174623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fabb4-cea0-4226-a6f2-4f4ef85a25c8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:17.176630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fabb4-cea0-4226-a6f2-4f4ef85a25c8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:17.176630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fabb4-cea0-4226-a6f2-4f4ef85a25c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:17.204589 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-199fabb4-cea0-4226-a6f2-4f4ef85a25c8 None None] MFA Rules not processed for user `c912fec403fa4973bb5dd14972ce185c`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:17.205832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-199fabb4-cea0-4226-a6f2-4f4ef85a25c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:17.275918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1289/2591] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:49:17.288023 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128cf81-02be-4dd4-9f3d-30ed9a0a50b2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:17.376516 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128cf81-02be-4dd4-9f3d-30ed9a0a50b2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:17.381397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fc65d-3303-41a3-abf5-3c81dad6d267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:17.382009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fc65d-3303-41a3-abf5-3c81dad6d267 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:17.382288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fc65d-3303-41a3-abf5-3c81dad6d267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:17.382556 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fc65d-3303-41a3-abf5-3c81dad6d267 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:17.383846 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fc65d-3303-41a3-abf5-3c81dad6d267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:17.386021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fc65d-3303-41a3-abf5-3c81dad6d267 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:17.472466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1303/2592] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:49:17 2022] POST /identity/v3/projects => generated 365 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:17.477171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fabb4-cea0-4226-a6f2-4f4ef85a25c8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:17.488815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fabb4-cea0-4226-a6f2-4f4ef85a25c8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:17.555744 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db969efc-e964-4349-a2f1-1f69c8b18eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:17.556359 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db969efc-e964-4349-a2f1-1f69c8b18eea admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:17.556768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db969efc-e964-4349-a2f1-1f69c8b18eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:17.557047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db969efc-e964-4349-a2f1-1f69c8b18eea admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:17.557811 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db969efc-e964-4349-a2f1-1f69c8b18eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:17.559792 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db969efc-e964-4349-a2f1-1f69c8b18eea admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:17.681863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1290/2593] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:49:17 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:17.687482 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fc65d-3303-41a3-abf5-3c81dad6d267 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:17.697369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fc65d-3303-41a3-abf5-3c81dad6d267 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:17.702927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87dfd4-3f5a-4f96-acf5-fd4cec6a6e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:17.703527 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87dfd4-3f5a-4f96-acf5-fd4cec6a6e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:17.703808 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87dfd4-3f5a-4f96-acf5-fd4cec6a6e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:17.704082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87dfd4-3f5a-4f96-acf5-fd4cec6a6e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:17.704729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87dfd4-3f5a-4f96-acf5-fd4cec6a6e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:17.706364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87dfd4-3f5a-4f96-acf5-fd4cec6a6e73 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:17.716889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1304/2594] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:49:17.721125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db969efc-e964-4349-a2f1-1f69c8b18eea admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:17.731288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db969efc-e964-4349-a2f1-1f69c8b18eea admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:17.736663 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e2ebf-3441-4a9f-8bc2-b3e4bb51cc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:17.737357 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e2ebf-3441-4a9f-8bc2-b3e4bb51cc53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:17.737648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e2ebf-3441-4a9f-8bc2-b3e4bb51cc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:17.737921 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e2ebf-3441-4a9f-8bc2-b3e4bb51cc53 admin admin] PATH_INFO: `/v3/projects/ea3067d2e1ce4c1d90673c1efa36e414/users/35059c343d234198b18c471c48f48408/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:17.746696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:17.760654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e2ebf-3441-4a9f-8bc2-b3e4bb51cc53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3067d2e1ce4c1d90673c1efa36e414, user_id=35059c343d234198b18c471c48f48408, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:17.760654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e2ebf-3441-4a9f-8bc2-b3e4bb51cc53 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:17.866280 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1291/2595] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:17 2022] PUT /identity/v3/projects/ea3067d2e1ce4c1d90673c1efa36e414/users/35059c343d234198b18c471c48f48408/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:17.870123 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87dfd4-3f5a-4f96-acf5-fd4cec6a6e73 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:17.881083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87dfd4-3f5a-4f96-acf5-fd4cec6a6e73 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:17.884821 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:17.949366 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687038d1-a761-424c-98ab-38bcd0e6eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:17.949875 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687038d1-a761-424c-98ab-38bcd0e6eb1b admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:17.950155 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687038d1-a761-424c-98ab-38bcd0e6eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:17.950425 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687038d1-a761-424c-98ab-38bcd0e6eb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:17.951059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687038d1-a761-424c-98ab-38bcd0e6eb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:17.953125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687038d1-a761-424c-98ab-38bcd0e6eb1b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:17.962756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1305/2596] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:17.966898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e2ebf-3441-4a9f-8bc2-b3e4bb51cc53 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:17.978518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e2ebf-3441-4a9f-8bc2-b3e4bb51cc53 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:17.984203 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ec847-1cf5-4e6e-a7fa-2eca5a48288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:17.984856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ec847-1cf5-4e6e-a7fa-2eca5a48288a admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:17.987194 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ec847-1cf5-4e6e-a7fa-2eca5a48288a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:17.987194 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ec847-1cf5-4e6e-a7fa-2eca5a48288a admin admin] PATH_INFO: `/v3/projects/ea3067d2e1ce4c1d90673c1efa36e414/users/35059c343d234198b18c471c48f48408/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:17.987512 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ec847-1cf5-4e6e-a7fa-2eca5a48288a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3067d2e1ce4c1d90673c1efa36e414, user_id=35059c343d234198b18c471c48f48408, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:17.990061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ec847-1cf5-4e6e-a7fa-2eca5a48288a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:18.000522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1292/2597] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:17 2022] PUT /identity/v3/projects/ea3067d2e1ce4c1d90673c1efa36e414/users/35059c343d234198b18c471c48f48408/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:18.010723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53aa2f-c225-445c-b720-a04d9dc3da97 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:18.015949 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53aa2f-c225-445c-b720-a04d9dc3da97 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:18.015949 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53aa2f-c225-445c-b720-a04d9dc3da97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:18.042532 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1b53aa2f-c225-445c-b720-a04d9dc3da97 None None] MFA Rules not processed for user `35059c343d234198b18c471c48f48408`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:18.043794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1b53aa2f-c225-445c-b720-a04d9dc3da97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:18.117873 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1306/2598] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:18.129763 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ec847-1cf5-4e6e-a7fa-2eca5a48288a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:18.131527 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ae0ec847-1cf5-4e6e-a7fa-2eca5a48288a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:18.192434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ec847-1cf5-4e6e-a7fa-2eca5a48288a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:18.196309 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b4f89-1797-4b7c-b90b-bc9c8edf06db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:18.196975 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b4f89-1797-4b7c-b90b-bc9c8edf06db service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:18.197315 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b4f89-1797-4b7c-b90b-bc9c8edf06db service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:18.197594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b4f89-1797-4b7c-b90b-bc9c8edf06db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:18.207731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b4f89-1797-4b7c-b90b-bc9c8edf06db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:18.209150 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b4f89-1797-4b7c-b90b-bc9c8edf06db service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:18.221605 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1293/2599] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:18.452704 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53aa2f-c225-445c-b720-a04d9dc3da97 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:18.462442 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53aa2f-c225-445c-b720-a04d9dc3da97 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:18.465924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dcb93-9820-4656-b283-565fad044a4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:18.466522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dcb93-9820-4656-b283-565fad044a4d service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:18.473615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dcb93-9820-4656-b283-565fad044a4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:18.473615 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dcb93-9820-4656-b283-565fad044a4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:18.531618 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dcb93-9820-4656-b283-565fad044a4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:18.534363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dcb93-9820-4656-b283-565fad044a4d service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:18.543150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1307/2600] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:18 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:22.534522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b4f89-1797-4b7c-b90b-bc9c8edf06db service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:22.535875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-459b4f89-1797-4b7c-b90b-bc9c8edf06db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:22.595372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b4f89-1797-4b7c-b90b-bc9c8edf06db service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:22.599134 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28787699-22d2-4d56-adbc-08d4b18fcabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:22.599731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28787699-22d2-4d56-adbc-08d4b18fcabc service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:22.600011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28787699-22d2-4d56-adbc-08d4b18fcabc service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:22.600285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28787699-22d2-4d56-adbc-08d4b18fcabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:22.602042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-28787699-22d2-4d56-adbc-08d4b18fcabc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:22.611381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28787699-22d2-4d56-adbc-08d4b18fcabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:22.612787 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28787699-22d2-4d56-adbc-08d4b18fcabc service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:22.620736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1294/2601] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:23.006815 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262ed31-9102-4b45-9cc2-2490feb79b07 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:23.007372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262ed31-9102-4b45-9cc2-2490feb79b07 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:23.007516 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262ed31-9102-4b45-9cc2-2490feb79b07 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:23.008941 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1308/2602] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 31 04:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:49:23.014880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8116c9c-558e-40a8-a675-ba02cc85cc65 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:23.015165 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8116c9c-558e-40a8-a675-ba02cc85cc65 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:23.016012 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8116c9c-558e-40a8-a675-ba02cc85cc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:23.039086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c8116c9c-558e-40a8-a675-ba02cc85cc65 None None] MFA Rules not processed for user `4877b72a6cea410dbb31a35c7acbd5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:23.040713 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c8116c9c-558e-40a8-a675-ba02cc85cc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:23.128590 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1295/2603] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 31 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:23.140529 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262ed31-9102-4b45-9cc2-2490feb79b07 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:23.149272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c262ed31-9102-4b45-9cc2-2490feb79b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:23.174419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:23.206985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262ed31-9102-4b45-9cc2-2490feb79b07 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:23.211288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3ac8-89b8-4a15-b8d1-c6a79d8b91f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526760ad8a04bf486d1e7e74e9ffbe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:23.211895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3ac8-89b8-4a15-b8d1-c6a79d8b91f8 service glance] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:23.212315 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3ac8-89b8-4a15-b8d1-c6a79d8b91f8 service glance] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:23.212444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3ac8-89b8-4a15-b8d1-c6a79d8b91f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:23.225787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b3ac8-89b8-4a15-b8d1-c6a79d8b91f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:23.227197 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b3ac8-89b8-4a15-b8d1-c6a79d8b91f8 service glance] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:23.238360 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1309/2604] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:49:23.480548 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11d6c3-b197-40b3-8a32-b4115e06ef06 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:23.480840 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11d6c3-b197-40b3-8a32-b4115e06ef06 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:23.481120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11d6c3-b197-40b3-8a32-b4115e06ef06 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:23.482558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1296/2605] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 31 04:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:49:23.487758 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365b2a-3f80-44c0-b75f-1a6a9155df4e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:23.488042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365b2a-3f80-44c0-b75f-1a6a9155df4e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:23.488327 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365b2a-3f80-44c0-b75f-1a6a9155df4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:23.508160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-0b365b2a-3f80-44c0-b75f-1a6a9155df4e None None] MFA Rules not processed for user `2c63e7e4105b41d1abfe58bf13c6125d`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:23.509381 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0b365b2a-3f80-44c0-b75f-1a6a9155df4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:23.515728 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1310/2606] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 31 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:23.527395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11d6c3-b197-40b3-8a32-b4115e06ef06 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:23.538466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11d6c3-b197-40b3-8a32-b4115e06ef06 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:23.542340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377af19c-d670-4780-95c5-eaf2363e7eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:23.542921 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377af19c-d670-4780-95c5-eaf2363e7eba service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:23.543196 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377af19c-d670-4780-95c5-eaf2363e7eba service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:23.543462 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377af19c-d670-4780-95c5-eaf2363e7eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:23.551196 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377af19c-d670-4780-95c5-eaf2363e7eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:23.552746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377af19c-d670-4780-95c5-eaf2363e7eba service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:23.555983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:23.561956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1297/2607] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:49:23.678911 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf04d28-c031-4bad-bb9d-4c2343ed435b None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:23.679217 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf04d28-c031-4bad-bb9d-4c2343ed435b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:23.679514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf04d28-c031-4bad-bb9d-4c2343ed435b None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:23.680847 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1311/2608] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 31 04:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:49:23.686425 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbc0c-b738-411e-8c47-29f0f1952c77 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:23.686743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbc0c-b738-411e-8c47-29f0f1952c77 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:23.687207 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbc0c-b738-411e-8c47-29f0f1952c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:23.714655 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-870dbc0c-b738-411e-8c47-29f0f1952c77 None None] MFA Rules not processed for user `4877b72a6cea410dbb31a35c7acbd5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:23.715866 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-870dbc0c-b738-411e-8c47-29f0f1952c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:23.725976 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1298/2609] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 31 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:23.737718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf04d28-c031-4bad-bb9d-4c2343ed435b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:23.739460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3bf04d28-c031-4bad-bb9d-4c2343ed435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:23.754170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf04d28-c031-4bad-bb9d-4c2343ed435b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:23.757572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50f8ea-01f3-48d2-a09b-73d808ebcd52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:23.758171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50f8ea-01f3-48d2-a09b-73d808ebcd52 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:23.758447 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50f8ea-01f3-48d2-a09b-73d808ebcd52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:23.758716 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50f8ea-01f3-48d2-a09b-73d808ebcd52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:23.769490 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50f8ea-01f3-48d2-a09b-73d808ebcd52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:23.770960 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50f8ea-01f3-48d2-a09b-73d808ebcd52 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:23.782125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1312/2610] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:23.846836 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dbc0c-b738-411e-8c47-29f0f1952c77 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:23.848269 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-870dbc0c-b738-411e-8c47-29f0f1952c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:23.917266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dbc0c-b738-411e-8c47-29f0f1952c77 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:23.922975 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bf5c7-75de-438d-a353-902fa6bed659 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ad954bbb7749ee8861e8da98619006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:23.923576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bf5c7-75de-438d-a353-902fa6bed659 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:23.923853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bf5c7-75de-438d-a353-902fa6bed659 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:23.924125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bf5c7-75de-438d-a353-902fa6bed659 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:23.925871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a27bf5c7-75de-438d-a353-902fa6bed659 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:23.937274 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bf5c7-75de-438d-a353-902fa6bed659 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:23.938823 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bf5c7-75de-438d-a353-902fa6bed659 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:23.948797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1299/2611] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:27.496961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50f8ea-01f3-48d2-a09b-73d808ebcd52 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:27.560105 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50f8ea-01f3-48d2-a09b-73d808ebcd52 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:27.565218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527f7f6-7d49-459c-9ec4-ff81eafa0b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:27.565846 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f7f6-7d49-459c-9ec4-ff81eafa0b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:27.566121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f7f6-7d49-459c-9ec4-ff81eafa0b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:27.566389 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f7f6-7d49-459c-9ec4-ff81eafa0b14 admin admin] PATH_INFO: `/v3/users/c912fec403fa4973bb5dd14972ce185c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:27.567481 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527f7f6-7d49-459c-9ec4-ff81eafa0b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c912fec403fa4973bb5dd14972ce185c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:27.569395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527f7f6-7d49-459c-9ec4-ff81eafa0b14 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:27.683702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d884-8987-4dea-8634-5cf22af72bf0 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:27.684185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d884-8987-4dea-8634-5cf22af72bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:27.684273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d884-8987-4dea-8634-5cf22af72bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:27.704722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d0e7d884-8987-4dea-8634-5cf22af72bf0 None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:27.706042 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d0e7d884-8987-4dea-8634-5cf22af72bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:27.766711 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1300/2612] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:49:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:49:27.778799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7d884-8987-4dea-8634-5cf22af72bf0 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:27.780970 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d0e7d884-8987-4dea-8634-5cf22af72bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:27.808974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3527f7f6-7d49-459c-9ec4-ff81eafa0b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c912fec403fa4973bb5dd14972ce185c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:27.824136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3527f7f6-7d49-459c-9ec4-ff81eafa0b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c912fec403fa4973bb5dd14972ce185c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:27.859529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7d884-8987-4dea-8634-5cf22af72bf0 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:27.865631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291db76-08de-4bf4-97cb-5e8079c30fd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:27.866321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291db76-08de-4bf4-97cb-5e8079c30fd5 service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:27.866597 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291db76-08de-4bf4-97cb-5e8079c30fd5 service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:27.866874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291db76-08de-4bf4-97cb-5e8079c30fd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:27.876082 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291db76-08de-4bf4-97cb-5e8079c30fd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:27.878307 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291db76-08de-4bf4-97cb-5e8079c30fd5 service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:27.887119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1301/2613] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:49:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 04:49:27.906938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3527f7f6-7d49-459c-9ec4-ff81eafa0b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c912fec403fa4973bb5dd14972ce185c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:27.914988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3527f7f6-7d49-459c-9ec4-ff81eafa0b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c912fec403fa4973bb5dd14972ce185c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:27.915608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-3527f7f6-7d49-459c-9ec4-ff81eafa0b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c912fec403fa4973bb5dd14972ce185c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:27.923487 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1313/2614] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:49:27 2022] DELETE /identity/v3/users/c912fec403fa4973bb5dd14972ce185c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:27.927917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a3f9c-f649-4d44-9c79-23617708486a None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:27.928187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a3f9c-f649-4d44-9c79-23617708486a None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:27.928461 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a3f9c-f649-4d44-9c79-23617708486a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:27.947493 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5c2a3f9c-f649-4d44-9c79-23617708486a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:27.948685 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5c2a3f9c-f649-4d44-9c79-23617708486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:27.958077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:28.007952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1302/2615] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:28.018478 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527f7f6-7d49-459c-9ec4-ff81eafa0b14 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:28.020067 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3527f7f6-7d49-459c-9ec4-ff81eafa0b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:28.062245 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:28.110821 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527f7f6-7d49-459c-9ec4-ff81eafa0b14 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:28.115267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346b01f-24bd-43d5-bf72-3f52943bc849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:28.115870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346b01f-24bd-43d5-bf72-3f52943bc849 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:28.116150 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346b01f-24bd-43d5-bf72-3f52943bc849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:28.116427 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346b01f-24bd-43d5-bf72-3f52943bc849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:28.127332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346b01f-24bd-43d5-bf72-3f52943bc849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:28.128871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346b01f-24bd-43d5-bf72-3f52943bc849 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:28.140505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1314/2616] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:28.693090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a3f9c-f649-4d44-9c79-23617708486a None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:28.697230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5c2a3f9c-f649-4d44-9c79-23617708486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:28.717852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a3f9c-f649-4d44-9c79-23617708486a None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:28.724347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:28.725328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:28.725972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:28.726552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] PATH_INFO: `/v3/projects/7c5a615aa1914c9eaf681b6e7b32a491` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:28.728020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c5a615aa1914c9eaf681b6e7b32a491)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:28.730694 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:28.835506 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c5a615aa1914c9eaf681b6e7b32a491', 'request_id': 'req-ada44896-a887-46bc-88d1-46b65728f42c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:28.907064 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c5a615aa1914c9eaf681b6e7b32a491', 'request_id': 'req-ada44896-a887-46bc-88d1-46b65728f42c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:28.914591 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c5a615aa1914c9eaf681b6e7b32a491', 'request_id': 'req-ada44896-a887-46bc-88d1-46b65728f42c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:28.927834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] The token cache is being invalidate because project 7c5a615aa1914c9eaf681b6e7b32a491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:49:28.928116 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:28.928853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:28.933234 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1303/2617] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:49:28 2022] DELETE /identity/v3/projects/7c5a615aa1914c9eaf681b6e7b32a491 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:28.934944 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346b01f-24bd-43d5-bf72-3f52943bc849 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:28.947861 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346b01f-24bd-43d5-bf72-3f52943bc849 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:29.028485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972bd9a-b52e-455e-83e7-895aafee4bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:29.029125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972bd9a-b52e-455e-83e7-895aafee4bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:29.030208 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972bd9a-b52e-455e-83e7-895aafee4bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:29.030507 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972bd9a-b52e-455e-83e7-895aafee4bf4 admin admin] PATH_INFO: `/v3/users/35059c343d234198b18c471c48f48408` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:29.031725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972bd9a-b52e-455e-83e7-895aafee4bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35059c343d234198b18c471c48f48408)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:29.033686 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972bd9a-b52e-455e-83e7-895aafee4bf4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:29.234242 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6972bd9a-b52e-455e-83e7-895aafee4bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35059c343d234198b18c471c48f48408'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:29.250936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6972bd9a-b52e-455e-83e7-895aafee4bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35059c343d234198b18c471c48f48408'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:29.313279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6972bd9a-b52e-455e-83e7-895aafee4bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35059c343d234198b18c471c48f48408'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:29.322292 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6972bd9a-b52e-455e-83e7-895aafee4bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35059c343d234198b18c471c48f48408'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:29.323155 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-6972bd9a-b52e-455e-83e7-895aafee4bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35059c343d234198b18c471c48f48408'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:29.330901 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1315/2618] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:49:28 2022] DELETE /identity/v3/users/35059c343d234198b18c471c48f48408 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:49:29.851740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:29.853632 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:29.868437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada44896-a887-46bc-88d1-46b65728f42c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:29.948857 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5cd30-cba2-48d5-a925-44150b158236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:29.949512 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5cd30-cba2-48d5-a925-44150b158236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:29.949829 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5cd30-cba2-48d5-a925-44150b158236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:29.950110 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5cd30-cba2-48d5-a925-44150b158236 admin admin] PATH_INFO: `/v3/projects/ea3067d2e1ce4c1d90673c1efa36e414` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:29.951882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5cd30-cba2-48d5-a925-44150b158236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea3067d2e1ce4c1d90673c1efa36e414)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:29.953898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5cd30-cba2-48d5-a925-44150b158236 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:30.070929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:30.078857 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-22f5cd30-cba2-48d5-a925-44150b158236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea3067d2e1ce4c1d90673c1efa36e414', 'request_id': 'req-22f5cd30-cba2-48d5-a925-44150b158236'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:30.152661 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-22f5cd30-cba2-48d5-a925-44150b158236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea3067d2e1ce4c1d90673c1efa36e414', 'request_id': 'req-22f5cd30-cba2-48d5-a925-44150b158236'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:30.159167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-22f5cd30-cba2-48d5-a925-44150b158236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea3067d2e1ce4c1d90673c1efa36e414', 'request_id': 'req-22f5cd30-cba2-48d5-a925-44150b158236'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:30.171682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-22f5cd30-cba2-48d5-a925-44150b158236 admin admin] The token cache is being invalidate because project ea3067d2e1ce4c1d90673c1efa36e414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:49:30.171977 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-22f5cd30-cba2-48d5-a925-44150b158236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:30.172649 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-22f5cd30-cba2-48d5-a925-44150b158236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:30.174795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1304/2619] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:49:29 2022] DELETE /identity/v3/projects/ea3067d2e1ce4c1d90673c1efa36e414 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:30.180022 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5af50-d36e-4b2c-bf70-b42eb81636b9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:30.180588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5af50-d36e-4b2c-bf70-b42eb81636b9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:30.180588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5af50-d36e-4b2c-bf70-b42eb81636b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:30.223301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-d1c5af50-d36e-4b2c-bf70-b42eb81636b9 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:30.224578 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-d1c5af50-d36e-4b2c-bf70-b42eb81636b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:30.284624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:30.303000 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1316/2620] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:49:30.311440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371f5c6-498c-438e-8a3c-9e53010d063f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:30.313478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371f5c6-498c-438e-8a3c-9e53010d063f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:30.314088 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371f5c6-498c-438e-8a3c-9e53010d063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:30.336045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-2371f5c6-498c-438e-8a3c-9e53010d063f None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:30.337310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2371f5c6-498c-438e-8a3c-9e53010d063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:30.353767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1305/2621] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:30.361231 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5af50-d36e-4b2c-bf70-b42eb81636b9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:30.370860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5af50-d36e-4b2c-bf70-b42eb81636b9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:30.375649 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211c071-ebb6-4086-8897-d392e519d7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:30.376256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211c071-ebb6-4086-8897-d392e519d7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:30.376564 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211c071-ebb6-4086-8897-d392e519d7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:30.376832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211c071-ebb6-4086-8897-d392e519d7a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:30.377541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211c071-ebb6-4086-8897-d392e519d7a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:49:30.377844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211c071-ebb6-4086-8897-d392e519d7a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:30.379430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211c071-ebb6-4086-8897-d392e519d7a2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:30.395402 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1317/2622] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:49:30.400122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371f5c6-498c-438e-8a3c-9e53010d063f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:30.412261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371f5c6-498c-438e-8a3c-9e53010d063f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:30.422178 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76977242-3eea-418a-b68d-d4c75728c375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:30.423400 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76977242-3eea-418a-b68d-d4c75728c375 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:30.423686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76977242-3eea-418a-b68d-d4c75728c375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:30.423957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76977242-3eea-418a-b68d-d4c75728c375 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:30.425793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76977242-3eea-418a-b68d-d4c75728c375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:30.426692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76977242-3eea-418a-b68d-d4c75728c375 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:30.566438 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1306/2623] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:49:30 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:30.566642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211c071-ebb6-4086-8897-d392e519d7a2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:30.576086 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211c071-ebb6-4086-8897-d392e519d7a2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:30.648676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d95ba-cdc9-4d5d-95b0-370f90ca54c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:30.649924 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d95ba-cdc9-4d5d-95b0-370f90ca54c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:30.650050 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d95ba-cdc9-4d5d-95b0-370f90ca54c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:30.650475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d95ba-cdc9-4d5d-95b0-370f90ca54c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:30.651542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d95ba-cdc9-4d5d-95b0-370f90ca54c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:30.653522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d95ba-cdc9-4d5d-95b0-370f90ca54c8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:30.740475 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1318/2624] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:49:30 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:49:30.742372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76977242-3eea-418a-b68d-d4c75728c375 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:30.753529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76977242-3eea-418a-b68d-d4c75728c375 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:30.758394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb34c4-da80-44b1-9bdf-f7b47ac47be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:30.758994 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb34c4-da80-44b1-9bdf-f7b47ac47be0 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:30.759270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb34c4-da80-44b1-9bdf-f7b47ac47be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:30.759600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb34c4-da80-44b1-9bdf-f7b47ac47be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:30.760241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb34c4-da80-44b1-9bdf-f7b47ac47be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:30.761856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb34c4-da80-44b1-9bdf-f7b47ac47be0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:30.772587 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1307/2625] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:30.776817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d95ba-cdc9-4d5d-95b0-370f90ca54c8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:30.789651 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d95ba-cdc9-4d5d-95b0-370f90ca54c8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:30.797804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbf1db-4508-456f-b920-e0f21a332245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:30.798685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbf1db-4508-456f-b920-e0f21a332245 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:30.799092 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbf1db-4508-456f-b920-e0f21a332245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:30.799460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbf1db-4508-456f-b920-e0f21a332245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:30.800854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbf1db-4508-456f-b920-e0f21a332245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:30.802804 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbf1db-4508-456f-b920-e0f21a332245 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:30.815391 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1319/2626] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:49:30.822050 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb34c4-da80-44b1-9bdf-f7b47ac47be0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:30.835364 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb34c4-da80-44b1-9bdf-f7b47ac47be0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:30.840980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569259b-c7cf-4ad9-b70e-b90da0bf2fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:30.844046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569259b-c7cf-4ad9-b70e-b90da0bf2fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:30.844046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569259b-c7cf-4ad9-b70e-b90da0bf2fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:30.844046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569259b-c7cf-4ad9-b70e-b90da0bf2fd2 admin admin] PATH_INFO: `/v3/projects/7bd68b150b0d4f48b9583f95cebde48a/users/69792d9463024cddb06a223ab573ca56/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:30.863569 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569259b-c7cf-4ad9-b70e-b90da0bf2fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd68b150b0d4f48b9583f95cebde48a, user_id=69792d9463024cddb06a223ab573ca56, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:30.867767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569259b-c7cf-4ad9-b70e-b90da0bf2fd2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:30.937184 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1308/2627] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:30 2022] PUT /identity/v3/projects/7bd68b150b0d4f48b9583f95cebde48a/users/69792d9463024cddb06a223ab573ca56/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:30.953870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f90aaa-8447-492e-bd33-cc45c68cafbb None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:30.953870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f90aaa-8447-492e-bd33-cc45c68cafbb None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:30.953870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f90aaa-8447-492e-bd33-cc45c68cafbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:31.015732 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-51f90aaa-8447-492e-bd33-cc45c68cafbb None None] MFA Rules not processed for user `69792d9463024cddb06a223ab573ca56`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:31.017604 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-51f90aaa-8447-492e-bd33-cc45c68cafbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:31.182200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1320/2628] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:31.182887 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569259b-c7cf-4ad9-b70e-b90da0bf2fd2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:31.278015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569259b-c7cf-4ad9-b70e-b90da0bf2fd2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:31.283517 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ac6c5-f5de-4277-8914-ad699aa8e13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:31.284136 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ac6c5-f5de-4277-8914-ad699aa8e13d admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:31.284414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ac6c5-f5de-4277-8914-ad699aa8e13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:31.284827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ac6c5-f5de-4277-8914-ad699aa8e13d admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:31.285521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ac6c5-f5de-4277-8914-ad699aa8e13d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:31.287595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ac6c5-f5de-4277-8914-ad699aa8e13d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:31.720836 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1309/2629] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:49:31 2022] POST /identity/v3/projects => generated 379 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:31.722298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f90aaa-8447-492e-bd33-cc45c68cafbb None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:31.734588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f90aaa-8447-492e-bd33-cc45c68cafbb None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:31.784775 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:31.798993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154755f-fb8d-4b83-af00-690c30461651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:31.799652 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154755f-fb8d-4b83-af00-690c30461651 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:31.799881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154755f-fb8d-4b83-af00-690c30461651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:31.800154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154755f-fb8d-4b83-af00-690c30461651 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:31.800892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154755f-fb8d-4b83-af00-690c30461651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:31.802796 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154755f-fb8d-4b83-af00-690c30461651 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:31.924570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1321/2630] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:49:31 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:31.928539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ac6c5-f5de-4277-8914-ad699aa8e13d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:31.940179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ac6c5-f5de-4277-8914-ad699aa8e13d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:31.945094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e70ce-7b08-4a38-bfa0-bea629ae46ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:31.945820 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e70ce-7b08-4a38-bfa0-bea629ae46ce admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:31.946171 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e70ce-7b08-4a38-bfa0-bea629ae46ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:31.946545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e70ce-7b08-4a38-bfa0-bea629ae46ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:31.947283 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e70ce-7b08-4a38-bfa0-bea629ae46ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:31.949182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e70ce-7b08-4a38-bfa0-bea629ae46ce admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:31.966351 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1310/2631] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:31.976172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154755f-fb8d-4b83-af00-690c30461651 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:31.987819 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154755f-fb8d-4b83-af00-690c30461651 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:31.992429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e5560-428f-4e85-9dab-6e38b031ced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:31.993098 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e5560-428f-4e85-9dab-6e38b031ced4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:31.993419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e5560-428f-4e85-9dab-6e38b031ced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:31.993698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e5560-428f-4e85-9dab-6e38b031ced4 admin admin] PATH_INFO: `/v3/projects/d43309b7bf1e4526a9a6e8d5a6316579/users/04a70a20061142008bb2002c5c5da7e1/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:32.012331 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e5560-428f-4e85-9dab-6e38b031ced4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43309b7bf1e4526a9a6e8d5a6316579, user_id=04a70a20061142008bb2002c5c5da7e1, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:32.015822 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e5560-428f-4e85-9dab-6e38b031ced4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:32.085897 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1322/2632] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:31 2022] PUT /identity/v3/projects/d43309b7bf1e4526a9a6e8d5a6316579/users/04a70a20061142008bb2002c5c5da7e1/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:32.090477 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e70ce-7b08-4a38-bfa0-bea629ae46ce admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:32.101598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e70ce-7b08-4a38-bfa0-bea629ae46ce admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:32.157524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:32.177414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ad055-5c7f-4f4f-8630-27dd60f832ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:32.178165 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ad055-5c7f-4f4f-8630-27dd60f832ed admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:32.178537 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ad055-5c7f-4f4f-8630-27dd60f832ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:32.178906 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ad055-5c7f-4f4f-8630-27dd60f832ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:32.179715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ad055-5c7f-4f4f-8630-27dd60f832ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:32.181811 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ad055-5c7f-4f4f-8630-27dd60f832ed admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:32.198095 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1311/2633] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:32.203053 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e5560-428f-4e85-9dab-6e38b031ced4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:32.211401 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e5560-428f-4e85-9dab-6e38b031ced4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:32.216540 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063e34-a698-45ff-98f6-ed04c98f060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:32.217919 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063e34-a698-45ff-98f6-ed04c98f060b admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:32.218273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063e34-a698-45ff-98f6-ed04c98f060b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:32.218613 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063e34-a698-45ff-98f6-ed04c98f060b admin admin] PATH_INFO: `/v3/projects/d43309b7bf1e4526a9a6e8d5a6316579/users/04a70a20061142008bb2002c5c5da7e1/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:32.221892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb063e34-a698-45ff-98f6-ed04c98f060b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43309b7bf1e4526a9a6e8d5a6316579, user_id=04a70a20061142008bb2002c5c5da7e1, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:32.225597 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb063e34-a698-45ff-98f6-ed04c98f060b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:32.236969 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1323/2634] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:32 2022] PUT /identity/v3/projects/d43309b7bf1e4526a9a6e8d5a6316579/users/04a70a20061142008bb2002c5c5da7e1/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:32.250146 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5bcfd-53c2-439e-8d2c-4dc6608405cf None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:32.250438 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5bcfd-53c2-439e-8d2c-4dc6608405cf None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:32.250641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5bcfd-53c2-439e-8d2c-4dc6608405cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:32.305182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-52d5bcfd-53c2-439e-8d2c-4dc6608405cf None None] MFA Rules not processed for user `04a70a20061142008bb2002c5c5da7e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:32.312679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-52d5bcfd-53c2-439e-8d2c-4dc6608405cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:32.397577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1312/2635] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:32.409704 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063e34-a698-45ff-98f6-ed04c98f060b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:32.411509 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bb063e34-a698-45ff-98f6-ed04c98f060b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:32.474642 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063e34-a698-45ff-98f6-ed04c98f060b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:32.478878 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a7455-295d-4f9f-8001-77759b1d7e4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:32.479588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a7455-295d-4f9f-8001-77759b1d7e4a service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:32.479866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a7455-295d-4f9f-8001-77759b1d7e4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:32.480313 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a7455-295d-4f9f-8001-77759b1d7e4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:32.547413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a7455-295d-4f9f-8001-77759b1d7e4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:32.548989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a7455-295d-4f9f-8001-77759b1d7e4a service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:32.565413 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1324/2636] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:34.361852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5bcfd-53c2-439e-8d2c-4dc6608405cf None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:34.363262 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-52d5bcfd-53c2-439e-8d2c-4dc6608405cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:34.378897 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5bcfd-53c2-439e-8d2c-4dc6608405cf None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:34.383582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a94da2-0287-4396-89fe-addf7f8e9b34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:34.384338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a94da2-0287-4396-89fe-addf7f8e9b34 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:34.384722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a94da2-0287-4396-89fe-addf7f8e9b34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:34.385005 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a94da2-0287-4396-89fe-addf7f8e9b34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:34.396423 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a94da2-0287-4396-89fe-addf7f8e9b34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:34.397882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a94da2-0287-4396-89fe-addf7f8e9b34 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:34.407765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1313/2637] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:38.814691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a7455-295d-4f9f-8001-77759b1d7e4a service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:38.868522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:38.880275 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a7455-295d-4f9f-8001-77759b1d7e4a service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:38.884890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8106f60-55e3-4fcc-82da-017c7d6be903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:38.885570 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8106f60-55e3-4fcc-82da-017c7d6be903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:38.885851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8106f60-55e3-4fcc-82da-017c7d6be903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:38.886124 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8106f60-55e3-4fcc-82da-017c7d6be903 admin admin] PATH_INFO: `/v3/users/69792d9463024cddb06a223ab573ca56` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:38.887260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8106f60-55e3-4fcc-82da-017c7d6be903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69792d9463024cddb06a223ab573ca56)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:38.889455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8106f60-55e3-4fcc-82da-017c7d6be903 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:39.116547 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c8106f60-55e3-4fcc-82da-017c7d6be903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69792d9463024cddb06a223ab573ca56'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:39.129452 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c8106f60-55e3-4fcc-82da-017c7d6be903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69792d9463024cddb06a223ab573ca56'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:39.221640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c8106f60-55e3-4fcc-82da-017c7d6be903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69792d9463024cddb06a223ab573ca56'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:39.230103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c8106f60-55e3-4fcc-82da-017c7d6be903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69792d9463024cddb06a223ab573ca56'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:39.230793 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c8106f60-55e3-4fcc-82da-017c7d6be903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69792d9463024cddb06a223ab573ca56'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:39.237958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1325/2638] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:49:38 2022] DELETE /identity/v3/users/69792d9463024cddb06a223ab573ca56 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:39.242980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159e5d-5f05-4c48-a950-1647cfbb43f3 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:39.243522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159e5d-5f05-4c48-a950-1647cfbb43f3 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:39.243522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159e5d-5f05-4c48-a950-1647cfbb43f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:39.267748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5e159e5d-5f05-4c48-a950-1647cfbb43f3 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:39.268999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5e159e5d-5f05-4c48-a950-1647cfbb43f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:39.342888 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1314/2639] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:39.354753 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8106f60-55e3-4fcc-82da-017c7d6be903 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:39.356474 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c8106f60-55e3-4fcc-82da-017c7d6be903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:39.428366 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8106f60-55e3-4fcc-82da-017c7d6be903 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:39.433669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0048b-b11e-48ff-87ae-bdd3f2ac2198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:39.434710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0048b-b11e-48ff-87ae-bdd3f2ac2198 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:39.435395 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0048b-b11e-48ff-87ae-bdd3f2ac2198 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:39.436608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0048b-b11e-48ff-87ae-bdd3f2ac2198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:39.448520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0048b-b11e-48ff-87ae-bdd3f2ac2198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:39.450440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0048b-b11e-48ff-87ae-bdd3f2ac2198 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:39.462067 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1326/2640] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:39.964585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e159e5d-5f05-4c48-a950-1647cfbb43f3 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:39.967793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5e159e5d-5f05-4c48-a950-1647cfbb43f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:39.980414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e159e5d-5f05-4c48-a950-1647cfbb43f3 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:39.987228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:39.988052 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:39.988438 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:39.988582 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] PATH_INFO: `/v3/projects/7bd68b150b0d4f48b9583f95cebde48a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:39.989886 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd68b150b0d4f48b9583f95cebde48a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:39.991798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:40.109709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:40.113442 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd68b150b0d4f48b9583f95cebde48a', 'request_id': 'req-d247b61b-eaae-410d-a1c6-c1dfa57500f2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:40.218719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd68b150b0d4f48b9583f95cebde48a', 'request_id': 'req-d247b61b-eaae-410d-a1c6-c1dfa57500f2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:40.225413 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd68b150b0d4f48b9583f95cebde48a', 'request_id': 'req-d247b61b-eaae-410d-a1c6-c1dfa57500f2'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:40.237712 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] The token cache is being invalidate because project 7bd68b150b0d4f48b9583f95cebde48a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:49:40.238006 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:40.238654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:40.240269 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1315/2641] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:49:39 2022] DELETE /identity/v3/projects/7bd68b150b0d4f48b9583f95cebde48a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:40.244188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0048b-b11e-48ff-87ae-bdd3f2ac2198 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:40.255255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0048b-b11e-48ff-87ae-bdd3f2ac2198 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:40.312470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92b7fe-036b-4638-896b-ca971e029016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:40.312844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92b7fe-036b-4638-896b-ca971e029016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:40.313120 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92b7fe-036b-4638-896b-ca971e029016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:40.313416 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92b7fe-036b-4638-896b-ca971e029016 admin admin] PATH_INFO: `/v3/users/04a70a20061142008bb2002c5c5da7e1` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:40.314546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92b7fe-036b-4638-896b-ca971e029016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a70a20061142008bb2002c5c5da7e1)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:40.316486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92b7fe-036b-4638-896b-ca971e029016 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:40.334100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:40.488171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-dc92b7fe-036b-4638-896b-ca971e029016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a70a20061142008bb2002c5c5da7e1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:40.502406 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-dc92b7fe-036b-4638-896b-ca971e029016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a70a20061142008bb2002c5c5da7e1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:40.578760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-dc92b7fe-036b-4638-896b-ca971e029016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a70a20061142008bb2002c5c5da7e1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:40.586476 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-dc92b7fe-036b-4638-896b-ca971e029016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a70a20061142008bb2002c5c5da7e1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:40.587076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-dc92b7fe-036b-4638-896b-ca971e029016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a70a20061142008bb2002c5c5da7e1'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:40.593970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1327/2642] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:49:40 2022] DELETE /identity/v3/users/04a70a20061142008bb2002c5c5da7e1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:49:41.042923 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:41.046028 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:41.073230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247b61b-eaae-410d-a1c6-c1dfa57500f2 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:41.142332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac46a3-89ff-4460-bccb-9085900e16e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:41.142960 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac46a3-89ff-4460-bccb-9085900e16e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:41.143392 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac46a3-89ff-4460-bccb-9085900e16e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:41.143509 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac46a3-89ff-4460-bccb-9085900e16e3 admin admin] PATH_INFO: `/v3/projects/d43309b7bf1e4526a9a6e8d5a6316579` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:41.144675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac46a3-89ff-4460-bccb-9085900e16e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d43309b7bf1e4526a9a6e8d5a6316579)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:41.146585 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac46a3-89ff-4460-bccb-9085900e16e3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:41.256220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f6ac46a3-89ff-4460-bccb-9085900e16e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd43309b7bf1e4526a9a6e8d5a6316579', 'request_id': 'req-f6ac46a3-89ff-4460-bccb-9085900e16e3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:41.319574 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f6ac46a3-89ff-4460-bccb-9085900e16e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd43309b7bf1e4526a9a6e8d5a6316579', 'request_id': 'req-f6ac46a3-89ff-4460-bccb-9085900e16e3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:41.327938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f6ac46a3-89ff-4460-bccb-9085900e16e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd43309b7bf1e4526a9a6e8d5a6316579', 'request_id': 'req-f6ac46a3-89ff-4460-bccb-9085900e16e3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:41.344516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f6ac46a3-89ff-4460-bccb-9085900e16e3 admin admin] The token cache is being invalidate because project d43309b7bf1e4526a9a6e8d5a6316579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:49:41.344903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f6ac46a3-89ff-4460-bccb-9085900e16e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:41.345755 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-f6ac46a3-89ff-4460-bccb-9085900e16e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:41.352906 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1316/2643] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:49:41 2022] DELETE /identity/v3/projects/d43309b7bf1e4526a9a6e8d5a6316579 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:41.355283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee11d8-2a76-4a6d-8dad-ece4f0e6a977 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:41.355778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee11d8-2a76-4a6d-8dad-ece4f0e6a977 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:41.356002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee11d8-2a76-4a6d-8dad-ece4f0e6a977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:41.381812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-4bee11d8-2a76-4a6d-8dad-ece4f0e6a977 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:41.383033 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4bee11d8-2a76-4a6d-8dad-ece4f0e6a977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:41.450167 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1328/2644] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:41.459177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399179d-b8a9-47ca-a0eb-ccb05d1da154 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:41.459467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399179d-b8a9-47ca-a0eb-ccb05d1da154 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:41.459744 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399179d-b8a9-47ca-a0eb-ccb05d1da154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:41.481057 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7399179d-b8a9-47ca-a0eb-ccb05d1da154 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:41.482922 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7399179d-b8a9-47ca-a0eb-ccb05d1da154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:41.493569 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1317/2645] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:41.499777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee11d8-2a76-4a6d-8dad-ece4f0e6a977 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:41.510149 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee11d8-2a76-4a6d-8dad-ece4f0e6a977 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:41.516528 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081e1b3-6de6-41a9-b658-a04d6d5048ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:41.517058 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081e1b3-6de6-41a9-b658-a04d6d5048ed admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:41.517383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081e1b3-6de6-41a9-b658-a04d6d5048ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:41.517678 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081e1b3-6de6-41a9-b658-a04d6d5048ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:41.518358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081e1b3-6de6-41a9-b658-a04d6d5048ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:49:41.518660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081e1b3-6de6-41a9-b658-a04d6d5048ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:41.520322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081e1b3-6de6-41a9-b658-a04d6d5048ed admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:41.534423 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1329/2646] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:49:41.539110 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399179d-b8a9-47ca-a0eb-ccb05d1da154 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:41.550192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399179d-b8a9-47ca-a0eb-ccb05d1da154 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:41.555065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ec3e6-9041-4928-8dd3-3881f4d5a119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:41.555672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ec3e6-9041-4928-8dd3-3881f4d5a119 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:41.555983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ec3e6-9041-4928-8dd3-3881f4d5a119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:41.556254 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ec3e6-9041-4928-8dd3-3881f4d5a119 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:41.557001 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ec3e6-9041-4928-8dd3-3881f4d5a119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:41.559057 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ec3e6-9041-4928-8dd3-3881f4d5a119 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:41.671555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1318/2647] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:49:41 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:41.675661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081e1b3-6de6-41a9-b658-a04d6d5048ed admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:41.686055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081e1b3-6de6-41a9-b658-a04d6d5048ed admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:41.743449 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b48943-b521-40a1-ade4-c7056a8ddcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:41.743958 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b48943-b521-40a1-ade4-c7056a8ddcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:41.744238 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b48943-b521-40a1-ade4-c7056a8ddcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:41.744517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b48943-b521-40a1-ade4-c7056a8ddcd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:41.745151 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b48943-b521-40a1-ade4-c7056a8ddcd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:41.747075 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b48943-b521-40a1-ade4-c7056a8ddcd0 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:41.852077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1330/2648] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:49:41 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:41.856291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ec3e6-9041-4928-8dd3-3881f4d5a119 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:41.866752 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ec3e6-9041-4928-8dd3-3881f4d5a119 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:41.871366 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747eb4b-6eaf-4e3b-804e-92d2905761e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:41.871955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747eb4b-6eaf-4e3b-804e-92d2905761e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:41.872230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747eb4b-6eaf-4e3b-804e-92d2905761e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:41.872500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747eb4b-6eaf-4e3b-804e-92d2905761e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:41.873849 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747eb4b-6eaf-4e3b-804e-92d2905761e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:41.875319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747eb4b-6eaf-4e3b-804e-92d2905761e5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:41.885036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1319/2649] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:41.890085 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b48943-b521-40a1-ade4-c7056a8ddcd0 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:41.900139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b48943-b521-40a1-ade4-c7056a8ddcd0 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:41.904764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a4e57-b239-4125-8275-aa6550fab8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:41.905388 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a4e57-b239-4125-8275-aa6550fab8af admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:41.905667 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a4e57-b239-4125-8275-aa6550fab8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:41.905938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a4e57-b239-4125-8275-aa6550fab8af admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:41.906575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a4e57-b239-4125-8275-aa6550fab8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:41.908153 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a4e57-b239-4125-8275-aa6550fab8af admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:41.913435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:41.920076 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1331/2650] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:41.925306 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747eb4b-6eaf-4e3b-804e-92d2905761e5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:41.935842 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747eb4b-6eaf-4e3b-804e-92d2905761e5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:41.940675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ccc0e-6476-4694-87e9-bdee719b2b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:41.941346 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ccc0e-6476-4694-87e9-bdee719b2b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:41.941624 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ccc0e-6476-4694-87e9-bdee719b2b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:41.941893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ccc0e-6476-4694-87e9-bdee719b2b75 admin admin] PATH_INFO: `/v3/projects/98750d0194a848c4a225a8bf7143a2df/users/32008d654e5340878f2708053b1443c5/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:41.957041 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ccc0e-6476-4694-87e9-bdee719b2b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98750d0194a848c4a225a8bf7143a2df, user_id=32008d654e5340878f2708053b1443c5, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:41.959702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ccc0e-6476-4694-87e9-bdee719b2b75 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:42.032734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:42.038114 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1320/2651] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:41 2022] PUT /identity/v3/projects/98750d0194a848c4a225a8bf7143a2df/users/32008d654e5340878f2708053b1443c5/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:42.103747 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef5bbd-d95c-4088-a8de-ce2254b39a5a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:42.104030 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef5bbd-d95c-4088-a8de-ce2254b39a5a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:42.104425 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef5bbd-d95c-4088-a8de-ce2254b39a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:42.132599 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ceef5bbd-d95c-4088-a8de-ce2254b39a5a None None] MFA Rules not processed for user `32008d654e5340878f2708053b1443c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:42.133823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ceef5bbd-d95c-4088-a8de-ce2254b39a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:42.197728 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1332/2652] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:42.202274 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ccc0e-6476-4694-87e9-bdee719b2b75 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:42.255778 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514db528-10ac-4815-931f-9fee47b59c91 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:42.256061 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514db528-10ac-4815-931f-9fee47b59c91 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:42.256329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514db528-10ac-4815-931f-9fee47b59c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:42.274062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ccc0e-6476-4694-87e9-bdee719b2b75 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:42.280715 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-514db528-10ac-4815-931f-9fee47b59c91 None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:42.281952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-514db528-10ac-4815-931f-9fee47b59c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:42.282548 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c75a09-f1da-46bf-ad9f-c3000facc7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:42.283228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c75a09-f1da-46bf-ad9f-c3000facc7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:42.283446 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c75a09-f1da-46bf-ad9f-c3000facc7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:42.283719 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c75a09-f1da-46bf-ad9f-c3000facc7b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:42.284356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c75a09-f1da-46bf-ad9f-c3000facc7b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:42.286618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c75a09-f1da-46bf-ad9f-c3000facc7b4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:42.349692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1333/2653] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 31 04:49:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:49:42.364173 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514db528-10ac-4815-931f-9fee47b59c91 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:42.366129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-514db528-10ac-4815-931f-9fee47b59c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:42.424961 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1321/2654] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:49:42 2022] POST /identity/v3/projects => generated 389 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:42.428634 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c75a09-f1da-46bf-ad9f-c3000facc7b4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:42.454907 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514db528-10ac-4815-931f-9fee47b59c91 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:42.494168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:42.503077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c75a09-f1da-46bf-ad9f-c3000facc7b4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:42.508033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce4492-d80c-47ca-9c53-7c503e6b5a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:42.508317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce4492-d80c-47ca-9c53-7c503e6b5a5d admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:42.508592 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce4492-d80c-47ca-9c53-7c503e6b5a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:42.508858 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce4492-d80c-47ca-9c53-7c503e6b5a5d admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:42.509520 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce4492-d80c-47ca-9c53-7c503e6b5a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:42.511440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce4492-d80c-47ca-9c53-7c503e6b5a5d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:42.522471 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c499903-50a7-4e27-bc7f-ae10e3cade6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:42.523088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c499903-50a7-4e27-bc7f-ae10e3cade6e service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:42.523366 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c499903-50a7-4e27-bc7f-ae10e3cade6e service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:42.523635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c499903-50a7-4e27-bc7f-ae10e3cade6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:42.584200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c499903-50a7-4e27-bc7f-ae10e3cade6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:42.585830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c499903-50a7-4e27-bc7f-ae10e3cade6e service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:42.594736 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1334/2655] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:49:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:49:42.638328 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1322/2656] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:49:42 2022] POST /identity/v3/users => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:49:42.640271 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c499903-50a7-4e27-bc7f-ae10e3cade6e service swift] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:42.651407 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c499903-50a7-4e27-bc7f-ae10e3cade6e service swift] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:42.658338 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a472e-c102-4abe-bac2-e67d1d3a482b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:42.658970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a472e-c102-4abe-bac2-e67d1d3a482b admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:42.659248 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a472e-c102-4abe-bac2-e67d1d3a482b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:42.659522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a472e-c102-4abe-bac2-e67d1d3a482b admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:42.660396 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a472e-c102-4abe-bac2-e67d1d3a482b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:42.661814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a472e-c102-4abe-bac2-e67d1d3a482b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:42.679096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1335/2657] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:42.680488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce4492-d80c-47ca-9c53-7c503e6b5a5d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:42.691455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce4492-d80c-47ca-9c53-7c503e6b5a5d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:42.696145 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a4fb0-d211-4981-8b04-b21036caa8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:42.696793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a4fb0-d211-4981-8b04-b21036caa8ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:42.697069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a4fb0-d211-4981-8b04-b21036caa8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:42.697380 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a4fb0-d211-4981-8b04-b21036caa8ac admin admin] PATH_INFO: `/v3/projects/e55e1a3ada784e5eb1658afb32412746/users/e979c6923c9f447c83bcafa86636ad35/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:42.712908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a4fb0-d211-4981-8b04-b21036caa8ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e55e1a3ada784e5eb1658afb32412746, user_id=e979c6923c9f447c83bcafa86636ad35, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:42.715560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a4fb0-d211-4981-8b04-b21036caa8ac admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:42.809600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1323/2658] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:42 2022] PUT /identity/v3/projects/e55e1a3ada784e5eb1658afb32412746/users/e979c6923c9f447c83bcafa86636ad35/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:42.814190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a472e-c102-4abe-bac2-e67d1d3a482b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:42.824250 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a472e-c102-4abe-bac2-e67d1d3a482b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:42.881833 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a871b-e082-4a59-9b27-e7b5f3f3bfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:42.882437 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a871b-e082-4a59-9b27-e7b5f3f3bfec admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:42.882720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a871b-e082-4a59-9b27-e7b5f3f3bfec admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:42.882996 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a871b-e082-4a59-9b27-e7b5f3f3bfec admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:42.885867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a871b-e082-4a59-9b27-e7b5f3f3bfec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:42.887477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a871b-e082-4a59-9b27-e7b5f3f3bfec admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:42.899295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1336/2659] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:42.903122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a4fb0-d211-4981-8b04-b21036caa8ac admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:42.914008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a4fb0-d211-4981-8b04-b21036caa8ac admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:42.918937 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d67b2c-5363-4834-9d52-4a8678b96b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:42.919576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d67b2c-5363-4834-9d52-4a8678b96b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:42.919969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d67b2c-5363-4834-9d52-4a8678b96b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:42.920242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d67b2c-5363-4834-9d52-4a8678b96b31 admin admin] PATH_INFO: `/v3/projects/e55e1a3ada784e5eb1658afb32412746/users/e979c6923c9f447c83bcafa86636ad35/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:42.922219 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d67b2c-5363-4834-9d52-4a8678b96b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e55e1a3ada784e5eb1658afb32412746, user_id=e979c6923c9f447c83bcafa86636ad35, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:42.924802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d67b2c-5363-4834-9d52-4a8678b96b31 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:42.934856 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1324/2660] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:42 2022] PUT /identity/v3/projects/e55e1a3ada784e5eb1658afb32412746/users/e979c6923c9f447c83bcafa86636ad35/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:42.945619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e5c2b-1049-453a-9c7d-6835d0ce6165 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:42.945908 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e5c2b-1049-453a-9c7d-6835d0ce6165 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:42.946185 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e5c2b-1049-453a-9c7d-6835d0ce6165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:42.975331 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-540e5c2b-1049-453a-9c7d-6835d0ce6165 None None] MFA Rules not processed for user `e979c6923c9f447c83bcafa86636ad35`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:42.977128 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-540e5c2b-1049-453a-9c7d-6835d0ce6165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:43.035001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=100 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:43.056346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1337/2661] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:43.066622 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d67b2c-5363-4834-9d52-4a8678b96b31 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:43.068523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-77d67b2c-5363-4834-9d52-4a8678b96b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:43.113406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:43.129610 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d67b2c-5363-4834-9d52-4a8678b96b31 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:43.133363 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f59880-9b55-4ef3-bd5d-778e8cc2689a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:43.136331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f59880-9b55-4ef3-bd5d-778e8cc2689a service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:43.136331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f59880-9b55-4ef3-bd5d-778e8cc2689a service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:43.136331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f59880-9b55-4ef3-bd5d-778e8cc2689a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:43.144704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f59880-9b55-4ef3-bd5d-778e8cc2689a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:43.146478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f59880-9b55-4ef3-bd5d-778e8cc2689a service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:43.157155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1325/2662] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:43.305083 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e5c2b-1049-453a-9c7d-6835d0ce6165 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:43.375667 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e5c2b-1049-453a-9c7d-6835d0ce6165 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:43.380751 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a043a21-990a-473e-a5d0-60ed98536d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:43.381526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a043a21-990a-473e-a5d0-60ed98536d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:43.381801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a043a21-990a-473e-a5d0-60ed98536d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:43.382081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a043a21-990a-473e-a5d0-60ed98536d9a admin admin] PATH_INFO: `/v3/users/32008d654e5340878f2708053b1443c5` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:43.383194 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a043a21-990a-473e-a5d0-60ed98536d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=32008d654e5340878f2708053b1443c5)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:43.385470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a043a21-990a-473e-a5d0-60ed98536d9a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:43.593137 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7a043a21-990a-473e-a5d0-60ed98536d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32008d654e5340878f2708053b1443c5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:43.609452 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7a043a21-990a-473e-a5d0-60ed98536d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32008d654e5340878f2708053b1443c5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:43.675325 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7a043a21-990a-473e-a5d0-60ed98536d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32008d654e5340878f2708053b1443c5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:43.683346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7a043a21-990a-473e-a5d0-60ed98536d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32008d654e5340878f2708053b1443c5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:43.683987 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7a043a21-990a-473e-a5d0-60ed98536d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32008d654e5340878f2708053b1443c5'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:43.690645 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1338/2663] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:49:43 2022] DELETE /identity/v3/users/32008d654e5340878f2708053b1443c5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:43.695335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec2eea-e8b4-46b8-a691-6a6485c10a50 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:43.695822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec2eea-e8b4-46b8-a691-6a6485c10a50 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:43.695934 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec2eea-e8b4-46b8-a691-6a6485c10a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:43.717162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-59ec2eea-e8b4-46b8-a691-6a6485c10a50 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:43.718247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-59ec2eea-e8b4-46b8-a691-6a6485c10a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:43.777790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1326/2664] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:43.788284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a043a21-990a-473e-a5d0-60ed98536d9a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:43.789698 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-7a043a21-990a-473e-a5d0-60ed98536d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:43.846809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a043a21-990a-473e-a5d0-60ed98536d9a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:43.850354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb4178-e7f9-46fb-91a3-e18547a0ff3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:43.850943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4178-e7f9-46fb-91a3-e18547a0ff3f service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:43.851222 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4178-e7f9-46fb-91a3-e18547a0ff3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:43.851492 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4178-e7f9-46fb-91a3-e18547a0ff3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:43.860611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb4178-e7f9-46fb-91a3-e18547a0ff3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:43.862072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb4178-e7f9-46fb-91a3-e18547a0ff3f service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:43.871314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1339/2665] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:44.276495 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec2eea-e8b4-46b8-a691-6a6485c10a50 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:44.281299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-59ec2eea-e8b4-46b8-a691-6a6485c10a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:44.291320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec2eea-e8b4-46b8-a691-6a6485c10a50 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:44.297188 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:44.297908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:44.298130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:44.298406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] PATH_INFO: `/v3/projects/98750d0194a848c4a225a8bf7143a2df` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:44.299960 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98750d0194a848c4a225a8bf7143a2df)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:44.301654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:44.415676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98750d0194a848c4a225a8bf7143a2df', 'request_id': 'req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:44.511845 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98750d0194a848c4a225a8bf7143a2df', 'request_id': 'req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:44.519123 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98750d0194a848c4a225a8bf7143a2df', 'request_id': 'req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:44.530959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] The token cache is being invalidate because project 98750d0194a848c4a225a8bf7143a2df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:49:44.531182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:44.531867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:44.533384 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1327/2666] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:49:44 2022] DELETE /identity/v3/projects/98750d0194a848c4a225a8bf7143a2df => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:44.537583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb4178-e7f9-46fb-91a3-e18547a0ff3f service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:44.547769 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb4178-e7f9-46fb-91a3-e18547a0ff3f service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:44.555393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:44.603247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5abcf-f851-4009-ad19-d4d86571da3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:44.603867 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5abcf-f851-4009-ad19-d4d86571da3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:44.604143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5abcf-f851-4009-ad19-d4d86571da3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:44.604412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5abcf-f851-4009-ad19-d4d86571da3a admin admin] PATH_INFO: `/v3/users/e979c6923c9f447c83bcafa86636ad35` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:44.605672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5abcf-f851-4009-ad19-d4d86571da3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e979c6923c9f447c83bcafa86636ad35)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:44.609614 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5abcf-f851-4009-ad19-d4d86571da3a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:44.805409 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d4b5abcf-f851-4009-ad19-d4d86571da3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e979c6923c9f447c83bcafa86636ad35'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:44.818291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d4b5abcf-f851-4009-ad19-d4d86571da3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e979c6923c9f447c83bcafa86636ad35'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:44.892051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d4b5abcf-f851-4009-ad19-d4d86571da3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e979c6923c9f447c83bcafa86636ad35'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:44.899623 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d4b5abcf-f851-4009-ad19-d4d86571da3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e979c6923c9f447c83bcafa86636ad35'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:44.900249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-d4b5abcf-f851-4009-ad19-d4d86571da3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e979c6923c9f447c83bcafa86636ad35'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:44.907130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1340/2667] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:49:44 2022] DELETE /identity/v3/users/e979c6923c9f447c83bcafa86636ad35 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:45.373991 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:45.376797 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:45.390399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ec22c-50ca-4a4b-8ed6-708ca3bf2551 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:45.448873 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf006d-0e46-4523-b014-4cb0f0416f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:45.449533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf006d-0e46-4523-b014-4cb0f0416f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:45.449814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf006d-0e46-4523-b014-4cb0f0416f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:45.450087 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf006d-0e46-4523-b014-4cb0f0416f4e admin admin] PATH_INFO: `/v3/projects/e55e1a3ada784e5eb1658afb32412746` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:45.452208 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf006d-0e46-4523-b014-4cb0f0416f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e55e1a3ada784e5eb1658afb32412746)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:45.454337 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf006d-0e46-4523-b014-4cb0f0416f4e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:45.456474 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:45.551437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ebbf006d-0e46-4523-b014-4cb0f0416f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e55e1a3ada784e5eb1658afb32412746', 'request_id': 'req-ebbf006d-0e46-4523-b014-4cb0f0416f4e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:45.614732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ebbf006d-0e46-4523-b014-4cb0f0416f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e55e1a3ada784e5eb1658afb32412746', 'request_id': 'req-ebbf006d-0e46-4523-b014-4cb0f0416f4e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:45.620514 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ebbf006d-0e46-4523-b014-4cb0f0416f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e55e1a3ada784e5eb1658afb32412746', 'request_id': 'req-ebbf006d-0e46-4523-b014-4cb0f0416f4e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:45.631906 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ebbf006d-0e46-4523-b014-4cb0f0416f4e admin admin] The token cache is being invalidate because project e55e1a3ada784e5eb1658afb32412746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:49:45.632193 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ebbf006d-0e46-4523-b014-4cb0f0416f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:45.632825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-ebbf006d-0e46-4523-b014-4cb0f0416f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:45.634351 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1328/2668] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:49:45 2022] DELETE /identity/v3/projects/e55e1a3ada784e5eb1658afb32412746 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:45.640102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea2d8d-ac0f-47ca-95e8-4118fc0b51b4 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:45.640602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea2d8d-ac0f-47ca-95e8-4118fc0b51b4 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:45.640699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea2d8d-ac0f-47ca-95e8-4118fc0b51b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:45.660009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-88ea2d8d-ac0f-47ca-95e8-4118fc0b51b4 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:45.661190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-88ea2d8d-ac0f-47ca-95e8-4118fc0b51b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:45.719614 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1341/2669] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:45.728670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e2127-2428-4d94-bd09-b75d10650856 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:45.728956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e2127-2428-4d94-bd09-b75d10650856 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:45.729260 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e2127-2428-4d94-bd09-b75d10650856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:45.758902 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0b8e2127-2428-4d94-bd09-b75d10650856 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:45.760119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0b8e2127-2428-4d94-bd09-b75d10650856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:45.769555 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1329/2670] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:45.773834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea2d8d-ac0f-47ca-95e8-4118fc0b51b4 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:45.783576 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea2d8d-ac0f-47ca-95e8-4118fc0b51b4 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:45.788302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90e7fc-b328-44a0-b984-e85b6327b879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:45.788934 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e7fc-b328-44a0-b984-e85b6327b879 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:45.789241 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e7fc-b328-44a0-b984-e85b6327b879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:45.789523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e7fc-b328-44a0-b984-e85b6327b879 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:45.790200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90e7fc-b328-44a0-b984-e85b6327b879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:49:45.790503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90e7fc-b328-44a0-b984-e85b6327b879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:45.792346 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90e7fc-b328-44a0-b984-e85b6327b879 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:45.805006 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1342/2671] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:49:45.809574 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e2127-2428-4d94-bd09-b75d10650856 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:45.819544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e2127-2428-4d94-bd09-b75d10650856 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:45.824208 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530149fc-aa9a-48b5-a3a4-f458e0a633d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:45.824802 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530149fc-aa9a-48b5-a3a4-f458e0a633d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:45.825093 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530149fc-aa9a-48b5-a3a4-f458e0a633d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:45.825375 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530149fc-aa9a-48b5-a3a4-f458e0a633d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:45.826180 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530149fc-aa9a-48b5-a3a4-f458e0a633d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:45.828068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530149fc-aa9a-48b5-a3a4-f458e0a633d9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:45.925373 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1330/2672] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:49:45 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:45.929676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90e7fc-b328-44a0-b984-e85b6327b879 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:45.940494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90e7fc-b328-44a0-b984-e85b6327b879 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:45.953657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:45.999506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3729f43-00d0-4404-9af8-90b219170907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:46.000111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3729f43-00d0-4404-9af8-90b219170907 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:46.000393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3729f43-00d0-4404-9af8-90b219170907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:46.000667 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3729f43-00d0-4404-9af8-90b219170907 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:46.001342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3729f43-00d0-4404-9af8-90b219170907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:46.003326 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3729f43-00d0-4404-9af8-90b219170907 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:46.125729 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1343/2673] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:49:45 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:49:46.129827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530149fc-aa9a-48b5-a3a4-f458e0a633d9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:46.141322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530149fc-aa9a-48b5-a3a4-f458e0a633d9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:46.146116 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b2a14-333a-4958-8bd6-89d4f1de3aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:46.146813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b2a14-333a-4958-8bd6-89d4f1de3aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:46.156549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b2a14-333a-4958-8bd6-89d4f1de3aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:46.156549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b2a14-333a-4958-8bd6-89d4f1de3aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:46.156549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b2a14-333a-4958-8bd6-89d4f1de3aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:46.156549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b2a14-333a-4958-8bd6-89d4f1de3aa5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:46.160915 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1331/2674] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:49:46.165024 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3729f43-00d0-4404-9af8-90b219170907 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:46.176962 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3729f43-00d0-4404-9af8-90b219170907 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:46.183849 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6bf9d-2665-40e6-ad1d-43d0e4ae859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:46.184681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6bf9d-2665-40e6-ad1d-43d0e4ae859b admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:46.185864 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6bf9d-2665-40e6-ad1d-43d0e4ae859b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:46.186185 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6bf9d-2665-40e6-ad1d-43d0e4ae859b admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:46.186848 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6bf9d-2665-40e6-ad1d-43d0e4ae859b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:46.188462 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6bf9d-2665-40e6-ad1d-43d0e4ae859b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:46.204228 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1344/2675] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:49:46.208521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b2a14-333a-4958-8bd6-89d4f1de3aa5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:46.222891 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b2a14-333a-4958-8bd6-89d4f1de3aa5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:46.228612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2ae7b-54da-46aa-ab31-233b5d970984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:46.229305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ae7b-54da-46aa-ab31-233b5d970984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:46.231135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ae7b-54da-46aa-ab31-233b5d970984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:46.231135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ae7b-54da-46aa-ab31-233b5d970984 admin admin] PATH_INFO: `/v3/projects/e7d606b9b5ae4e04a539c5cd7d6b5400/users/0e695aaa93844e6f9bca100564d38e2f/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:46.253772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2ae7b-54da-46aa-ab31-233b5d970984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d606b9b5ae4e04a539c5cd7d6b5400, user_id=0e695aaa93844e6f9bca100564d38e2f, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:46.256635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2ae7b-54da-46aa-ab31-233b5d970984 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:46.329009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1332/2676] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:46 2022] PUT /identity/v3/projects/e7d606b9b5ae4e04a539c5cd7d6b5400/users/0e695aaa93844e6f9bca100564d38e2f/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:46.334049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6acbe-7b80-4773-92a0-25e6db682d37 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:46.334337 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6acbe-7b80-4773-92a0-25e6db682d37 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:46.334609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6acbe-7b80-4773-92a0-25e6db682d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:46.355003 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-01f6acbe-7b80-4773-92a0-25e6db682d37 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:46.356202 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-01f6acbe-7b80-4773-92a0-25e6db682d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:46.416455 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1345/2677] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:46.426453 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2ae7b-54da-46aa-ab31-233b5d970984 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:46.428197 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5da2ae7b-54da-46aa-ab31-233b5d970984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:46.486026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2ae7b-54da-46aa-ab31-233b5d970984 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:46.489704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41ba55-f92e-4094-af3f-c7cbf1a0cdb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:46.490311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41ba55-f92e-4094-af3f-c7cbf1a0cdb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:46.490591 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41ba55-f92e-4094-af3f-c7cbf1a0cdb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:46.490864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41ba55-f92e-4094-af3f-c7cbf1a0cdb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:46.500595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41ba55-f92e-4094-af3f-c7cbf1a0cdb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:46.502057 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41ba55-f92e-4094-af3f-c7cbf1a0cdb4 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:46.511408 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1333/2678] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:49.423380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6acbe-7b80-4773-92a0-25e6db682d37 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:49.425185 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-01f6acbe-7b80-4773-92a0-25e6db682d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:49.438605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6acbe-7b80-4773-92a0-25e6db682d37 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:49.443329 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2929b0b-4ca3-49f5-b0cc-9056b15be2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:49.444017 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2929b0b-4ca3-49f5-b0cc-9056b15be2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:49.444430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2929b0b-4ca3-49f5-b0cc-9056b15be2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:49.446593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2929b0b-4ca3-49f5-b0cc-9056b15be2b1 admin admin] PATH_INFO: `/v3/users/b29c4ee64a444504b32748e5a2e9a38c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:49.446593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2929b0b-4ca3-49f5-b0cc-9056b15be2b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b29c4ee64a444504b32748e5a2e9a38c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:49.448079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2929b0b-4ca3-49f5-b0cc-9056b15be2b1 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:49.665357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c2929b0b-4ca3-49f5-b0cc-9056b15be2b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b29c4ee64a444504b32748e5a2e9a38c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:49.684706 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c2929b0b-4ca3-49f5-b0cc-9056b15be2b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b29c4ee64a444504b32748e5a2e9a38c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:49.766563 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c2929b0b-4ca3-49f5-b0cc-9056b15be2b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b29c4ee64a444504b32748e5a2e9a38c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:49.782825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c2929b0b-4ca3-49f5-b0cc-9056b15be2b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b29c4ee64a444504b32748e5a2e9a38c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:49.782825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-c2929b0b-4ca3-49f5-b0cc-9056b15be2b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b29c4ee64a444504b32748e5a2e9a38c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:49.789810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1346/2679] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:49:49 2022] DELETE /identity/v3/users/b29c4ee64a444504b32748e5a2e9a38c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:49.795898 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011a4b7-7a06-4799-b052-7bfe5f053182 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:49.796532 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011a4b7-7a06-4799-b052-7bfe5f053182 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:49.796532 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011a4b7-7a06-4799-b052-7bfe5f053182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:49.839591 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3011a4b7-7a06-4799-b052-7bfe5f053182 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:49.840883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3011a4b7-7a06-4799-b052-7bfe5f053182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:49.875228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:49.921274 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1334/2680] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:49:49.931709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2929b0b-4ca3-49f5-b0cc-9056b15be2b1 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:49.934422 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c2929b0b-4ca3-49f5-b0cc-9056b15be2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:49.947376 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:50.003616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2929b0b-4ca3-49f5-b0cc-9056b15be2b1 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:50.007516 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1482399-aabe-4dc9-8c44-91890ee376db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:50.008126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1482399-aabe-4dc9-8c44-91890ee376db service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:50.010284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1482399-aabe-4dc9-8c44-91890ee376db service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:50.010284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1482399-aabe-4dc9-8c44-91890ee376db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:50.019920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1482399-aabe-4dc9-8c44-91890ee376db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:50.021784 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1482399-aabe-4dc9-8c44-91890ee376db service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:50.035979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1347/2681] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:49:50.580528 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011a4b7-7a06-4799-b052-7bfe5f053182 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:50.583691 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3011a4b7-7a06-4799-b052-7bfe5f053182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:50.600138 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011a4b7-7a06-4799-b052-7bfe5f053182 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:50.605129 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:50.606205 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:50.606602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:50.607470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] PATH_INFO: `/v3/projects/83d77b81bf634c0e9df9f1a4856b8080` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:50.608985 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d77b81bf634c0e9df9f1a4856b8080)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:50.611157 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:50.735419 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d77b81bf634c0e9df9f1a4856b8080', 'request_id': 'req-b56c324d-d39a-4587-8ebe-22519644f26f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:50.832125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d77b81bf634c0e9df9f1a4856b8080', 'request_id': 'req-b56c324d-d39a-4587-8ebe-22519644f26f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:50.839191 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d77b81bf634c0e9df9f1a4856b8080', 'request_id': 'req-b56c324d-d39a-4587-8ebe-22519644f26f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:50.852991 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] The token cache is being invalidate because project 83d77b81bf634c0e9df9f1a4856b8080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:49:50.853324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:50.854166 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:50.861060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1482399-aabe-4dc9-8c44-91890ee376db service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:50.861642 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1335/2682] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:49:50 2022] DELETE /identity/v3/projects/83d77b81bf634c0e9df9f1a4856b8080 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:50.871325 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1482399-aabe-4dc9-8c44-91890ee376db service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:50.949690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd61c0-b6af-4c7a-bb2d-961ef4c4da61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:50.950342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd61c0-b6af-4c7a-bb2d-961ef4c4da61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:50.950748 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd61c0-b6af-4c7a-bb2d-961ef4c4da61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:50.951117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd61c0-b6af-4c7a-bb2d-961ef4c4da61 admin admin] PATH_INFO: `/v3/users/a2014deb4f2046a0a54610e264b9a005` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:50.952392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd61c0-b6af-4c7a-bb2d-961ef4c4da61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2014deb4f2046a0a54610e264b9a005)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:50.954412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd61c0-b6af-4c7a-bb2d-961ef4c4da61 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:51.171485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-dffd61c0-b6af-4c7a-bb2d-961ef4c4da61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2014deb4f2046a0a54610e264b9a005'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:51.185673 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-dffd61c0-b6af-4c7a-bb2d-961ef4c4da61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2014deb4f2046a0a54610e264b9a005'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:51.272124 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-dffd61c0-b6af-4c7a-bb2d-961ef4c4da61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2014deb4f2046a0a54610e264b9a005'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:51.281176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-dffd61c0-b6af-4c7a-bb2d-961ef4c4da61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2014deb4f2046a0a54610e264b9a005'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:51.281966 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-dffd61c0-b6af-4c7a-bb2d-961ef4c4da61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2014deb4f2046a0a54610e264b9a005'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:51.289374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1348/2683] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:49:50 2022] DELETE /identity/v3/users/a2014deb4f2046a0a54610e264b9a005 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:51.737047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:51.739515 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:51.760360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c324d-d39a-4587-8ebe-22519644f26f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:51.914380 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e063c-42fb-46fd-a480-8db7a4186c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:51.917505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e063c-42fb-46fd-a480-8db7a4186c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:51.918015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e063c-42fb-46fd-a480-8db7a4186c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:51.918299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e063c-42fb-46fd-a480-8db7a4186c6d admin admin] PATH_INFO: `/v3/projects/c9e42d86a6064e5b83d04f0fb759b261` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:51.920164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e063c-42fb-46fd-a480-8db7a4186c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e42d86a6064e5b83d04f0fb759b261)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:51.922250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e063c-42fb-46fd-a480-8db7a4186c6d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:52.038309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd37f81-f405-425f-a6a8-e9ef59537f41 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.038782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd37f81-f405-425f-a6a8-e9ef59537f41 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.039229 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd37f81-f405-425f-a6a8-e9ef59537f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:52.061285 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c50e063c-42fb-46fd-a480-8db7a4186c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e42d86a6064e5b83d04f0fb759b261', 'request_id': 'req-c50e063c-42fb-46fd-a480-8db7a4186c6d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:52.079549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1cd37f81-f405-425f-a6a8-e9ef59537f41 None None] MFA Rules not processed for user `0e695aaa93844e6f9bca100564d38e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:52.081059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1cd37f81-f405-425f-a6a8-e9ef59537f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:52.104263 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:52.126380 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c50e063c-42fb-46fd-a480-8db7a4186c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e42d86a6064e5b83d04f0fb759b261', 'request_id': 'req-c50e063c-42fb-46fd-a480-8db7a4186c6d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:52.128068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:52.134054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c50e063c-42fb-46fd-a480-8db7a4186c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e42d86a6064e5b83d04f0fb759b261', 'request_id': 'req-c50e063c-42fb-46fd-a480-8db7a4186c6d'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:52.150336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c50e063c-42fb-46fd-a480-8db7a4186c6d admin admin] The token cache is being invalidate because project c9e42d86a6064e5b83d04f0fb759b261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:49:52.150626 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c50e063c-42fb-46fd-a480-8db7a4186c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:52.151281 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c50e063c-42fb-46fd-a480-8db7a4186c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:49:52.153353 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1336/2684] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:49:51 2022] DELETE /identity/v3/projects/c9e42d86a6064e5b83d04f0fb759b261 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:52.158211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109bed9-45fc-4639-a956-934df13301d9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.158544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109bed9-45fc-4639-a956-934df13301d9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.158766 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109bed9-45fc-4639-a956-934df13301d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:52.168922 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1349/2685] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:49:52.174631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd37f81-f405-425f-a6a8-e9ef59537f41 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:52.176126 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1cd37f81-f405-425f-a6a8-e9ef59537f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:52.181422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-f109bed9-45fc-4639-a956-934df13301d9 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:52.182733 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-f109bed9-45fc-4639-a956-934df13301d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:52.260608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd37f81-f405-425f-a6a8-e9ef59537f41 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:52.267411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aec02-ead6-4594-93f9-3140e24ab940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:52.268115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aec02-ead6-4594-93f9-3140e24ab940 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.268396 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aec02-ead6-4594-93f9-3140e24ab940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.268667 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aec02-ead6-4594-93f9-3140e24ab940 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:52.269373 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361aec02-ead6-4594-93f9-3140e24ab940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:52.271288 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361aec02-ead6-4594-93f9-3140e24ab940 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:52.289113 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1337/2686] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:52.298672 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c9f70-c0bf-4095-ae46-dfeba99a05ec None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.298988 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c9f70-c0bf-4095-ae46-dfeba99a05ec None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.303228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c9f70-c0bf-4095-ae46-dfeba99a05ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:52.319499 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bd0c9f70-c0bf-4095-ae46-dfeba99a05ec None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:52.320717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bd0c9f70-c0bf-4095-ae46-dfeba99a05ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:52.329709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1338/2687] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:52.333665 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c9f70-c0bf-4095-ae46-dfeba99a05ec None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:52.343834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c9f70-c0bf-4095-ae46-dfeba99a05ec None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:52.349072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82cb8a-dc49-4106-b2c7-dad05c1132ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:52.349717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82cb8a-dc49-4106-b2c7-dad05c1132ee admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.349995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82cb8a-dc49-4106-b2c7-dad05c1132ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.350266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82cb8a-dc49-4106-b2c7-dad05c1132ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:52.351106 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82cb8a-dc49-4106-b2c7-dad05c1132ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:49:52.351215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82cb8a-dc49-4106-b2c7-dad05c1132ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:52.352775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82cb8a-dc49-4106-b2c7-dad05c1132ee admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:52.365103 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1350/2688] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:49:52 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:52.369832 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aec02-ead6-4594-93f9-3140e24ab940 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:52.371470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1339/2689] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:49:52.375875 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82cb8a-dc49-4106-b2c7-dad05c1132ee admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:52.386154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82cb8a-dc49-4106-b2c7-dad05c1132ee admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:52.443842 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aec02-ead6-4594-93f9-3140e24ab940 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:52.449144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a6a2a-89e5-44d9-b23e-b317ebcff517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:52.449918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a6a2a-89e5-44d9-b23e-b317ebcff517 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.450197 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a6a2a-89e5-44d9-b23e-b317ebcff517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.450486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a6a2a-89e5-44d9-b23e-b317ebcff517 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:52.451127 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a6a2a-89e5-44d9-b23e-b317ebcff517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:52.453144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a6a2a-89e5-44d9-b23e-b317ebcff517 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:52.455043 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07458ae2-02bc-43a5-bfef-1c26939f84ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:52.455669 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07458ae2-02bc-43a5-bfef-1c26939f84ec admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.455953 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07458ae2-02bc-43a5-bfef-1c26939f84ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.456567 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07458ae2-02bc-43a5-bfef-1c26939f84ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:52.457134 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07458ae2-02bc-43a5-bfef-1c26939f84ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:52.461318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07458ae2-02bc-43a5-bfef-1c26939f84ec admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:52.566583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1351/2690] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:49:52 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:49:52.570436 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a6a2a-89e5-44d9-b23e-b317ebcff517 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:52.580051 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a6a2a-89e5-44d9-b23e-b317ebcff517 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:52.584585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ee6ff-9e62-4380-bbd1-b582b7bd4b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:52.585154 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ee6ff-9e62-4380-bbd1-b582b7bd4b1e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.585527 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ee6ff-9e62-4380-bbd1-b582b7bd4b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.585810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ee6ff-9e62-4380-bbd1-b582b7bd4b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:52.586430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ee6ff-9e62-4380-bbd1-b582b7bd4b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:52.588036 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ee6ff-9e62-4380-bbd1-b582b7bd4b1e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:52.597061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1340/2691] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:49:52 2022] POST /identity/v3/projects => generated 401 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:52.601333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07458ae2-02bc-43a5-bfef-1c26939f84ec admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:52.605935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1352/2692] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:49:52.607700 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ee6ff-9e62-4380-bbd1-b582b7bd4b1e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:52.617117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ee6ff-9e62-4380-bbd1-b582b7bd4b1e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:52.638170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:52.651824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:52.663606 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07458ae2-02bc-43a5-bfef-1c26939f84ec admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:52.668862 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be484b63-a2c5-41d3-82c3-b0510fecf4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:52.670959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be484b63-a2c5-41d3-82c3-b0510fecf4ba admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.670959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be484b63-a2c5-41d3-82c3-b0510fecf4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.670959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be484b63-a2c5-41d3-82c3-b0510fecf4ba admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:52.671419 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be484b63-a2c5-41d3-82c3-b0510fecf4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:52.673357 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be484b63-a2c5-41d3-82c3-b0510fecf4ba admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:52.680419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db1f2b-ba58-4034-b00d-6a4ae5b09eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:52.681247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db1f2b-ba58-4034-b00d-6a4ae5b09eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.681803 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db1f2b-ba58-4034-b00d-6a4ae5b09eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.682203 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db1f2b-ba58-4034-b00d-6a4ae5b09eaf admin admin] PATH_INFO: `/v3/projects/f8b3f115ef8b4a489b49a0b76588c685/users/d666fe4df7a94a91ae43ae547523d584/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:52.697170 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db1f2b-ba58-4034-b00d-6a4ae5b09eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b3f115ef8b4a489b49a0b76588c685, user_id=d666fe4df7a94a91ae43ae547523d584, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:52.699937 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db1f2b-ba58-4034-b00d-6a4ae5b09eaf admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:52.792376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1341/2693] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:49:52 2022] POST /identity/v3/users => generated 301 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:49:52.796845 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be484b63-a2c5-41d3-82c3-b0510fecf4ba admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:52.804307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1353/2694] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:52 2022] PUT /identity/v3/projects/f8b3f115ef8b4a489b49a0b76588c685/users/d666fe4df7a94a91ae43ae547523d584/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:52.809148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be484b63-a2c5-41d3-82c3-b0510fecf4ba admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:52.809569 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db1f2b-ba58-4034-b00d-6a4ae5b09eaf admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:52.868364 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b982e0-11a4-47f6-b9be-f76fa6c804ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:52.868971 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b982e0-11a4-47f6-b9be-f76fa6c804ac admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.869288 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b982e0-11a4-47f6-b9be-f76fa6c804ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.869561 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b982e0-11a4-47f6-b9be-f76fa6c804ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:52.870205 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b982e0-11a4-47f6-b9be-f76fa6c804ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:52.871803 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b982e0-11a4-47f6-b9be-f76fa6c804ac admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:52.873655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db1f2b-ba58-4034-b00d-6a4ae5b09eaf admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:52.878504 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50631b-c9f8-45e5-b8bb-fecf36560a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:52.879226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50631b-c9f8-45e5-b8bb-fecf36560a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.879737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50631b-c9f8-45e5-b8bb-fecf36560a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.880190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50631b-c9f8-45e5-b8bb-fecf36560a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:52.880951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50631b-c9f8-45e5-b8bb-fecf36560a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:52.882781 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50631b-c9f8-45e5-b8bb-fecf36560a8e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:52.885371 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1342/2695] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:49:52.886367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b982e0-11a4-47f6-b9be-f76fa6c804ac admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:52.897881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1354/2696] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:49:52.898085 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b982e0-11a4-47f6-b9be-f76fa6c804ac admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:52.899247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50631b-c9f8-45e5-b8bb-fecf36560a8e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:52.902262 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c990a-8163-474d-a1f1-941c71ef9ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:52.902867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c990a-8163-474d-a1f1-941c71ef9ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.903147 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c990a-8163-474d-a1f1-941c71ef9ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.903420 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c990a-8163-474d-a1f1-941c71ef9ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:52.904845 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c990a-8163-474d-a1f1-941c71ef9ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:52.906615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c990a-8163-474d-a1f1-941c71ef9ee0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:52.912124 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50631b-c9f8-45e5-b8bb-fecf36560a8e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:52.917428 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094adb6-c038-4a20-bbe6-7cf1d979acea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:52.918098 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094adb6-c038-4a20-bbe6-7cf1d979acea admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.918239 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1343/2697] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:52.918680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094adb6-c038-4a20-bbe6-7cf1d979acea admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.918680 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094adb6-c038-4a20-bbe6-7cf1d979acea admin admin] PATH_INFO: `/v3/projects/f8b3f115ef8b4a489b49a0b76588c685/users/d666fe4df7a94a91ae43ae547523d584/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:52.920851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094adb6-c038-4a20-bbe6-7cf1d979acea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b3f115ef8b4a489b49a0b76588c685, user_id=d666fe4df7a94a91ae43ae547523d584, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:52.922343 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c990a-8163-474d-a1f1-941c71ef9ee0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:52.924655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094adb6-c038-4a20-bbe6-7cf1d979acea admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:52.932349 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c990a-8163-474d-a1f1-941c71ef9ee0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:52.935818 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1355/2698] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:52 2022] PUT /identity/v3/projects/f8b3f115ef8b4a489b49a0b76588c685/users/d666fe4df7a94a91ae43ae547523d584/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:49:52.995542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e26908-a0b2-48f4-a329-6adb47121efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:52.996202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e26908-a0b2-48f4-a329-6adb47121efa admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:52.996482 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e26908-a0b2-48f4-a329-6adb47121efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:52.996781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e26908-a0b2-48f4-a329-6adb47121efa admin admin] PATH_INFO: `/v3/projects/d9a02619e81543a4a62cbffd48f32e65/users/5629c033fe3c466eae5b7f29cc41fb1c/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:53.011398 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e26908-a0b2-48f4-a329-6adb47121efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a02619e81543a4a62cbffd48f32e65, user_id=5629c033fe3c466eae5b7f29cc41fb1c, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:53.014956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e26908-a0b2-48f4-a329-6adb47121efa admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:53.104231 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1344/2699] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:52 2022] PUT /identity/v3/projects/d9a02619e81543a4a62cbffd48f32e65/users/5629c033fe3c466eae5b7f29cc41fb1c/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:53.115110 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7f0c8-b7f1-4063-bee0-bf6700ecf8f6 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:53.115657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7f0c8-b7f1-4063-bee0-bf6700ecf8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:53.115657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7f0c8-b7f1-4063-bee0-bf6700ecf8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:53.145882 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-f7b7f0c8-b7f1-4063-bee0-bf6700ecf8f6 None None] MFA Rules not processed for user `5629c033fe3c466eae5b7f29cc41fb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:53.147198 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f7b7f0c8-b7f1-4063-bee0-bf6700ecf8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:53.217644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1356/2700] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:53 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:53.222570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e26908-a0b2-48f4-a329-6adb47121efa admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:53.288428 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:53.305295 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e26908-a0b2-48f4-a329-6adb47121efa admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:53.312341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d7ef0-8937-4132-b259-b34af279261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:53.313303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d7ef0-8937-4132-b259-b34af279261f admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:53.313545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d7ef0-8937-4132-b259-b34af279261f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:53.313827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d7ef0-8937-4132-b259-b34af279261f admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:53.314480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d7ef0-8937-4132-b259-b34af279261f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:53.316549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d7ef0-8937-4132-b259-b34af279261f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:53.427044 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1345/2701] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:49:53 2022] POST /identity/v3/projects => generated 399 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:53.431001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7f0c8-b7f1-4063-bee0-bf6700ecf8f6 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:53.443552 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7f0c8-b7f1-4063-bee0-bf6700ecf8f6 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:53.464279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:53.537164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f323d94-a303-4a74-a5f7-e1c1293627de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:53.537923 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f323d94-a303-4a74-a5f7-e1c1293627de admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:53.538270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f323d94-a303-4a74-a5f7-e1c1293627de admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:53.539041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f323d94-a303-4a74-a5f7-e1c1293627de admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:53.539188 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f323d94-a303-4a74-a5f7-e1c1293627de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:53.541324 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f323d94-a303-4a74-a5f7-e1c1293627de admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:53.664210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1357/2702] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:49:53 2022] POST /identity/v3/users => generated 306 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:49:53.668633 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d7ef0-8937-4132-b259-b34af279261f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:53.680811 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d7ef0-8937-4132-b259-b34af279261f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:53.687947 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd6d31-028f-4dcd-8218-102bb1ea44bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:53.689243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6d31-028f-4dcd-8218-102bb1ea44bc admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:53.689243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6d31-028f-4dcd-8218-102bb1ea44bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:53.689243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6d31-028f-4dcd-8218-102bb1ea44bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:53.689761 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd6d31-028f-4dcd-8218-102bb1ea44bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:53.691339 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd6d31-028f-4dcd-8218-102bb1ea44bc admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:53.703058 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1346/2703] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:49:53.707008 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f323d94-a303-4a74-a5f7-e1c1293627de admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:53.718966 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f323d94-a303-4a74-a5f7-e1c1293627de admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:53.722825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9a4c5-c331-4340-9e3c-7818857b7c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:53.723560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a4c5-c331-4340-9e3c-7818857b7c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:53.723904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a4c5-c331-4340-9e3c-7818857b7c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:53.724301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a4c5-c331-4340-9e3c-7818857b7c9f admin admin] PATH_INFO: `/v3/projects/d3d25061fdc04635be52cc040aeff574/users/aec5554c13cb452ebcf1073b3d8db215/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:53.742182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9a4c5-c331-4340-9e3c-7818857b7c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d25061fdc04635be52cc040aeff574, user_id=aec5554c13cb452ebcf1073b3d8db215, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:53.744906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9a4c5-c331-4340-9e3c-7818857b7c9f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:53.832471 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1358/2704] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:53 2022] PUT /identity/v3/projects/d3d25061fdc04635be52cc040aeff574/users/aec5554c13cb452ebcf1073b3d8db215/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:49:53.836139 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd6d31-028f-4dcd-8218-102bb1ea44bc admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:53.852348 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd6d31-028f-4dcd-8218-102bb1ea44bc admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:53.924220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992b335-6a3b-4f34-9b4a-6a7d2417d9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:53.925091 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992b335-6a3b-4f34-9b4a-6a7d2417d9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:53.926415 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992b335-6a3b-4f34-9b4a-6a7d2417d9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:53.927121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992b335-6a3b-4f34-9b4a-6a7d2417d9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:53.927845 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992b335-6a3b-4f34-9b4a-6a7d2417d9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:53.929766 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992b335-6a3b-4f34-9b4a-6a7d2417d9f8 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:53.941315 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1347/2705] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:49:53.944813 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9a4c5-c331-4340-9e3c-7818857b7c9f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:53.957095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9a4c5-c331-4340-9e3c-7818857b7c9f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:53.963335 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7196821-e1dd-4f90-901c-e56748050d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:53.964139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7196821-e1dd-4f90-901c-e56748050d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:53.964484 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7196821-e1dd-4f90-901c-e56748050d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:53.964883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7196821-e1dd-4f90-901c-e56748050d19 admin admin] PATH_INFO: `/v3/projects/d3d25061fdc04635be52cc040aeff574/users/aec5554c13cb452ebcf1073b3d8db215/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:53.968695 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7196821-e1dd-4f90-901c-e56748050d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d25061fdc04635be52cc040aeff574, user_id=aec5554c13cb452ebcf1073b3d8db215, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:53.971692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7196821-e1dd-4f90-901c-e56748050d19 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:53.982821 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1359/2706] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:49:53 2022] PUT /identity/v3/projects/d3d25061fdc04635be52cc040aeff574/users/aec5554c13cb452ebcf1073b3d8db215/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:49:53.994256 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5220e-3741-417e-980d-1716d045a99d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:53.994630 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5220e-3741-417e-980d-1716d045a99d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:53.994969 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5220e-3741-417e-980d-1716d045a99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:54.034019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7ab5220e-3741-417e-980d-1716d045a99d None None] MFA Rules not processed for user `aec5554c13cb452ebcf1073b3d8db215`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:54.035350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7ab5220e-3741-417e-980d-1716d045a99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:54.124505 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1348/2707] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:54.135428 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7196821-e1dd-4f90-901c-e56748050d19 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:54.137374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f7196821-e1dd-4f90-901c-e56748050d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:54.197922 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7196821-e1dd-4f90-901c-e56748050d19 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:54.202130 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7623-b19d-4e7f-96cb-0e9d8ffa5c85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:54.203371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7623-b19d-4e7f-96cb-0e9d8ffa5c85 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:54.203851 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7623-b19d-4e7f-96cb-0e9d8ffa5c85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:54.204649 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7623-b19d-4e7f-96cb-0e9d8ffa5c85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:54.216697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a7623-b19d-4e7f-96cb-0e9d8ffa5c85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:54.218386 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a7623-b19d-4e7f-96cb-0e9d8ffa5c85 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:54.228744 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1360/2708] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:54.481066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5220e-3741-417e-980d-1716d045a99d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:54.495516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5220e-3741-417e-980d-1716d045a99d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:54.503532 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91ed58-809e-464c-914b-77c8050ee8a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:54.505440 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91ed58-809e-464c-914b-77c8050ee8a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:54.506162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91ed58-809e-464c-914b-77c8050ee8a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:54.506877 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91ed58-809e-464c-914b-77c8050ee8a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:54.561034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:54.578433 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91ed58-809e-464c-914b-77c8050ee8a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:54.580733 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91ed58-809e-464c-914b-77c8050ee8a5 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:54.594394 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1349/2709] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:54 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:58.891227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32c64e-c2dc-4ef2-a64c-86e87d9041d9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:58.891731 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32c64e-c2dc-4ef2-a64c-86e87d9041d9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:58.896041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32c64e-c2dc-4ef2-a64c-86e87d9041d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:58.923814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6b32c64e-c2dc-4ef2-a64c-86e87d9041d9 None None] MFA Rules not processed for user `d666fe4df7a94a91ae43ae547523d584`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:58.925129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6b32c64e-c2dc-4ef2-a64c-86e87d9041d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:59.000045 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:49:59.004055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1361/2710] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:49:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:59.016926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91ed58-809e-464c-914b-77c8050ee8a5 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:59.018577 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-9a91ed58-809e-464c-914b-77c8050ee8a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:59.082073 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91ed58-809e-464c-914b-77c8050ee8a5 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:59.085951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ad0f8-e6d8-400a-88ff-4247fbf0f92a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c526760ad8a04bf486d1e7e74e9ffbe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:59.086571 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ad0f8-e6d8-400a-88ff-4247fbf0f92a service glance] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:59.086850 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ad0f8-e6d8-400a-88ff-4247fbf0f92a service glance] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:59.087160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ad0f8-e6d8-400a-88ff-4247fbf0f92a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:59.149024 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ad0f8-e6d8-400a-88ff-4247fbf0f92a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:59.150512 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ad0f8-e6d8-400a-88ff-4247fbf0f92a service glance] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:59.161018 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1350/2711] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:49:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:49:59.440489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f687bf-fe67-4815-9fa8-d0fcfd4967be None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:59.440489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f687bf-fe67-4815-9fa8-d0fcfd4967be None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:59.440489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f687bf-fe67-4815-9fa8-d0fcfd4967be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:59.458645 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-78f687bf-fe67-4815-9fa8-d0fcfd4967be None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:49:59.459852 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-78f687bf-fe67-4815-9fa8-d0fcfd4967be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:59.516908 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1362/2712] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:49:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:49:59.530119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ad0f8-e6d8-400a-88ff-4247fbf0f92a service glance] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:59.531589 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-800ad0f8-e6d8-400a-88ff-4247fbf0f92a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:49:59.606198 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ad0f8-e6d8-400a-88ff-4247fbf0f92a service glance] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:49:59.612274 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d7037-26f9-4c02-9ceb-cf74a238843f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:49:59.612972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d7037-26f9-4c02-9ceb-cf74a238843f service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:49:59.613279 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d7037-26f9-4c02-9ceb-cf74a238843f service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:49:59.613549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d7037-26f9-4c02-9ceb-cf74a238843f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:49:59.622047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d7037-26f9-4c02-9ceb-cf74a238843f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:49:59.624504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d7037-26f9-4c02-9ceb-cf74a238843f service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:49:59.633093 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1351/2713] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:49:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 04:49:59.865612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f687bf-fe67-4815-9fa8-d0fcfd4967be None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:49:59.994013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f687bf-fe67-4815-9fa8-d0fcfd4967be None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:00.004811 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb123a-b93e-4f9f-9c58-e6af74868a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:00.005589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb123a-b93e-4f9f-9c58-e6af74868a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:00.005938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb123a-b93e-4f9f-9c58-e6af74868a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:00.006302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb123a-b93e-4f9f-9c58-e6af74868a2c admin admin] PATH_INFO: `/v3/users/5629c033fe3c466eae5b7f29cc41fb1c` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:00.007720 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb123a-b93e-4f9f-9c58-e6af74868a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5629c033fe3c466eae5b7f29cc41fb1c)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:00.009889 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb123a-b93e-4f9f-9c58-e6af74868a2c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:00.274226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1feb123a-b93e-4f9f-9c58-e6af74868a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5629c033fe3c466eae5b7f29cc41fb1c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:00.289438 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1feb123a-b93e-4f9f-9c58-e6af74868a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5629c033fe3c466eae5b7f29cc41fb1c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:00.358163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1feb123a-b93e-4f9f-9c58-e6af74868a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5629c033fe3c466eae5b7f29cc41fb1c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:00.374663 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1feb123a-b93e-4f9f-9c58-e6af74868a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5629c033fe3c466eae5b7f29cc41fb1c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:00.375918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-1feb123a-b93e-4f9f-9c58-e6af74868a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5629c033fe3c466eae5b7f29cc41fb1c'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:00.391305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1363/2714] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:49:59 2022] DELETE /identity/v3/users/5629c033fe3c466eae5b7f29cc41fb1c => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:00.396047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcf4bb-8465-4e49-858f-26dc215c1f7d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:00.396900 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcf4bb-8465-4e49-858f-26dc215c1f7d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:00.397417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcf4bb-8465-4e49-858f-26dc215c1f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:00.423179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-65dcf4bb-8465-4e49-858f-26dc215c1f7d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:00.425504 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-65dcf4bb-8465-4e49-858f-26dc215c1f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:00.467296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=100 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:00.530772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1352/2715] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:00.540072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb123a-b93e-4f9f-9c58-e6af74868a2c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:00.542095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1feb123a-b93e-4f9f-9c58-e6af74868a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:00.601342 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:00.648471 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb123a-b93e-4f9f-9c58-e6af74868a2c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:00.657109 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dc01d-032b-4ef7-b50f-5c043903bbd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:00.657830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc01d-032b-4ef7-b50f-5c043903bbd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:00.658169 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc01d-032b-4ef7-b50f-5c043903bbd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:00.658520 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc01d-032b-4ef7-b50f-5c043903bbd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:00.671291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50dc01d-032b-4ef7-b50f-5c043903bbd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:00.673225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50dc01d-032b-4ef7-b50f-5c043903bbd3 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:00.684255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1364/2716] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:50:01.156237 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcf4bb-8465-4e49-858f-26dc215c1f7d None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:01.157800 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-65dcf4bb-8465-4e49-858f-26dc215c1f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:01.204134 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcf4bb-8465-4e49-858f-26dc215c1f7d None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:01.218273 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:01.219351 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:01.219771 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:01.220121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] PATH_INFO: `/v3/projects/d9a02619e81543a4a62cbffd48f32e65` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:01.222531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a02619e81543a4a62cbffd48f32e65)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:01.224687 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:01.336729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a02619e81543a4a62cbffd48f32e65', 'request_id': 'req-2f90bdcb-e8eb-4883-9304-b81fad133990'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:01.431618 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a02619e81543a4a62cbffd48f32e65', 'request_id': 'req-2f90bdcb-e8eb-4883-9304-b81fad133990'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:01.439300 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a02619e81543a4a62cbffd48f32e65', 'request_id': 'req-2f90bdcb-e8eb-4883-9304-b81fad133990'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:01.470332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] The token cache is being invalidate because project d9a02619e81543a4a62cbffd48f32e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:50:01.471725 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:01.472603 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:01.474290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1353/2717] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:50:01 2022] DELETE /identity/v3/projects/d9a02619e81543a4a62cbffd48f32e65 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:01.478276 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dc01d-032b-4ef7-b50f-5c043903bbd3 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:01.491982 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dc01d-032b-4ef7-b50f-5c043903bbd3 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:01.594769 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b736331-6c00-4e49-8ce6-1a55f7938103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:01.595725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b736331-6c00-4e49-8ce6-1a55f7938103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:01.596426 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b736331-6c00-4e49-8ce6-1a55f7938103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:01.596909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b736331-6c00-4e49-8ce6-1a55f7938103 admin admin] PATH_INFO: `/v3/users/aec5554c13cb452ebcf1073b3d8db215` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:01.598271 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b736331-6c00-4e49-8ce6-1a55f7938103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec5554c13cb452ebcf1073b3d8db215)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:01.600435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b736331-6c00-4e49-8ce6-1a55f7938103 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:01.774181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7b736331-6c00-4e49-8ce6-1a55f7938103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec5554c13cb452ebcf1073b3d8db215'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:01.809111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7b736331-6c00-4e49-8ce6-1a55f7938103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec5554c13cb452ebcf1073b3d8db215'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:01.901840 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7b736331-6c00-4e49-8ce6-1a55f7938103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec5554c13cb452ebcf1073b3d8db215'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:01.913723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7b736331-6c00-4e49-8ce6-1a55f7938103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec5554c13cb452ebcf1073b3d8db215'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:01.914472 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7b736331-6c00-4e49-8ce6-1a55f7938103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec5554c13cb452ebcf1073b3d8db215'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:01.943490 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1365/2718] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:50:01 2022] DELETE /identity/v3/users/aec5554c13cb452ebcf1073b3d8db215 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:02.531763 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:02.538342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:02.552156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90bdcb-e8eb-4883-9304-b81fad133990 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:02.641395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796b735-7fff-414f-b5f0-745e050bf12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:02.642154 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796b735-7fff-414f-b5f0-745e050bf12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:02.642708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796b735-7fff-414f-b5f0-745e050bf12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:02.643153 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796b735-7fff-414f-b5f0-745e050bf12c admin admin] PATH_INFO: `/v3/projects/d3d25061fdc04635be52cc040aeff574` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:02.644569 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796b735-7fff-414f-b5f0-745e050bf12c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d25061fdc04635be52cc040aeff574)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:02.646871 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796b735-7fff-414f-b5f0-745e050bf12c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:02.770628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c796b735-7fff-414f-b5f0-745e050bf12c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d25061fdc04635be52cc040aeff574', 'request_id': 'req-c796b735-7fff-414f-b5f0-745e050bf12c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:02.774115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:03.134472 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c796b735-7fff-414f-b5f0-745e050bf12c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d25061fdc04635be52cc040aeff574', 'request_id': 'req-c796b735-7fff-414f-b5f0-745e050bf12c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:03.141138 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c796b735-7fff-414f-b5f0-745e050bf12c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d25061fdc04635be52cc040aeff574', 'request_id': 'req-c796b735-7fff-414f-b5f0-745e050bf12c'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:03.152327 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c796b735-7fff-414f-b5f0-745e050bf12c admin admin] The token cache is being invalidate because project d3d25061fdc04635be52cc040aeff574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:50:03.152615 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c796b735-7fff-414f-b5f0-745e050bf12c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:03.153831 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c796b735-7fff-414f-b5f0-745e050bf12c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:03.155916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1354/2719] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:50:02 2022] DELETE /identity/v3/projects/d3d25061fdc04635be52cc040aeff574 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:03.160917 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4d260-1627-4a0f-876d-0c1583690d4b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:03.161555 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4d260-1627-4a0f-876d-0c1583690d4b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:03.161555 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4d260-1627-4a0f-876d-0c1583690d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:03.185430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-92a4d260-1627-4a0f-876d-0c1583690d4b None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:03.185430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-92a4d260-1627-4a0f-876d-0c1583690d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:03.228913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:03.251576 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1366/2720] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:03.262833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5fdea-16bf-4a98-828f-df73ba268bfb None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:03.263202 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5fdea-16bf-4a98-828f-df73ba268bfb None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:03.263697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5fdea-16bf-4a98-828f-df73ba268bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:03.285718 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ffc5fdea-16bf-4a98-828f-df73ba268bfb None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:03.287119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ffc5fdea-16bf-4a98-828f-df73ba268bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:03.296624 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1355/2721] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:03.300771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4d260-1627-4a0f-876d-0c1583690d4b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:03.311517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4d260-1627-4a0f-876d-0c1583690d4b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:03.317580 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4d88c-9a4d-46bc-95ba-6f41d38cdd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:03.318282 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4d88c-9a4d-46bc-95ba-6f41d38cdd86 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:03.318633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4d88c-9a4d-46bc-95ba-6f41d38cdd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:03.318905 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4d88c-9a4d-46bc-95ba-6f41d38cdd86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:03.319560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4d88c-9a4d-46bc-95ba-6f41d38cdd86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:50:03.319868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4d88c-9a4d-46bc-95ba-6f41d38cdd86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:03.321502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4d88c-9a4d-46bc-95ba-6f41d38cdd86 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:03.335193 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1367/2722] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:50:03.340061 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5fdea-16bf-4a98-828f-df73ba268bfb None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:03.350181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5fdea-16bf-4a98-828f-df73ba268bfb None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:03.359085 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eefb2c-bd70-4b69-a08b-031ad051ebbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:03.359824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eefb2c-bd70-4b69-a08b-031ad051ebbd admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:03.360207 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eefb2c-bd70-4b69-a08b-031ad051ebbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:03.360580 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eefb2c-bd70-4b69-a08b-031ad051ebbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:03.361644 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eefb2c-bd70-4b69-a08b-031ad051ebbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:03.367646 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eefb2c-bd70-4b69-a08b-031ad051ebbd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:03.462192 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1356/2723] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:50:03 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:50:03.462904 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4d88c-9a4d-46bc-95ba-6f41d38cdd86 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:03.477478 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4d88c-9a4d-46bc-95ba-6f41d38cdd86 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:03.568251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30507329-f0f4-4fb6-9071-5bada69502b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:03.568251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30507329-f0f4-4fb6-9071-5bada69502b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:03.570671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30507329-f0f4-4fb6-9071-5bada69502b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:03.571139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30507329-f0f4-4fb6-9071-5bada69502b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:03.571890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30507329-f0f4-4fb6-9071-5bada69502b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:03.573920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30507329-f0f4-4fb6-9071-5bada69502b3 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:03.667468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1368/2724] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:50:03 2022] POST /identity/v3/users => generated 284 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:50:03.672185 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eefb2c-bd70-4b69-a08b-031ad051ebbd admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:03.684019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eefb2c-bd70-4b69-a08b-031ad051ebbd admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:03.689746 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a069645-123b-4bad-ba93-21248101e28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:03.690554 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a069645-123b-4bad-ba93-21248101e28c admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:03.691010 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a069645-123b-4bad-ba93-21248101e28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:03.691491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a069645-123b-4bad-ba93-21248101e28c admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:03.692292 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a069645-123b-4bad-ba93-21248101e28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:03.694776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a069645-123b-4bad-ba93-21248101e28c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:03.706750 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1357/2725] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:50:03.711024 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30507329-f0f4-4fb6-9071-5bada69502b3 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:03.724195 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30507329-f0f4-4fb6-9071-5bada69502b3 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:03.729268 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591f74b-84aa-49c5-8831-188e34b3d35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:03.729981 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591f74b-84aa-49c5-8831-188e34b3d35e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:03.730385 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591f74b-84aa-49c5-8831-188e34b3d35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:03.730765 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591f74b-84aa-49c5-8831-188e34b3d35e admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:03.731610 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591f74b-84aa-49c5-8831-188e34b3d35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:03.733450 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591f74b-84aa-49c5-8831-188e34b3d35e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:03.746485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1369/2726] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:50:03.751395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a069645-123b-4bad-ba93-21248101e28c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:03.763862 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a069645-123b-4bad-ba93-21248101e28c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:03.770825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc72b06-da7d-416e-8b84-a35cbe21da80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:03.771497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc72b06-da7d-416e-8b84-a35cbe21da80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:03.771776 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc72b06-da7d-416e-8b84-a35cbe21da80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:03.772047 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc72b06-da7d-416e-8b84-a35cbe21da80 admin admin] PATH_INFO: `/v3/projects/9408843cfa744ff49c63edde8d789a18/users/e5f7b96e82f045689c2a2dfacd341e64/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:03.793558 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc72b06-da7d-416e-8b84-a35cbe21da80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9408843cfa744ff49c63edde8d789a18, user_id=e5f7b96e82f045689c2a2dfacd341e64, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:03.796918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc72b06-da7d-416e-8b84-a35cbe21da80 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:03.881411 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1358/2727] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:50:03 2022] PUT /identity/v3/projects/9408843cfa744ff49c63edde8d789a18/users/e5f7b96e82f045689c2a2dfacd341e64/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:03.896794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9fb34-f712-42d6-beb4-a28201e09ddd None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:03.897522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9fb34-f712-42d6-beb4-a28201e09ddd None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:03.898204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9fb34-f712-42d6-beb4-a28201e09ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:03.932911 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2ca9fb34-f712-42d6-beb4-a28201e09ddd None None] MFA Rules not processed for user `e5f7b96e82f045689c2a2dfacd341e64`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:03.934457 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2ca9fb34-f712-42d6-beb4-a28201e09ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:04.011370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1370/2728] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:04.017451 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc72b06-da7d-416e-8b84-a35cbe21da80 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:04.096738 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc72b06-da7d-416e-8b84-a35cbe21da80 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:04.103167 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a6435-f7d5-4519-a760-631030de8d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:04.103919 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6435-f7d5-4519-a760-631030de8d86 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:04.104294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6435-f7d5-4519-a760-631030de8d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:04.104656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6435-f7d5-4519-a760-631030de8d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:04.105587 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a6435-f7d5-4519-a760-631030de8d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:04.108591 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a6435-f7d5-4519-a760-631030de8d86 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:04.203607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1359/2729] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:50:04 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:50:04.207451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9fb34-f712-42d6-beb4-a28201e09ddd None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:04.221696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9fb34-f712-42d6-beb4-a28201e09ddd None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:04.271607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:04.302797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973017a8-05f5-4bd6-8778-75e2178d8f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:04.303737 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973017a8-05f5-4bd6-8778-75e2178d8f51 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:04.304452 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973017a8-05f5-4bd6-8778-75e2178d8f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:04.305172 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973017a8-05f5-4bd6-8778-75e2178d8f51 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:04.306156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973017a8-05f5-4bd6-8778-75e2178d8f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:04.308667 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973017a8-05f5-4bd6-8778-75e2178d8f51 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:04.375400 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1371/2730] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:50:04 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:50:04.379516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a6435-f7d5-4519-a760-631030de8d86 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:04.393815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a6435-f7d5-4519-a760-631030de8d86 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:04.399191 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5bb57-b0ee-4ddf-a0dd-119608a244b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:04.399912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5bb57-b0ee-4ddf-a0dd-119608a244b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:04.400261 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5bb57-b0ee-4ddf-a0dd-119608a244b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:04.400623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5bb57-b0ee-4ddf-a0dd-119608a244b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:04.401471 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5bb57-b0ee-4ddf-a0dd-119608a244b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:04.403709 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5bb57-b0ee-4ddf-a0dd-119608a244b9 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:04.420122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1360/2731] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:50:04.421301 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973017a8-05f5-4bd6-8778-75e2178d8f51 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:04.431648 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973017a8-05f5-4bd6-8778-75e2178d8f51 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:04.436579 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b6776-ecf3-43a8-a131-ea098c794b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:04.437369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b6776-ecf3-43a8-a131-ea098c794b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:04.437660 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b6776-ecf3-43a8-a131-ea098c794b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:04.437916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b6776-ecf3-43a8-a131-ea098c794b36 admin admin] PATH_INFO: `/v3/projects/d5552984e0fe4c61862469a55a11c0c4/users/44b9dc8220df42dbb47a914d644b8d92/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:04.457582 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b6776-ecf3-43a8-a131-ea098c794b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5552984e0fe4c61862469a55a11c0c4, user_id=44b9dc8220df42dbb47a914d644b8d92, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:04.460255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b6776-ecf3-43a8-a131-ea098c794b36 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:04.556307 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1372/2732] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:50:04 2022] PUT /identity/v3/projects/d5552984e0fe4c61862469a55a11c0c4/users/44b9dc8220df42dbb47a914d644b8d92/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:04.561793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5bb57-b0ee-4ddf-a0dd-119608a244b9 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:04.572940 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5bb57-b0ee-4ddf-a0dd-119608a244b9 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:04.637822 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:04.651208 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5439a-b861-4bdb-add1-2d94d59dac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:04.652224 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5439a-b861-4bdb-add1-2d94d59dac3f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:04.652666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5439a-b861-4bdb-add1-2d94d59dac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:04.653819 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5439a-b861-4bdb-add1-2d94d59dac3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:04.654476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5439a-b861-4bdb-add1-2d94d59dac3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:04.656060 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5439a-b861-4bdb-add1-2d94d59dac3f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:04.671056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1361/2733] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:50:04.674895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b6776-ecf3-43a8-a131-ea098c794b36 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:04.686607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b6776-ecf3-43a8-a131-ea098c794b36 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:04.694565 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d2034-0ecf-4485-b22a-94c8aa998880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:04.695314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d2034-0ecf-4485-b22a-94c8aa998880 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:04.695658 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d2034-0ecf-4485-b22a-94c8aa998880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:04.695998 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d2034-0ecf-4485-b22a-94c8aa998880 admin admin] PATH_INFO: `/v3/projects/d5552984e0fe4c61862469a55a11c0c4/users/44b9dc8220df42dbb47a914d644b8d92/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:04.700046 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d2034-0ecf-4485-b22a-94c8aa998880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5552984e0fe4c61862469a55a11c0c4, user_id=44b9dc8220df42dbb47a914d644b8d92, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:04.703634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d2034-0ecf-4485-b22a-94c8aa998880 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:04.718164 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1373/2734] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:50:04 2022] PUT /identity/v3/projects/d5552984e0fe4c61862469a55a11c0c4/users/44b9dc8220df42dbb47a914d644b8d92/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:50:04.730926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce482f-18f5-44e2-9297-6ebd8982de8b None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:04.732021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce482f-18f5-44e2-9297-6ebd8982de8b None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:04.733181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce482f-18f5-44e2-9297-6ebd8982de8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:04.770629 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c4ce482f-18f5-44e2-9297-6ebd8982de8b None None] MFA Rules not processed for user `44b9dc8220df42dbb47a914d644b8d92`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:04.771919 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c4ce482f-18f5-44e2-9297-6ebd8982de8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:04.850434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1362/2735] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:04.863165 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d2034-0ecf-4485-b22a-94c8aa998880 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:04.865367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-739d2034-0ecf-4485-b22a-94c8aa998880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:04.939551 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d2034-0ecf-4485-b22a-94c8aa998880 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:04.943798 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1b69a-f2c8-4be6-901d-519911efaf7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:04.944480 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1b69a-f2c8-4be6-901d-519911efaf7d service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:04.944831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1b69a-f2c8-4be6-901d-519911efaf7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:04.945171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1b69a-f2c8-4be6-901d-519911efaf7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:04.958817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1b69a-f2c8-4be6-901d-519911efaf7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:04.960371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1b69a-f2c8-4be6-901d-519911efaf7d service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:04.973313 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1374/2736] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:50:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:50:05.226079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce482f-18f5-44e2-9297-6ebd8982de8b None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:05.238018 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce482f-18f5-44e2-9297-6ebd8982de8b None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:05.242156 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19966fd-0a0d-4396-8fdd-ce59c1d2c463 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:05.243093 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19966fd-0a0d-4396-8fdd-ce59c1d2c463 service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:05.243438 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19966fd-0a0d-4396-8fdd-ce59c1d2c463 service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:05.243780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19966fd-0a0d-4396-8fdd-ce59c1d2c463 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:05.313321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19966fd-0a0d-4396-8fdd-ce59c1d2c463 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:05.314852 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19966fd-0a0d-4396-8fdd-ce59c1d2c463 service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:05.326414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1363/2737] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:50:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:50:10.905121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73a081-82b2-4d2e-aff8-d6d0a0b29d21 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:10.905668 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73a081-82b2-4d2e-aff8-d6d0a0b29d21 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:10.905775 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73a081-82b2-4d2e-aff8-d6d0a0b29d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:10.925925 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2c73a081-82b2-4d2e-aff8-d6d0a0b29d21 None None] MFA Rules not processed for user `0e695aaa93844e6f9bca100564d38e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:10.927180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2c73a081-82b2-4d2e-aff8-d6d0a0b29d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:10.988994 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1375/2738] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:13.181367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19966fd-0a0d-4396-8fdd-ce59c1d2c463 service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:13.243496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19966fd-0a0d-4396-8fdd-ce59c1d2c463 service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:13.249773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2a35a-8699-4911-9ac4-512e62c49b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:13.250403 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2a35a-8699-4911-9ac4-512e62c49b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:13.250675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2a35a-8699-4911-9ac4-512e62c49b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:13.250942 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2a35a-8699-4911-9ac4-512e62c49b42 admin admin] PATH_INFO: `/v3/users/e5f7b96e82f045689c2a2dfacd341e64` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:13.252067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2a35a-8699-4911-9ac4-512e62c49b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f7b96e82f045689c2a2dfacd341e64)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:13.254021 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2a35a-8699-4911-9ac4-512e62c49b42 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:13.268395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:13.444987 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c6f2a35a-8699-4911-9ac4-512e62c49b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f7b96e82f045689c2a2dfacd341e64'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:13.445678 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c6f2a35a-8699-4911-9ac4-512e62c49b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f7b96e82f045689c2a2dfacd341e64'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:13.458110 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c6f2a35a-8699-4911-9ac4-512e62c49b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f7b96e82f045689c2a2dfacd341e64'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:13.464848 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c6f2a35a-8699-4911-9ac4-512e62c49b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f7b96e82f045689c2a2dfacd341e64'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:13.469058 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c6f2a35a-8699-4911-9ac4-512e62c49b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f7b96e82f045689c2a2dfacd341e64'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:13.583076 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1364/2739] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:50:13 2022] DELETE /identity/v3/users/e5f7b96e82f045689c2a2dfacd341e64 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:13.587548 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab40ce4-c2a0-41e8-a1e1-e39c40b2ed69 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:13.588029 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab40ce4-c2a0-41e8-a1e1-e39c40b2ed69 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:13.588141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab40ce4-c2a0-41e8-a1e1-e39c40b2ed69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:13.607546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fab40ce4-c2a0-41e8-a1e1-e39c40b2ed69 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:13.608758 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fab40ce4-c2a0-41e8-a1e1-e39c40b2ed69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:13.651286 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:13.671635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1376/2740] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:13.681686 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2a35a-8699-4911-9ac4-512e62c49b42 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:13.683094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c6f2a35a-8699-4911-9ac4-512e62c49b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:13.742828 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2a35a-8699-4911-9ac4-512e62c49b42 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:13.746389 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ad960-2c89-4fe5-9d1b-8e4167b52479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:13.747045 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ad960-2c89-4fe5-9d1b-8e4167b52479 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:13.747899 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ad960-2c89-4fe5-9d1b-8e4167b52479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:13.748183 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ad960-2c89-4fe5-9d1b-8e4167b52479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:13.757149 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ad960-2c89-4fe5-9d1b-8e4167b52479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:13.758696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ad960-2c89-4fe5-9d1b-8e4167b52479 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:13.768796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1365/2741] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:50:14.232606 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab40ce4-c2a0-41e8-a1e1-e39c40b2ed69 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:14.235187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fab40ce4-c2a0-41e8-a1e1-e39c40b2ed69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:14.246080 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab40ce4-c2a0-41e8-a1e1-e39c40b2ed69 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:14.251544 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:14.252404 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:14.258184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:14.258184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] PATH_INFO: `/v3/projects/9408843cfa744ff49c63edde8d789a18` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:14.262746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9408843cfa744ff49c63edde8d789a18)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:14.265942 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:14.414037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9408843cfa744ff49c63edde8d789a18', 'request_id': 'req-49b17caa-e111-472d-88db-49eea65c3604'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:14.437980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d79d0d-d0fc-4600-b051-8d0786950b25 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:14.437980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d79d0d-d0fc-4600-b051-8d0786950b25 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:14.438524 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d79d0d-d0fc-4600-b051-8d0786950b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:14.459533 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-c4d79d0d-d0fc-4600-b051-8d0786950b25 None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:14.460865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c4d79d0d-d0fc-4600-b051-8d0786950b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:14.483224 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9408843cfa744ff49c63edde8d789a18', 'request_id': 'req-49b17caa-e111-472d-88db-49eea65c3604'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:14.491306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9408843cfa744ff49c63edde8d789a18', 'request_id': 'req-49b17caa-e111-472d-88db-49eea65c3604'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:14.512957 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] The token cache is being invalidate because project 9408843cfa744ff49c63edde8d789a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:50:14.513803 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:14.515980 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:14.521809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1377/2742] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:50:14 2022] DELETE /identity/v3/projects/9408843cfa744ff49c63edde8d789a18 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:14.523478 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:14.526986 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:14.535625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1366/2743] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:50:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:50:14.551616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d79d0d-d0fc-4600-b051-8d0786950b25 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:14.553900 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c4d79d0d-d0fc-4600-b051-8d0786950b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:14.620695 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:14.644442 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b17caa-e111-472d-88db-49eea65c3604 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:14.649181 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06e09b-1bfe-4a4f-945a-28055363e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:14.649828 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06e09b-1bfe-4a4f-945a-28055363e56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:14.650100 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06e09b-1bfe-4a4f-945a-28055363e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:14.650368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06e09b-1bfe-4a4f-945a-28055363e56e admin admin] PATH_INFO: `/v3/users/44b9dc8220df42dbb47a914d644b8d92` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:14.651486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06e09b-1bfe-4a4f-945a-28055363e56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b9dc8220df42dbb47a914d644b8d92)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:14.652500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d79d0d-d0fc-4600-b051-8d0786950b25 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:14.654428 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06e09b-1bfe-4a4f-945a-28055363e56e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:14.658043 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022e0db-9962-490d-a383-84d1e8cace17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:14.658679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022e0db-9962-490d-a383-84d1e8cace17 service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:14.658958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022e0db-9962-490d-a383-84d1e8cace17 service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:14.659250 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022e0db-9962-490d-a383-84d1e8cace17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:14.669633 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022e0db-9962-490d-a383-84d1e8cace17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:14.671665 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022e0db-9962-490d-a383-84d1e8cace17 service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:14.680716 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1367/2744] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:50:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:50:14.906136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ff06e09b-1bfe-4a4f-945a-28055363e56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b9dc8220df42dbb47a914d644b8d92'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:14.958143 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ff06e09b-1bfe-4a4f-945a-28055363e56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b9dc8220df42dbb47a914d644b8d92'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:14.964789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:15.054160 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ff06e09b-1bfe-4a4f-945a-28055363e56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b9dc8220df42dbb47a914d644b8d92'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:15.074243 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ff06e09b-1bfe-4a4f-945a-28055363e56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b9dc8220df42dbb47a914d644b8d92'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:15.077605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-ff06e09b-1bfe-4a4f-945a-28055363e56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b9dc8220df42dbb47a914d644b8d92'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:15.099129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1378/2745] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:50:14 2022] DELETE /identity/v3/users/44b9dc8220df42dbb47a914d644b8d92 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:15.751728 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022e0db-9962-490d-a383-84d1e8cace17 service swift] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:15.768437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022e0db-9962-490d-a383-84d1e8cace17 service swift] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:15.866126 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f1c58-46c9-4528-a840-162f0504a03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:15.867736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f1c58-46c9-4528-a840-162f0504a03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:15.868242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f1c58-46c9-4528-a840-162f0504a03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:15.868788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f1c58-46c9-4528-a840-162f0504a03b admin admin] PATH_INFO: `/v3/projects/d5552984e0fe4c61862469a55a11c0c4` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:15.870988 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f1c58-46c9-4528-a840-162f0504a03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5552984e0fe4c61862469a55a11c0c4)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:15.874938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f1c58-46c9-4528-a840-162f0504a03b admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:16.025084 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-774f1c58-46c9-4528-a840-162f0504a03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5552984e0fe4c61862469a55a11c0c4', 'request_id': 'req-774f1c58-46c9-4528-a840-162f0504a03b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:16.114480 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-774f1c58-46c9-4528-a840-162f0504a03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5552984e0fe4c61862469a55a11c0c4', 'request_id': 'req-774f1c58-46c9-4528-a840-162f0504a03b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:16.123456 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-774f1c58-46c9-4528-a840-162f0504a03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5552984e0fe4c61862469a55a11c0c4', 'request_id': 'req-774f1c58-46c9-4528-a840-162f0504a03b'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:16.138374 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-774f1c58-46c9-4528-a840-162f0504a03b admin admin] The token cache is being invalidate because project d5552984e0fe4c61862469a55a11c0c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:50:16.138813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-774f1c58-46c9-4528-a840-162f0504a03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:16.139576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-774f1c58-46c9-4528-a840-162f0504a03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:16.141331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1368/2746] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:50:15 2022] DELETE /identity/v3/projects/d5552984e0fe4c61862469a55a11c0c4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:16.146279 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488474-019e-4de8-900e-be654a772020 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:16.147285 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488474-019e-4de8-900e-be654a772020 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:16.147756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af488474-019e-4de8-900e-be654a772020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:16.194725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-af488474-019e-4de8-900e-be654a772020 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:16.196148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-af488474-019e-4de8-900e-be654a772020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:16.271826 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1379/2747] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:16.280360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705566d-bf27-47f4-9d8c-03ac8e218306 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:16.280903 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705566d-bf27-47f4-9d8c-03ac8e218306 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:16.288296 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705566d-bf27-47f4-9d8c-03ac8e218306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:16.338948 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3705566d-bf27-47f4-9d8c-03ac8e218306 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:16.350190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3705566d-bf27-47f4-9d8c-03ac8e218306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:16.357475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1369/2748] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:50:16.361742 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af488474-019e-4de8-900e-be654a772020 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:16.373378 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af488474-019e-4de8-900e-be654a772020 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:16.378654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa238-5dea-42fd-9edd-a8ba4e203d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:16.379383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa238-5dea-42fd-9edd-a8ba4e203d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:16.379764 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa238-5dea-42fd-9edd-a8ba4e203d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:16.380141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa238-5dea-42fd-9edd-a8ba4e203d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:16.380906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aa238-5dea-42fd-9edd-a8ba4e203d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:50:16.381364 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aa238-5dea-42fd-9edd-a8ba4e203d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:16.383060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aa238-5dea-42fd-9edd-a8ba4e203d1e admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:16.398782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1380/2749] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:50:16.403889 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705566d-bf27-47f4-9d8c-03ac8e218306 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:16.414863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705566d-bf27-47f4-9d8c-03ac8e218306 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:16.422033 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c05667-6f8c-42f3-86ed-a01aa7bc1181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:16.422796 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c05667-6f8c-42f3-86ed-a01aa7bc1181 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:16.423080 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c05667-6f8c-42f3-86ed-a01aa7bc1181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:16.423351 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c05667-6f8c-42f3-86ed-a01aa7bc1181 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:16.423995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c05667-6f8c-42f3-86ed-a01aa7bc1181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:16.425999 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c05667-6f8c-42f3-86ed-a01aa7bc1181 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:16.530358 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1370/2750] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:50:16 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:50:16.534255 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa238-5dea-42fd-9edd-a8ba4e203d1e admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:16.546261 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa238-5dea-42fd-9edd-a8ba4e203d1e admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:16.652944 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e7e32-7d35-43e3-ab6e-e279b9edf46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:16.653854 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e7e32-7d35-43e3-ab6e-e279b9edf46b admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:16.654309 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e7e32-7d35-43e3-ab6e-e279b9edf46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:16.654655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e7e32-7d35-43e3-ab6e-e279b9edf46b admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:16.655368 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e7e32-7d35-43e3-ab6e-e279b9edf46b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:16.657526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e7e32-7d35-43e3-ab6e-e279b9edf46b admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:16.732424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1381/2751] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:50:16 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:50:16.736607 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c05667-6f8c-42f3-86ed-a01aa7bc1181 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:16.750374 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c05667-6f8c-42f3-86ed-a01aa7bc1181 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:16.755544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72854a-b25c-48c1-a597-3d16102b3be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:16.756159 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72854a-b25c-48c1-a597-3d16102b3be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:16.756411 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72854a-b25c-48c1-a597-3d16102b3be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:16.756740 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72854a-b25c-48c1-a597-3d16102b3be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:16.757414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72854a-b25c-48c1-a597-3d16102b3be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:16.759084 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72854a-b25c-48c1-a597-3d16102b3be3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:16.781065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1371/2752] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:50:16.784980 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e7e32-7d35-43e3-ab6e-e279b9edf46b admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:16.798488 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e7e32-7d35-43e3-ab6e-e279b9edf46b admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:16.803457 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acebb7-dc46-4343-81eb-8cdaa48ae6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:16.804060 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acebb7-dc46-4343-81eb-8cdaa48ae6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:16.804336 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acebb7-dc46-4343-81eb-8cdaa48ae6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:16.804605 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acebb7-dc46-4343-81eb-8cdaa48ae6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:16.805287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acebb7-dc46-4343-81eb-8cdaa48ae6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:16.806882 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acebb7-dc46-4343-81eb-8cdaa48ae6d5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:16.819783 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1382/2753] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:50:16.823656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72854a-b25c-48c1-a597-3d16102b3be3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:16.834238 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72854a-b25c-48c1-a597-3d16102b3be3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:16.838931 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257803a-f5a6-442e-9d41-3719e695e01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:16.839777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257803a-f5a6-442e-9d41-3719e695e01e admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:16.840056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257803a-f5a6-442e-9d41-3719e695e01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:16.840322 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257803a-f5a6-442e-9d41-3719e695e01e admin admin] PATH_INFO: `/v3/projects/8778639937f84cdc96fc9ff29381cfdc/users/5be895516f4c432a8bca51a38ba594af/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:16.857786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257803a-f5a6-442e-9d41-3719e695e01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8778639937f84cdc96fc9ff29381cfdc, user_id=5be895516f4c432a8bca51a38ba594af, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:16.860410 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257803a-f5a6-442e-9d41-3719e695e01e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:16.862725 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:16.963683 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1372/2754] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:50:16 2022] PUT /identity/v3/projects/8778639937f84cdc96fc9ff29381cfdc/users/5be895516f4c432a8bca51a38ba594af/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:16.975513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2edad-09fb-4af4-adeb-b26e734362cb None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:16.975803 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2edad-09fb-4af4-adeb-b26e734362cb None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:16.976072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2edad-09fb-4af4-adeb-b26e734362cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:17.014065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-15d2edad-09fb-4af4-adeb-b26e734362cb None None] MFA Rules not processed for user `5be895516f4c432a8bca51a38ba594af`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:17.015281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-15d2edad-09fb-4af4-adeb-b26e734362cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:17.064493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:17.095883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1383/2755] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:17.100620 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257803a-f5a6-442e-9d41-3719e695e01e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:17.176854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257803a-f5a6-442e-9d41-3719e695e01e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:17.187833 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da4345-576a-4992-9315-45488f25b056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:17.193682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da4345-576a-4992-9315-45488f25b056 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:17.193682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da4345-576a-4992-9315-45488f25b056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:17.193682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da4345-576a-4992-9315-45488f25b056 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:17.193682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da4345-576a-4992-9315-45488f25b056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:17.194164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da4345-576a-4992-9315-45488f25b056 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:17.281815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1373/2756] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:50:17 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:50:17.285792 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2edad-09fb-4af4-adeb-b26e734362cb None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:17.308187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2edad-09fb-4af4-adeb-b26e734362cb None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:17.397840 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb67d2e-5281-4bc8-aac4-da25cdd17cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:17.398480 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb67d2e-5281-4bc8-aac4-da25cdd17cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:17.398923 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb67d2e-5281-4bc8-aac4-da25cdd17cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:17.399204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb67d2e-5281-4bc8-aac4-da25cdd17cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:17.399884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb67d2e-5281-4bc8-aac4-da25cdd17cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:17.401835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb67d2e-5281-4bc8-aac4-da25cdd17cf4 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:17.515248 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1384/2757] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:50:17 2022] POST /identity/v3/users => generated 299 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:50:17.517360 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da4345-576a-4992-9315-45488f25b056 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:17.527995 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da4345-576a-4992-9315-45488f25b056 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:17.536297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00985f03-ab9e-48b7-b818-07105d32d39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:17.539011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00985f03-ab9e-48b7-b818-07105d32d39f admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:17.539011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00985f03-ab9e-48b7-b818-07105d32d39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:17.539011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00985f03-ab9e-48b7-b818-07105d32d39f admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:17.539011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00985f03-ab9e-48b7-b818-07105d32d39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:17.546588 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00985f03-ab9e-48b7-b818-07105d32d39f admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:17.559058 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1374/2758] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:50:17.564296 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb67d2e-5281-4bc8-aac4-da25cdd17cf4 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:17.576691 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb67d2e-5281-4bc8-aac4-da25cdd17cf4 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:17.581948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a42f1c-7270-470f-bb1c-d12ec9dac483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:17.582950 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a42f1c-7270-470f-bb1c-d12ec9dac483 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:17.583331 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a42f1c-7270-470f-bb1c-d12ec9dac483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:17.583712 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a42f1c-7270-470f-bb1c-d12ec9dac483 admin admin] PATH_INFO: `/v3/projects/bb8b48779b904e41b5066600ca62b2e2/users/690981b77354462fb9650a81c5d35f9e/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:17.602189 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a42f1c-7270-470f-bb1c-d12ec9dac483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8b48779b904e41b5066600ca62b2e2, user_id=690981b77354462fb9650a81c5d35f9e, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:17.605270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a42f1c-7270-470f-bb1c-d12ec9dac483 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:17.708033 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1385/2759] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:50:17 2022] PUT /identity/v3/projects/bb8b48779b904e41b5066600ca62b2e2/users/690981b77354462fb9650a81c5d35f9e/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:17.711916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00985f03-ab9e-48b7-b818-07105d32d39f admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:17.722950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00985f03-ab9e-48b7-b818-07105d32d39f admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:17.822089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9595811-dac1-4d50-90be-6954ba4f8efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:17.822818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9595811-dac1-4d50-90be-6954ba4f8efe admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:17.822818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9595811-dac1-4d50-90be-6954ba4f8efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:17.823152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9595811-dac1-4d50-90be-6954ba4f8efe admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:17.823774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9595811-dac1-4d50-90be-6954ba4f8efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:17.826914 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9595811-dac1-4d50-90be-6954ba4f8efe admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:17.839827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1375/2760] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:50:17.845165 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a42f1c-7270-470f-bb1c-d12ec9dac483 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:17.855920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a42f1c-7270-470f-bb1c-d12ec9dac483 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:17.861070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ab735-f99c-4a50-83bd-1e7ea856a114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:17.861765 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ab735-f99c-4a50-83bd-1e7ea856a114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:17.862039 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ab735-f99c-4a50-83bd-1e7ea856a114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:17.862336 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ab735-f99c-4a50-83bd-1e7ea856a114 admin admin] PATH_INFO: `/v3/projects/bb8b48779b904e41b5066600ca62b2e2/users/690981b77354462fb9650a81c5d35f9e/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:17.864284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ab735-f99c-4a50-83bd-1e7ea856a114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8b48779b904e41b5066600ca62b2e2, user_id=690981b77354462fb9650a81c5d35f9e, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:17.867042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ab735-f99c-4a50-83bd-1e7ea856a114 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:17.880624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1386/2761] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:50:17 2022] PUT /identity/v3/projects/bb8b48779b904e41b5066600ca62b2e2/users/690981b77354462fb9650a81c5d35f9e/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:50:17.893286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3607d41-a38a-4272-95f4-76d255da8987 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:17.893570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3607d41-a38a-4272-95f4-76d255da8987 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:17.893845 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3607d41-a38a-4272-95f4-76d255da8987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:17.923980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e3607d41-a38a-4272-95f4-76d255da8987 None None] MFA Rules not processed for user `690981b77354462fb9650a81c5d35f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:17.925242 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e3607d41-a38a-4272-95f4-76d255da8987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:17.989832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:18.009814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1376/2762] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:18.020821 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ab735-f99c-4a50-83bd-1e7ea856a114 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:18.022546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c07ab735-f99c-4a50-83bd-1e7ea856a114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:18.109817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ab735-f99c-4a50-83bd-1e7ea856a114 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:18.114290 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57264a5-aa33-441e-b86a-708b55b2f894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:18.115844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57264a5-aa33-441e-b86a-708b55b2f894 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:18.116355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57264a5-aa33-441e-b86a-708b55b2f894 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:18.116868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57264a5-aa33-441e-b86a-708b55b2f894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:18.127332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57264a5-aa33-441e-b86a-708b55b2f894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:18.129161 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57264a5-aa33-441e-b86a-708b55b2f894 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:18.140844 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1387/2763] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:50:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:50:19.270830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3607d41-a38a-4272-95f4-76d255da8987 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:19.353518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3607d41-a38a-4272-95f4-76d255da8987 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:19.360356 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77043e45-2370-4632-a54e-90d204502611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:19.361063 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77043e45-2370-4632-a54e-90d204502611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:19.361376 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77043e45-2370-4632-a54e-90d204502611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:19.361647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77043e45-2370-4632-a54e-90d204502611 admin admin] PATH_INFO: `/v3/users/5be895516f4c432a8bca51a38ba594af` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:19.362787 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77043e45-2370-4632-a54e-90d204502611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be895516f4c432a8bca51a38ba594af)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:19.364708 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77043e45-2370-4632-a54e-90d204502611 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:19.609381 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-77043e45-2370-4632-a54e-90d204502611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be895516f4c432a8bca51a38ba594af'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:19.609907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-77043e45-2370-4632-a54e-90d204502611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be895516f4c432a8bca51a38ba594af'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:19.626703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-77043e45-2370-4632-a54e-90d204502611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be895516f4c432a8bca51a38ba594af'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:19.635338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-77043e45-2370-4632-a54e-90d204502611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be895516f4c432a8bca51a38ba594af'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:19.636082 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-77043e45-2370-4632-a54e-90d204502611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be895516f4c432a8bca51a38ba594af'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:19.726331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1377/2764] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:50:19 2022] DELETE /identity/v3/users/5be895516f4c432a8bca51a38ba594af => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:19.730831 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c19b-8480-4f15-b0a8-3a61acc83947 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:19.731827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c19b-8480-4f15-b0a8-3a61acc83947 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:19.731962 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c19b-8480-4f15-b0a8-3a61acc83947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:19.753451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-2642c19b-8480-4f15-b0a8-3a61acc83947 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:19.754689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2642c19b-8480-4f15-b0a8-3a61acc83947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:19.791557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:19.822773 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1388/2765] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:19.832978 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77043e45-2370-4632-a54e-90d204502611 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:19.834468 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-77043e45-2370-4632-a54e-90d204502611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:19.905658 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77043e45-2370-4632-a54e-90d204502611 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:19.905658 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17efbb4-3f27-4bbb-ab95-9fc8fa097a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:19.905984 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17efbb4-3f27-4bbb-ab95-9fc8fa097a95 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:19.906093 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17efbb4-3f27-4bbb-ab95-9fc8fa097a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:19.906319 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17efbb4-3f27-4bbb-ab95-9fc8fa097a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:19.916120 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17efbb4-3f27-4bbb-ab95-9fc8fa097a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:19.917872 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17efbb4-3f27-4bbb-ab95-9fc8fa097a95 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:19.941305 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1378/2766] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:50:20.439648 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642c19b-8480-4f15-b0a8-3a61acc83947 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:20.441583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-2642c19b-8480-4f15-b0a8-3a61acc83947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:20.457535 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642c19b-8480-4f15-b0a8-3a61acc83947 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:20.480828 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:20.482884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:20.483354 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:20.484535 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] PATH_INFO: `/v3/projects/8778639937f84cdc96fc9ff29381cfdc` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:20.486034 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8778639937f84cdc96fc9ff29381cfdc)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:20.488220 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:20.590121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8778639937f84cdc96fc9ff29381cfdc', 'request_id': 'req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:20.654736 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8778639937f84cdc96fc9ff29381cfdc', 'request_id': 'req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:20.661269 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8778639937f84cdc96fc9ff29381cfdc', 'request_id': 'req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:20.673249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] The token cache is being invalidate because project 8778639937f84cdc96fc9ff29381cfdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:50:20.673559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:20.674203 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:20.675670 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1389/2767] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:50:20 2022] DELETE /identity/v3/projects/8778639937f84cdc96fc9ff29381cfdc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:20.679807 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17efbb4-3f27-4bbb-ab95-9fc8fa097a95 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:20.692880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17efbb4-3f27-4bbb-ab95-9fc8fa097a95 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:20.701715 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:20.759753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9878776-a1cd-4c08-bc8e-f64f6c44be99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:20.760392 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9878776-a1cd-4c08-bc8e-f64f6c44be99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:20.760676 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9878776-a1cd-4c08-bc8e-f64f6c44be99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:20.760958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9878776-a1cd-4c08-bc8e-f64f6c44be99 admin admin] PATH_INFO: `/v3/users/690981b77354462fb9650a81c5d35f9e` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:20.762130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9878776-a1cd-4c08-bc8e-f64f6c44be99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690981b77354462fb9650a81c5d35f9e)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:20.764087 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9878776-a1cd-4c08-bc8e-f64f6c44be99 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:20.955014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b9878776-a1cd-4c08-bc8e-f64f6c44be99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690981b77354462fb9650a81c5d35f9e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:20.955557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b9878776-a1cd-4c08-bc8e-f64f6c44be99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690981b77354462fb9650a81c5d35f9e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:20.968909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b9878776-a1cd-4c08-bc8e-f64f6c44be99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690981b77354462fb9650a81c5d35f9e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:20.988889 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b9878776-a1cd-4c08-bc8e-f64f6c44be99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690981b77354462fb9650a81c5d35f9e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:20.989801 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b9878776-a1cd-4c08-bc8e-f64f6c44be99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690981b77354462fb9650a81c5d35f9e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:21.071109 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1379/2768] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:50:20 2022] DELETE /identity/v3/users/690981b77354462fb9650a81c5d35f9e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:22.407440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:22.413489 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:22.422671 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07b3ff-1f63-4d46-b4f0-5cef80c0dabd admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:22.488010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a68e14-eb2f-499a-a284-84fa5dc89782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:22.488706 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a68e14-eb2f-499a-a284-84fa5dc89782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:22.488881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a68e14-eb2f-499a-a284-84fa5dc89782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:22.489602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a68e14-eb2f-499a-a284-84fa5dc89782 admin admin] PATH_INFO: `/v3/projects/bb8b48779b904e41b5066600ca62b2e2` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:22.490892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a68e14-eb2f-499a-a284-84fa5dc89782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb8b48779b904e41b5066600ca62b2e2)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:22.492900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a68e14-eb2f-499a-a284-84fa5dc89782 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:22.604094 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99a68e14-eb2f-499a-a284-84fa5dc89782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb8b48779b904e41b5066600ca62b2e2', 'request_id': 'req-99a68e14-eb2f-499a-a284-84fa5dc89782'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:22.708556 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99a68e14-eb2f-499a-a284-84fa5dc89782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb8b48779b904e41b5066600ca62b2e2', 'request_id': 'req-99a68e14-eb2f-499a-a284-84fa5dc89782'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:22.713042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:22.715725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99a68e14-eb2f-499a-a284-84fa5dc89782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb8b48779b904e41b5066600ca62b2e2', 'request_id': 'req-99a68e14-eb2f-499a-a284-84fa5dc89782'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:22.727308 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99a68e14-eb2f-499a-a284-84fa5dc89782 admin admin] The token cache is being invalidate because project bb8b48779b904e41b5066600ca62b2e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:50:22.727600 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99a68e14-eb2f-499a-a284-84fa5dc89782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:22.728257 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-99a68e14-eb2f-499a-a284-84fa5dc89782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:50:22.729814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1390/2769] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:50:22 2022] DELETE /identity/v3/projects/bb8b48779b904e41b5066600ca62b2e2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:22.737141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82a09-ea09-40ff-bc21-f3b5ce96bc19 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:22.737736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82a09-ea09-40ff-bc21-f3b5ce96bc19 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:22.737736 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82a09-ea09-40ff-bc21-f3b5ce96bc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:22.758226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3ee82a09-ea09-40ff-bc21-f3b5ce96bc19 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:22.759442 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3ee82a09-ea09-40ff-bc21-f3b5ce96bc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:22.822452 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1380/2770] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:50:22.830789 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a00b78-e012-466d-a48a-cd18005c4023 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:22.831077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a00b78-e012-466d-a48a-cd18005c4023 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:22.831357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a00b78-e012-466d-a48a-cd18005c4023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:22.851933 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-29a00b78-e012-466d-a48a-cd18005c4023 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:22.853129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-29a00b78-e012-466d-a48a-cd18005c4023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:22.861117 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1391/2771] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:22.865367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee82a09-ea09-40ff-bc21-f3b5ce96bc19 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:22.875137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee82a09-ea09-40ff-bc21-f3b5ce96bc19 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:22.879734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81c711-3aa2-4f60-aa4c-7deb16a04b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:22.880332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81c711-3aa2-4f60-aa4c-7deb16a04b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:22.880645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81c711-3aa2-4f60-aa4c-7deb16a04b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:22.880938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81c711-3aa2-4f60-aa4c-7deb16a04b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:22.881643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81c711-3aa2-4f60-aa4c-7deb16a04b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:50:22.881952 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81c711-3aa2-4f60-aa4c-7deb16a04b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:22.883544 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81c711-3aa2-4f60-aa4c-7deb16a04b86 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:22.896027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1381/2772] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:50:22.900121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a00b78-e012-466d-a48a-cd18005c4023 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:22.910332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a00b78-e012-466d-a48a-cd18005c4023 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:22.915037 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dedb64-1c68-4e22-8904-e0a04aa5bfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:22.915643 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dedb64-1c68-4e22-8904-e0a04aa5bfe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:22.915920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dedb64-1c68-4e22-8904-e0a04aa5bfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:22.916193 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dedb64-1c68-4e22-8904-e0a04aa5bfe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:22.917138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dedb64-1c68-4e22-8904-e0a04aa5bfe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:22.919069 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dedb64-1c68-4e22-8904-e0a04aa5bfe9 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:23.040792 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1392/2773] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:50:22 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:50:23.045442 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81c711-3aa2-4f60-aa4c-7deb16a04b86 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:23.063723 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81c711-3aa2-4f60-aa4c-7deb16a04b86 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:23.088067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:23.135334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c97b76-e871-43a8-9c19-8983279d97cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:23.135938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c97b76-e871-43a8-9c19-8983279d97cf admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:23.136217 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c97b76-e871-43a8-9c19-8983279d97cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:23.136549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c97b76-e871-43a8-9c19-8983279d97cf admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:23.137183 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c97b76-e871-43a8-9c19-8983279d97cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:23.139771 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c97b76-e871-43a8-9c19-8983279d97cf admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:23.230772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1382/2774] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:50:23 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:50:23.235653 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dedb64-1c68-4e22-8904-e0a04aa5bfe9 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:23.246797 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dedb64-1c68-4e22-8904-e0a04aa5bfe9 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:23.257014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa271a0-0cbd-4e68-a9dd-ed864a1609a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:23.259435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa271a0-0cbd-4e68-a9dd-ed864a1609a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:23.259435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa271a0-0cbd-4e68-a9dd-ed864a1609a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:23.259435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa271a0-0cbd-4e68-a9dd-ed864a1609a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:23.259435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa271a0-0cbd-4e68-a9dd-ed864a1609a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:23.260583 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa271a0-0cbd-4e68-a9dd-ed864a1609a3 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:23.274542 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1393/2775] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:50:23.275586 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c97b76-e871-43a8-9c19-8983279d97cf admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:23.286894 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c97b76-e871-43a8-9c19-8983279d97cf admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:23.293075 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bf1eb-dc76-4632-856f-f7c74d348c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:23.293786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bf1eb-dc76-4632-856f-f7c74d348c5e admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:23.294082 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bf1eb-dc76-4632-856f-f7c74d348c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:23.294335 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bf1eb-dc76-4632-856f-f7c74d348c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:23.295083 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bf1eb-dc76-4632-856f-f7c74d348c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:23.296721 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bf1eb-dc76-4632-856f-f7c74d348c5e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:23.308103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1383/2776] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:50:23.312853 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa271a0-0cbd-4e68-a9dd-ed864a1609a3 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:23.323204 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa271a0-0cbd-4e68-a9dd-ed864a1609a3 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:23.328129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14c68b-ccbc-418d-aef9-010876a012b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:23.328781 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14c68b-ccbc-418d-aef9-010876a012b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:23.329118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14c68b-ccbc-418d-aef9-010876a012b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:23.329427 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14c68b-ccbc-418d-aef9-010876a012b8 admin admin] PATH_INFO: `/v3/projects/e8f329c37dae4eee847a5b09d63a108c/users/6a1fc0e72561448c851d03f5ccfaf7fd/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:23.345636 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14c68b-ccbc-418d-aef9-010876a012b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f329c37dae4eee847a5b09d63a108c, user_id=6a1fc0e72561448c851d03f5ccfaf7fd, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:23.347825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14c68b-ccbc-418d-aef9-010876a012b8 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:23.443380 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1394/2777] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:50:23 2022] PUT /identity/v3/projects/e8f329c37dae4eee847a5b09d63a108c/users/6a1fc0e72561448c851d03f5ccfaf7fd/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:23.448545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c454223-1de6-4e47-9ddd-a42566ad8bd6 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:23.448834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c454223-1de6-4e47-9ddd-a42566ad8bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:23.449104 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c454223-1de6-4e47-9ddd-a42566ad8bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:23.470463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-0c454223-1de6-4e47-9ddd-a42566ad8bd6 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:23.471694 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-0c454223-1de6-4e47-9ddd-a42566ad8bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:23.534651 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1384/2778] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:23.542549 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14c68b-ccbc-418d-aef9-010876a012b8 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:23.545999 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3d14c68b-ccbc-418d-aef9-010876a012b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:23.627614 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14c68b-ccbc-418d-aef9-010876a012b8 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:23.634247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d70cc2-ceb3-467f-9ad0-d7d20b463ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:23.634247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d70cc2-ceb3-467f-9ad0-d7d20b463ddf service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:23.634247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d70cc2-ceb3-467f-9ad0-d7d20b463ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:23.634247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d70cc2-ceb3-467f-9ad0-d7d20b463ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:23.646538 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d70cc2-ceb3-467f-9ad0-d7d20b463ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:23.648180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d70cc2-ceb3-467f-9ad0-d7d20b463ddf service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:23.659908 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1395/2779] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:50:30.162324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb7c78-efd2-4d1b-8881-db01934c6986 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:30.162821 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb7c78-efd2-4d1b-8881-db01934c6986 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:30.162930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb7c78-efd2-4d1b-8881-db01934c6986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:30.193800 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-66cb7c78-efd2-4d1b-8881-db01934c6986 None None] MFA Rules not processed for user `6a1fc0e72561448c851d03f5ccfaf7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:30.195010 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-66cb7c78-efd2-4d1b-8881-db01934c6986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:30.273035 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1385/2780] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:30.277849 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d70cc2-ceb3-467f-9ad0-d7d20b463ddf service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:30.289628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d70cc2-ceb3-467f-9ad0-d7d20b463ddf service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:30.295353 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330b0cf-0567-4c39-937a-97aceddf63e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:30.296375 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330b0cf-0567-4c39-937a-97aceddf63e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:30.296883 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330b0cf-0567-4c39-937a-97aceddf63e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:30.297256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330b0cf-0567-4c39-937a-97aceddf63e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:30.298102 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330b0cf-0567-4c39-937a-97aceddf63e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:30.300084 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330b0cf-0567-4c39-937a-97aceddf63e6 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:30.409681 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1396/2781] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:50:30 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:50:30.413439 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb7c78-efd2-4d1b-8881-db01934c6986 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:30.427066 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb7c78-efd2-4d1b-8881-db01934c6986 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:30.456545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:30.519867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04c1b-e690-4140-9a3d-eac62a579c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:30.520584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04c1b-e690-4140-9a3d-eac62a579c12 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:30.520868 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04c1b-e690-4140-9a3d-eac62a579c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:30.531654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04c1b-e690-4140-9a3d-eac62a579c12 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:30.531654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed04c1b-e690-4140-9a3d-eac62a579c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:30.531654 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed04c1b-e690-4140-9a3d-eac62a579c12 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:30.623111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1386/2782] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:50:30 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:50:30.624585 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330b0cf-0567-4c39-937a-97aceddf63e6 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:30.637184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330b0cf-0567-4c39-937a-97aceddf63e6 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:30.642894 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e862bd7-c995-424c-9b37-cf4aef8690ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:30.643637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e862bd7-c995-424c-9b37-cf4aef8690ea admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:30.644168 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e862bd7-c995-424c-9b37-cf4aef8690ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:30.644539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e862bd7-c995-424c-9b37-cf4aef8690ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:30.645344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e862bd7-c995-424c-9b37-cf4aef8690ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:30.647502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e862bd7-c995-424c-9b37-cf4aef8690ea admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:30.666009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1397/2783] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:50:30.671896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04c1b-e690-4140-9a3d-eac62a579c12 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:30.691437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04c1b-e690-4140-9a3d-eac62a579c12 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:30.697059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79adf6-33f8-4531-9fa2-47e5a9b1584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:30.701645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79adf6-33f8-4531-9fa2-47e5a9b1584a admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:30.701645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79adf6-33f8-4531-9fa2-47e5a9b1584a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:30.701645 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79adf6-33f8-4531-9fa2-47e5a9b1584a admin admin] PATH_INFO: `/v3/projects/ee36af96d386490aaa4012f70614c896/users/ec42b6be1f404f80b96725dd8660642e/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:30.720067 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79adf6-33f8-4531-9fa2-47e5a9b1584a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee36af96d386490aaa4012f70614c896, user_id=ec42b6be1f404f80b96725dd8660642e, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:30.729793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79adf6-33f8-4531-9fa2-47e5a9b1584a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:30.811517 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1387/2784] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:50:30 2022] PUT /identity/v3/projects/ee36af96d386490aaa4012f70614c896/users/ec42b6be1f404f80b96725dd8660642e/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:30.815440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e862bd7-c995-424c-9b37-cf4aef8690ea admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:30.826453 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e862bd7-c995-424c-9b37-cf4aef8690ea admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:30.889113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:30.897845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544e757-ceb5-47e0-91e9-e05cc7842c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:30.903931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544e757-ceb5-47e0-91e9-e05cc7842c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:30.903931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544e757-ceb5-47e0-91e9-e05cc7842c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:30.903931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544e757-ceb5-47e0-91e9-e05cc7842c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:30.903931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544e757-ceb5-47e0-91e9-e05cc7842c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:30.903931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544e757-ceb5-47e0-91e9-e05cc7842c96 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:30.913499 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1398/2785] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:50:30.918024 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79adf6-33f8-4531-9fa2-47e5a9b1584a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:30.931955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79adf6-33f8-4531-9fa2-47e5a9b1584a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:30.935220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1e2f0-66cf-4535-b0a0-499abe7d8787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:30.935907 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1e2f0-66cf-4535-b0a0-499abe7d8787 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:30.936182 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1e2f0-66cf-4535-b0a0-499abe7d8787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:30.936469 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1e2f0-66cf-4535-b0a0-499abe7d8787 admin admin] PATH_INFO: `/v3/projects/ee36af96d386490aaa4012f70614c896/users/ec42b6be1f404f80b96725dd8660642e/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:30.938583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1e2f0-66cf-4535-b0a0-499abe7d8787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee36af96d386490aaa4012f70614c896, user_id=ec42b6be1f404f80b96725dd8660642e, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:30.941317 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1e2f0-66cf-4535-b0a0-499abe7d8787 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:30.953463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1388/2786] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:50:30 2022] PUT /identity/v3/projects/ee36af96d386490aaa4012f70614c896/users/ec42b6be1f404f80b96725dd8660642e/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:50:33.626870 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a41760-bee0-444a-adad-1b480193b81d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:33.627435 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a41760-bee0-444a-adad-1b480193b81d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:33.627561 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a41760-bee0-444a-adad-1b480193b81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:33.649119 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-e8a41760-bee0-444a-adad-1b480193b81d None None] MFA Rules not processed for user `a22e284af0b94f9ea41e0c8e64a27a25`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:33.650386 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e8a41760-bee0-444a-adad-1b480193b81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:33.777065 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1399/2787] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:34.322994 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1e2f0-66cf-4535-b0a0-499abe7d8787 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:34.324784 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bcd1e2f0-66cf-4535-b0a0-499abe7d8787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:34.400222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1e2f0-66cf-4535-b0a0-499abe7d8787 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:34.405816 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b41f29-5d23-4107-9976-d0322e418bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:34.406631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b41f29-5d23-4107-9976-d0322e418bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:34.448051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b41f29-5d23-4107-9976-d0322e418bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:34.448051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b41f29-5d23-4107-9976-d0322e418bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:34.448051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-37b41f29-5d23-4107-9976-d0322e418bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:34.448051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b41f29-5d23-4107-9976-d0322e418bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:34.448051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b41f29-5d23-4107-9976-d0322e418bb4 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:34.448051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1389/2788] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:50:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:50:37.521498 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25176980-932e-4f5f-bd62-70798392f30e None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:37.522027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25176980-932e-4f5f-bd62-70798392f30e None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:37.522027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25176980-932e-4f5f-bd62-70798392f30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:37.557903 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-25176980-932e-4f5f-bd62-70798392f30e None None] MFA Rules not processed for user `ec42b6be1f404f80b96725dd8660642e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:37.559135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-25176980-932e-4f5f-bd62-70798392f30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:37.645825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1400/2789] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:37.659805 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b41f29-5d23-4107-9976-d0322e418bb4 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:37.661772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-37b41f29-5d23-4107-9976-d0322e418bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:37.785648 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b41f29-5d23-4107-9976-d0322e418bb4 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:37.792277 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83812723-7998-4594-b09d-2943e5be90d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:37.792904 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83812723-7998-4594-b09d-2943e5be90d7 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:37.793184 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83812723-7998-4594-b09d-2943e5be90d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:37.793487 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83812723-7998-4594-b09d-2943e5be90d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:37.814248 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:37.892650 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83812723-7998-4594-b09d-2943e5be90d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:37.895314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83812723-7998-4594-b09d-2943e5be90d7 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:37.928565 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1390/2790] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:50:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:50:38.645113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25176980-932e-4f5f-bd62-70798392f30e None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:38.656501 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25176980-932e-4f5f-bd62-70798392f30e None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:38.660640 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3fa65-f4e3-4c57-9c21-a209d85c438b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:38.661356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3fa65-f4e3-4c57-9c21-a209d85c438b service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:38.661812 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3fa65-f4e3-4c57-9c21-a209d85c438b service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:38.662246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3fa65-f4e3-4c57-9c21-a209d85c438b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:38.664190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6ac3fa65-f4e3-4c57-9c21-a209d85c438b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:38.736723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3fa65-f4e3-4c57-9c21-a209d85c438b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:38.738316 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3fa65-f4e3-4c57-9c21-a209d85c438b service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:38.750616 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1401/2791] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:50:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:50:41.364099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e3edf-c8a3-467c-ab52-5074dbbfa937 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:41.364635 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e3edf-c8a3-467c-ab52-5074dbbfa937 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:41.364745 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e3edf-c8a3-467c-ab52-5074dbbfa937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:41.386486 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-7a5e3edf-c8a3-467c-ab52-5074dbbfa937 None None] MFA Rules not processed for user `6a1fc0e72561448c851d03f5ccfaf7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:50:41.390131 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-7a5e3edf-c8a3-467c-ab52-5074dbbfa937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:41.397793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1391/2792] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:50:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:50:42.278682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3fa65-f4e3-4c57-9c21-a209d85c438b service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:50:42.282374 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6ac3fa65-f4e3-4c57-9c21-a209d85c438b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:42.316010 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3fa65-f4e3-4c57-9c21-a209d85c438b service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:50:42.322991 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd857fc9-d221-430b-bf94-02172b8c4425 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:50:42.324664 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857fc9-d221-430b-bf94-02172b8c4425 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:50:42.324664 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857fc9-d221-430b-bf94-02172b8c4425 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:50:42.324664 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857fc9-d221-430b-bf94-02172b8c4425 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:50:42.326814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bd857fc9-d221-430b-bf94-02172b8c4425 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:50:42.341438 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd857fc9-d221-430b-bf94-02172b8c4425 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:50:42.343169 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd857fc9-d221-430b-bf94-02172b8c4425 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:50:42.355145 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1402/2793] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:50:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:50:51.380002 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=22 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:50:52.350792 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=99 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:51:09.536130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e3edf-c8a3-467c-ab52-5074dbbfa937 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:51:09.557685 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e3edf-c8a3-467c-ab52-5074dbbfa937 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:51:09.561403 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30057224-616e-4fe6-9cc1-d98f3a5fd624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:51:09.562014 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30057224-616e-4fe6-9cc1-d98f3a5fd624 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:51:09.562299 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30057224-616e-4fe6-9cc1-d98f3a5fd624 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:51:09.562570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30057224-616e-4fe6-9cc1-d98f3a5fd624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:51:09.594753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30057224-616e-4fe6-9cc1-d98f3a5fd624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:51:09.596239 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30057224-616e-4fe6-9cc1-d98f3a5fd624 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:51:09.605721 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1392/2794] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:51:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:51:19.601530 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=20 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:51:46.567141 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739616aa-7bdc-4b2d-a2dc-501f005e5ffa None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:51:46.567682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739616aa-7bdc-4b2d-a2dc-501f005e5ffa None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:51:46.567682 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739616aa-7bdc-4b2d-a2dc-501f005e5ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:51:46.612670 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-739616aa-7bdc-4b2d-a2dc-501f005e5ffa None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:51:46.614013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-739616aa-7bdc-4b2d-a2dc-501f005e5ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:51:46.689432 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1403/2795] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:51:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:51:46.730383 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30057224-616e-4fe6-9cc1-d98f3a5fd624 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:51:46.731847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-30057224-616e-4fe6-9cc1-d98f3a5fd624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:51:46.804388 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30057224-616e-4fe6-9cc1-d98f3a5fd624 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:51:46.809372 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410e91c-15ee-4af1-ba6d-89a9207bcbd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:51:46.809970 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410e91c-15ee-4af1-ba6d-89a9207bcbd6 service swift] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:51:46.810251 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410e91c-15ee-4af1-ba6d-89a9207bcbd6 service swift] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:51:46.810518 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410e91c-15ee-4af1-ba6d-89a9207bcbd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:51:46.818463 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410e91c-15ee-4af1-ba6d-89a9207bcbd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:51:46.820020 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410e91c-15ee-4af1-ba6d-89a9207bcbd6 service swift] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:51:46.827883 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1393/2796] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:51:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:51:56.680968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=40 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:51:56.825485 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=32 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:52:00.498409 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739616aa-7bdc-4b2d-a2dc-501f005e5ffa None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:52:00.499835 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-739616aa-7bdc-4b2d-a2dc-501f005e5ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:52:00.593514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739616aa-7bdc-4b2d-a2dc-501f005e5ffa None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:52:00.599256 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d245576-0d60-4285-8d86-4c31413d797e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ad954bbb7749ee8861e8da98619006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:52:00.599900 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d245576-0d60-4285-8d86-4c31413d797e service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:52:00.600176 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d245576-0d60-4285-8d86-4c31413d797e service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:52:00.600447 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d245576-0d60-4285-8d86-4c31413d797e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:52:00.602286 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3d245576-0d60-4285-8d86-4c31413d797e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:52:00.614486 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d245576-0d60-4285-8d86-4c31413d797e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:52:00.618246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d245576-0d60-4285-8d86-4c31413d797e service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:52:00.631555 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1404/2797] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:52:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:52:05.668979 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be0248-a664-4de2-ad42-6b653c483b8d None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:52:05.669570 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be0248-a664-4de2-ad42-6b653c483b8d None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:52:05.669670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be0248-a664-4de2-ad42-6b653c483b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:52:05.690186 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-57be0248-a664-4de2-ad42-6b653c483b8d None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:52:05.691410 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-57be0248-a664-4de2-ad42-6b653c483b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:52:05.699130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1394/2798] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 31 04:52:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:52:05.711095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d245576-0d60-4285-8d86-4c31413d797e service placement] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:52:05.723360 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d245576-0d60-4285-8d86-4c31413d797e service placement] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:52:05.728393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c334e-f841-404a-a95e-1adde1f9110e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:52:05.728990 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c334e-f841-404a-a95e-1adde1f9110e service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:52:05.729513 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c334e-f841-404a-a95e-1adde1f9110e service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:52:05.729992 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c334e-f841-404a-a95e-1adde1f9110e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:52:05.739521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c334e-f841-404a-a95e-1adde1f9110e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:52:05.741095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c334e-f841-404a-a95e-1adde1f9110e service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:52:05.749478 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1405/2799] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:52:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:52:08.112000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff376917-a4d9-464c-919b-154e6c160b88 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:52:08.112494 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff376917-a4d9-464c-919b-154e6c160b88 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:52:08.112939 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff376917-a4d9-464c-919b-154e6c160b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:52:08.132590 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ff376917-a4d9-464c-919b-154e6c160b88 None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:52:08.133760 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ff376917-a4d9-464c-919b-154e6c160b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:52:08.140862 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1395/2800] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 31 04:52:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:52:08.153523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c334e-f841-404a-a95e-1adde1f9110e service swift] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:52:08.164505 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c334e-f841-404a-a95e-1adde1f9110e service swift] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:52:08.169934 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b1def-7e3b-47d3-9504-1b45c2a46b4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:52:08.170534 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b1def-7e3b-47d3-9504-1b45c2a46b4f service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:52:08.170813 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b1def-7e3b-47d3-9504-1b45c2a46b4f service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:52:08.171088 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b1def-7e3b-47d3-9504-1b45c2a46b4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:52:08.180023 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b1def-7e3b-47d3-9504-1b45c2a46b4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:52:08.181648 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b1def-7e3b-47d3-9504-1b45c2a46b4f service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:52:08.190787 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1406/2801] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:52:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:52:15.713132 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff376917-a4d9-464c-919b-154e6c160b88 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:52:15.719705 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ff376917-a4d9-464c-919b-154e6c160b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:52:15.828624 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff376917-a4d9-464c-919b-154e6c160b88 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:52:15.833275 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108dc97-8f6c-43a5-9b8f-653ec2830427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:52:15.833908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108dc97-8f6c-43a5-9b8f-653ec2830427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:52:15.834193 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108dc97-8f6c-43a5-9b8f-653ec2830427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:52:15.834470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108dc97-8f6c-43a5-9b8f-653ec2830427 admin admin] PATH_INFO: `/v3/users/0e695aaa93844e6f9bca100564d38e2f` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:52:15.835600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108dc97-8f6c-43a5-9b8f-653ec2830427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e695aaa93844e6f9bca100564d38e2f)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:52:15.837576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108dc97-8f6c-43a5-9b8f-653ec2830427 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:52:16.329011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3108dc97-8f6c-43a5-9b8f-653ec2830427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e695aaa93844e6f9bca100564d38e2f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:16.329804 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3108dc97-8f6c-43a5-9b8f-653ec2830427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e695aaa93844e6f9bca100564d38e2f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:16.343270 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3108dc97-8f6c-43a5-9b8f-653ec2830427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e695aaa93844e6f9bca100564d38e2f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:16.350968 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3108dc97-8f6c-43a5-9b8f-653ec2830427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e695aaa93844e6f9bca100564d38e2f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:16.351679 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3108dc97-8f6c-43a5-9b8f-653ec2830427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e695aaa93844e6f9bca100564d38e2f'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:16.421765 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1396/2802] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:52:15 2022] DELETE /identity/v3/users/0e695aaa93844e6f9bca100564d38e2f => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:52:16.713843 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b1def-7e3b-47d3-9504-1b45c2a46b4f service swift] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:52:16.724918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b1def-7e3b-47d3-9504-1b45c2a46b4f service swift] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:52:16.787021 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:52:16.787568 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:52:16.787874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:52:16.788142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] PATH_INFO: `/v3/projects/e7d606b9b5ae4e04a539c5cd7d6b5400` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:52:16.789371 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d606b9b5ae4e04a539c5cd7d6b5400)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:52:16.791266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:52:16.924739 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:52:16.927624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d606b9b5ae4e04a539c5cd7d6b5400', 'request_id': 'req-270b23af-5441-459d-aa8d-99b64404dd43'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:17.004557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d606b9b5ae4e04a539c5cd7d6b5400', 'request_id': 'req-270b23af-5441-459d-aa8d-99b64404dd43'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:17.011635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d606b9b5ae4e04a539c5cd7d6b5400', 'request_id': 'req-270b23af-5441-459d-aa8d-99b64404dd43'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:17.022938 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] The token cache is being invalidate because project e7d606b9b5ae4e04a539c5cd7d6b5400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:52:17.023225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:17.023856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:17.025369 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1407/2803] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:52:16 2022] DELETE /identity/v3/projects/e7d606b9b5ae4e04a539c5cd7d6b5400 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:52:17.029538 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108dc97-8f6c-43a5-9b8f-653ec2830427 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:52:17.030949 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3108dc97-8f6c-43a5-9b8f-653ec2830427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:52:17.045345 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108dc97-8f6c-43a5-9b8f-653ec2830427 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:52:17.079212 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:52:17.104301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58ce96-6168-41d3-b6d1-1c7bac9000c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:52:17.105190 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58ce96-6168-41d3-b6d1-1c7bac9000c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:52:17.105531 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58ce96-6168-41d3-b6d1-1c7bac9000c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:52:17.105957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58ce96-6168-41d3-b6d1-1c7bac9000c5 admin admin] PATH_INFO: `/v3/users/d666fe4df7a94a91ae43ae547523d584` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:52:17.107136 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58ce96-6168-41d3-b6d1-1c7bac9000c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d666fe4df7a94a91ae43ae547523d584)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:52:17.109455 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58ce96-6168-41d3-b6d1-1c7bac9000c5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:52:17.305333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2b58ce96-6168-41d3-b6d1-1c7bac9000c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd666fe4df7a94a91ae43ae547523d584'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:17.306004 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2b58ce96-6168-41d3-b6d1-1c7bac9000c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd666fe4df7a94a91ae43ae547523d584'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:17.321126 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2b58ce96-6168-41d3-b6d1-1c7bac9000c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd666fe4df7a94a91ae43ae547523d584'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:17.328110 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2b58ce96-6168-41d3-b6d1-1c7bac9000c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd666fe4df7a94a91ae43ae547523d584'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:17.328881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2b58ce96-6168-41d3-b6d1-1c7bac9000c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd666fe4df7a94a91ae43ae547523d584'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:17.432847 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1397/2804] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:52:17 2022] DELETE /identity/v3/users/d666fe4df7a94a91ae43ae547523d584 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:52:17.691694 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:52:17.694765 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:52:17.708723 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b23af-5441-459d-aa8d-99b64404dd43 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:52:17.768706 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:52:17.769404 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:52:17.769634 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:52:17.769908 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] PATH_INFO: `/v3/projects/f8b3f115ef8b4a489b49a0b76588c685` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:52:17.771031 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b3f115ef8b4a489b49a0b76588c685)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:52:17.772931 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:52:17.897817 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b3f115ef8b4a489b49a0b76588c685', 'request_id': 'req-96815b6f-2b89-4f08-ba40-6253869acb56'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:17.981356 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b3f115ef8b4a489b49a0b76588c685', 'request_id': 'req-96815b6f-2b89-4f08-ba40-6253869acb56'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:17.987635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b3f115ef8b4a489b49a0b76588c685', 'request_id': 'req-96815b6f-2b89-4f08-ba40-6253869acb56'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:17.999095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] The token cache is being invalidate because project f8b3f115ef8b4a489b49a0b76588c685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:52:17.999388 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:18.000035 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:52:18.001609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1408/2805] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:52:17 2022] DELETE /identity/v3/projects/f8b3f115ef8b4a489b49a0b76588c685 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:52:22.909643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f8b85-29b2-4bf1-878e-4270dbb4889c None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:52:22.910103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f8b85-29b2-4bf1-878e-4270dbb4889c None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:52:22.910361 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f8b85-29b2-4bf1-878e-4270dbb4889c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:52:22.930119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5d2f8b85-29b2-4bf1-878e-4270dbb4889c None None] MFA Rules not processed for user `d8f5e60b6e1a4acc87c03da8cf86451e`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:52:22.931324 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5d2f8b85-29b2-4bf1-878e-4270dbb4889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:52:22.986098 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1398/2806] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 31 04:52:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:52:22.998276 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:52:22.999669 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:52:23.069662 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96815b6f-2b89-4f08-ba40-6253869acb56 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:52:23.074657 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eed9c-7b74-473b-bb48-f57567706cac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98c52ca121d34ce6bbeb414c31f5d2fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:52:23.075267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eed9c-7b74-473b-bb48-f57567706cac service swift] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:52:23.075557 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eed9c-7b74-473b-bb48-f57567706cac service swift] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:52:23.075859 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eed9c-7b74-473b-bb48-f57567706cac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:52:23.081591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:52:23.085335 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87eed9c-7b74-473b-bb48-f57567706cac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:52:23.086920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87eed9c-7b74-473b-bb48-f57567706cac service swift] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:52:23.095216 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1409/2807] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 31 04:52:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:52:32.979563 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:52:33.289995 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:52:55.410103 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f8b85-29b2-4bf1-878e-4270dbb4889c None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:52:55.411543 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5d2f8b85-29b2-4bf1-878e-4270dbb4889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:52:55.507915 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f8b85-29b2-4bf1-878e-4270dbb4889c None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:52:55.513812 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068831b-add9-413b-94ee-fe95892f2b8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:52:55.514422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068831b-add9-413b-94ee-fe95892f2b8d service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:52:55.514698 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068831b-add9-413b-94ee-fe95892f2b8d service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:52:55.514964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068831b-add9-413b-94ee-fe95892f2b8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:52:55.516720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d068831b-add9-413b-94ee-fe95892f2b8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:52:55.575111 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068831b-add9-413b-94ee-fe95892f2b8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:52:55.576673 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068831b-add9-413b-94ee-fe95892f2b8d service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:52:55.585628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1399/2808] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:52:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:02.583023 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eed9c-7b74-473b-bb48-f57567706cac service swift] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:02.584485 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e87eed9c-7b74-473b-bb48-f57567706cac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:02.662453 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eed9c-7b74-473b-bb48-f57567706cac service swift] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:02.666115 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78b600-36c9-4db2-b888-2a2ef698c43f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:02.666702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78b600-36c9-4db2-b888-2a2ef698c43f service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:02.666974 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78b600-36c9-4db2-b888-2a2ef698c43f service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:02.667240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78b600-36c9-4db2-b888-2a2ef698c43f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:02.669782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cf78b600-36c9-4db2-b888-2a2ef698c43f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:02.732049 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78b600-36c9-4db2-b888-2a2ef698c43f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:02.733593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78b600-36c9-4db2-b888-2a2ef698c43f service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:02.743178 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1410/2809] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:05.581512 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=65 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:06.177675 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068831b-add9-413b-94ee-fe95892f2b8d service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:06.179186 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d068831b-add9-413b-94ee-fe95892f2b8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:06.251301 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068831b-add9-413b-94ee-fe95892f2b8d service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:06.256929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c60104-1c4f-42a2-8561-8db910188662 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ad954bbb7749ee8861e8da98619006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:06.257616 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c60104-1c4f-42a2-8561-8db910188662 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:06.261272 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c60104-1c4f-42a2-8561-8db910188662 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:06.261272 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c60104-1c4f-42a2-8561-8db910188662 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:06.261272 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c1c60104-1c4f-42a2-8561-8db910188662 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:06.272122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c60104-1c4f-42a2-8561-8db910188662 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:06.273753 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c60104-1c4f-42a2-8561-8db910188662 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:06.284051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1400/2810] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:06.303888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78b600-36c9-4db2-b888-2a2ef698c43f service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:06.305383 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-cf78b600-36c9-4db2-b888-2a2ef698c43f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:06.319035 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78b600-36c9-4db2-b888-2a2ef698c43f service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:06.324326 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa3a49-8f3e-4b56-a86e-f6a4304e1282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:06.324890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa3a49-8f3e-4b56-a86e-f6a4304e1282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:06.325155 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa3a49-8f3e-4b56-a86e-f6a4304e1282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:06.325468 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa3a49-8f3e-4b56-a86e-f6a4304e1282 admin admin] PATH_INFO: `/v3/users/a22e284af0b94f9ea41e0c8e64a27a25` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:06.326590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa3a49-8f3e-4b56-a86e-f6a4304e1282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22e284af0b94f9ea41e0c8e64a27a25)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:06.328491 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa3a49-8f3e-4b56-a86e-f6a4304e1282 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:06.456425 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a1aa3a49-8f3e-4b56-a86e-f6a4304e1282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22e284af0b94f9ea41e0c8e64a27a25'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:06.468809 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a1aa3a49-8f3e-4b56-a86e-f6a4304e1282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22e284af0b94f9ea41e0c8e64a27a25'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:06.512032 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a1aa3a49-8f3e-4b56-a86e-f6a4304e1282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22e284af0b94f9ea41e0c8e64a27a25'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:06.521062 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a1aa3a49-8f3e-4b56-a86e-f6a4304e1282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22e284af0b94f9ea41e0c8e64a27a25'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:06.521757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-a1aa3a49-8f3e-4b56-a86e-f6a4304e1282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22e284af0b94f9ea41e0c8e64a27a25'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:06.527978 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1411/2811] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:53:06 2022] DELETE /identity/v3/users/a22e284af0b94f9ea41e0c8e64a27a25 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:06.753092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c60104-1c4f-42a2-8561-8db910188662 service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:06.765336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c60104-1c4f-42a2-8561-8db910188662 service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:06.825905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25769575-de78-4c52-9d7a-650b8b39919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:06.826647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25769575-de78-4c52-9d7a-650b8b39919e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:06.826958 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25769575-de78-4c52-9d7a-650b8b39919e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:06.827230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25769575-de78-4c52-9d7a-650b8b39919e admin admin] PATH_INFO: `/v3/projects/de47b37419894d1382d63efffab00ded` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:06.828349 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25769575-de78-4c52-9d7a-650b8b39919e admin admin] RBAC: Authorizing `identity:delete_project(project_id=de47b37419894d1382d63efffab00ded)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:06.830276 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25769575-de78-4c52-9d7a-650b8b39919e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:06.952945 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-25769575-de78-4c52-9d7a-650b8b39919e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de47b37419894d1382d63efffab00ded', 'request_id': 'req-25769575-de78-4c52-9d7a-650b8b39919e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:07.032113 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-25769575-de78-4c52-9d7a-650b8b39919e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de47b37419894d1382d63efffab00ded', 'request_id': 'req-25769575-de78-4c52-9d7a-650b8b39919e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:07.038155 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-25769575-de78-4c52-9d7a-650b8b39919e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de47b37419894d1382d63efffab00ded', 'request_id': 'req-25769575-de78-4c52-9d7a-650b8b39919e'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:07.049908 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-25769575-de78-4c52-9d7a-650b8b39919e admin admin] The token cache is being invalidate because project de47b37419894d1382d63efffab00ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:53:07.050197 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-25769575-de78-4c52-9d7a-650b8b39919e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:07.050835 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-25769575-de78-4c52-9d7a-650b8b39919e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:07.052336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1401/2812] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:53:06 2022] DELETE /identity/v3/projects/de47b37419894d1382d63efffab00ded => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:07.058930 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb7a1-e443-409b-b60a-ce18ef31ade9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:07.059746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb7a1-e443-409b-b60a-ce18ef31ade9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:07.059746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb7a1-e443-409b-b60a-ce18ef31ade9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:07.064386 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:07.118056 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bddbb7a1-e443-409b-b60a-ce18ef31ade9 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:07.119246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bddbb7a1-e443-409b-b60a-ce18ef31ade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:07.178267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1412/2813] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:07.186773 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e505b-042b-4e9c-890b-60caf63846a9 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:07.187064 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e505b-042b-4e9c-890b-60caf63846a9 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:07.187342 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e505b-042b-4e9c-890b-60caf63846a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:07.207152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-318e505b-042b-4e9c-890b-60caf63846a9 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:07.208370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-318e505b-042b-4e9c-890b-60caf63846a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:07.217303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1402/2814] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:07.221511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbb7a1-e443-409b-b60a-ce18ef31ade9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:07.232451 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbb7a1-e443-409b-b60a-ce18ef31ade9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:07.236972 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e74c2f-d7f2-4fc9-8eaa-2defb99252dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:07.237598 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e74c2f-d7f2-4fc9-8eaa-2defb99252dc admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:07.237906 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e74c2f-d7f2-4fc9-8eaa-2defb99252dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:07.238174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e74c2f-d7f2-4fc9-8eaa-2defb99252dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:07.238813 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e74c2f-d7f2-4fc9-8eaa-2defb99252dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:53:07.239111 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e74c2f-d7f2-4fc9-8eaa-2defb99252dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:07.240689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e74c2f-d7f2-4fc9-8eaa-2defb99252dc admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:07.253370 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1413/2815] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:53:07.257643 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e505b-042b-4e9c-890b-60caf63846a9 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:07.267547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e505b-042b-4e9c-890b-60caf63846a9 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:07.272139 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a15ef-a8f0-4c20-a130-f038409f917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:07.272732 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a15ef-a8f0-4c20-a130-f038409f917e admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:07.273011 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a15ef-a8f0-4c20-a130-f038409f917e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:07.273323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a15ef-a8f0-4c20-a130-f038409f917e admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:07.273956 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a15ef-a8f0-4c20-a130-f038409f917e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:07.275839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a15ef-a8f0-4c20-a130-f038409f917e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:07.289431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:07.364034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1403/2816] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:53:07 2022] POST /identity/v3/projects => generated 361 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:53:07.368393 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e74c2f-d7f2-4fc9-8eaa-2defb99252dc admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:07.378771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e74c2f-d7f2-4fc9-8eaa-2defb99252dc admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:07.435467 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f2359-924d-4cac-9e11-7ce4b147fa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:07.436104 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2359-924d-4cac-9e11-7ce4b147fa4f admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:07.436386 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2359-924d-4cac-9e11-7ce4b147fa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:07.436661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2359-924d-4cac-9e11-7ce4b147fa4f admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:07.437333 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f2359-924d-4cac-9e11-7ce4b147fa4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:07.439234 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f2359-924d-4cac-9e11-7ce4b147fa4f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:07.523012 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1414/2817] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:53:07 2022] POST /identity/v3/users => generated 281 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:53:07.528036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a15ef-a8f0-4c20-a130-f038409f917e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:07.538857 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a15ef-a8f0-4c20-a130-f038409f917e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:07.557731 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ece44-9569-4620-bf75-a4fea99d4e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:07.558828 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ece44-9569-4620-bf75-a4fea99d4e5e admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:07.559101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ece44-9569-4620-bf75-a4fea99d4e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:07.559367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ece44-9569-4620-bf75-a4fea99d4e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:07.560010 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ece44-9569-4620-bf75-a4fea99d4e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:07.561631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ece44-9569-4620-bf75-a4fea99d4e5e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:07.577806 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1404/2818] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:53:07.581980 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f2359-924d-4cac-9e11-7ce4b147fa4f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:07.592390 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f2359-924d-4cac-9e11-7ce4b147fa4f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:07.597162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fcaa4-6e2f-4c7b-8b22-66070009ae1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:07.597786 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fcaa4-6e2f-4c7b-8b22-66070009ae1f admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:07.600440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fcaa4-6e2f-4c7b-8b22-66070009ae1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:07.600440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fcaa4-6e2f-4c7b-8b22-66070009ae1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:07.600440 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fcaa4-6e2f-4c7b-8b22-66070009ae1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:07.600807 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fcaa4-6e2f-4c7b-8b22-66070009ae1f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:07.611202 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1415/2819] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:53:07.615496 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ece44-9569-4620-bf75-a4fea99d4e5e admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:07.627509 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ece44-9569-4620-bf75-a4fea99d4e5e admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:07.632431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968007c-7b85-453b-8e25-a2883aa20ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:07.633072 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968007c-7b85-453b-8e25-a2883aa20ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:07.633384 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968007c-7b85-453b-8e25-a2883aa20ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:07.633658 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968007c-7b85-453b-8e25-a2883aa20ab0 admin admin] PATH_INFO: `/v3/projects/ea72e119051645b5986568fb0addccae/users/8c1c104ed6a448b19aa58445e2819b20/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:07.649470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968007c-7b85-453b-8e25-a2883aa20ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea72e119051645b5986568fb0addccae, user_id=8c1c104ed6a448b19aa58445e2819b20, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:07.652369 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968007c-7b85-453b-8e25-a2883aa20ab0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:07.734950 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1405/2820] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:53:07 2022] PUT /identity/v3/projects/ea72e119051645b5986568fb0addccae/users/8c1c104ed6a448b19aa58445e2819b20/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:07.745192 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac3f62-776e-4bc6-8c47-f5a4cc13913b None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:07.746313 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac3f62-776e-4bc6-8c47-f5a4cc13913b None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:07.746806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac3f62-776e-4bc6-8c47-f5a4cc13913b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:07.775525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1dac3f62-776e-4bc6-8c47-f5a4cc13913b None None] MFA Rules not processed for user `8c1c104ed6a448b19aa58445e2819b20`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:07.776806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1dac3f62-776e-4bc6-8c47-f5a4cc13913b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:07.803358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:07.841852 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1416/2821] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:07.847116 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968007c-7b85-453b-8e25-a2883aa20ab0 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:07.913122 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968007c-7b85-453b-8e25-a2883aa20ab0 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:07.918484 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829e440-94c4-477c-ba55-c2cd208ac493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:07.919105 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829e440-94c4-477c-ba55-c2cd208ac493 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:07.919364 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829e440-94c4-477c-ba55-c2cd208ac493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:07.919636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829e440-94c4-477c-ba55-c2cd208ac493 admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:07.920257 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829e440-94c4-477c-ba55-c2cd208ac493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:07.922204 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829e440-94c4-477c-ba55-c2cd208ac493 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:08.038331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1406/2822] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:53:07 2022] POST /identity/v3/projects => generated 363 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:53:08.043376 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac3f62-776e-4bc6-8c47-f5a4cc13913b None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:08.054294 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac3f62-776e-4bc6-8c47-f5a4cc13913b None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:08.112372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48c865-7771-4d36-a2f3-c75168e3dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:08.112902 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48c865-7771-4d36-a2f3-c75168e3dadf admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:08.113184 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48c865-7771-4d36-a2f3-c75168e3dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:08.113490 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48c865-7771-4d36-a2f3-c75168e3dadf admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:08.114131 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48c865-7771-4d36-a2f3-c75168e3dadf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:08.116171 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48c865-7771-4d36-a2f3-c75168e3dadf admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:08.220927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1417/2823] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:53:08 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:53:08.225286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829e440-94c4-477c-ba55-c2cd208ac493 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:08.236437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829e440-94c4-477c-ba55-c2cd208ac493 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:08.240979 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb56541-0de9-4faa-bcb3-946ebf697de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:08.241748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb56541-0de9-4faa-bcb3-946ebf697de5 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:08.242023 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb56541-0de9-4faa-bcb3-946ebf697de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:08.242290 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb56541-0de9-4faa-bcb3-946ebf697de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:08.242925 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb56541-0de9-4faa-bcb3-946ebf697de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:08.244497 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb56541-0de9-4faa-bcb3-946ebf697de5 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:08.256094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1407/2824] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:53:08.260335 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48c865-7771-4d36-a2f3-c75168e3dadf admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:08.271138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48c865-7771-4d36-a2f3-c75168e3dadf admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:08.275567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93df72c-4a56-4583-b126-a143357b8c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:08.276213 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93df72c-4a56-4583-b126-a143357b8c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:08.276502 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93df72c-4a56-4583-b126-a143357b8c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:08.276754 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93df72c-4a56-4583-b126-a143357b8c5f admin admin] PATH_INFO: `/v3/projects/908ab39670b048ed93ff2a44f99caac3/users/88f2d4bf82844ed693bc93c6799cfe87/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:08.291226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93df72c-4a56-4583-b126-a143357b8c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=908ab39670b048ed93ff2a44f99caac3, user_id=88f2d4bf82844ed693bc93c6799cfe87, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:08.294210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93df72c-4a56-4583-b126-a143357b8c5f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:08.351138 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1418/2825] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:53:08 2022] PUT /identity/v3/projects/908ab39670b048ed93ff2a44f99caac3/users/88f2d4bf82844ed693bc93c6799cfe87/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:08.355008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb56541-0de9-4faa-bcb3-946ebf697de5 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:08.364959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb56541-0de9-4faa-bcb3-946ebf697de5 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:08.422160 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48722c9a-97e7-46c9-b7bb-04c2e3e3be4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:08.422754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48722c9a-97e7-46c9-b7bb-04c2e3e3be4e admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:08.423029 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48722c9a-97e7-46c9-b7bb-04c2e3e3be4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:08.423297 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48722c9a-97e7-46c9-b7bb-04c2e3e3be4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:08.423926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48722c9a-97e7-46c9-b7bb-04c2e3e3be4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:08.425602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48722c9a-97e7-46c9-b7bb-04c2e3e3be4e admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:08.435704 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1408/2826] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:53:08.439825 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93df72c-4a56-4583-b126-a143357b8c5f admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:08.450243 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93df72c-4a56-4583-b126-a143357b8c5f admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:08.455113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36298b40-d2b6-4b12-97e2-e2db5ec105b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:08.455775 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36298b40-d2b6-4b12-97e2-e2db5ec105b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:08.456031 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36298b40-d2b6-4b12-97e2-e2db5ec105b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:08.456298 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36298b40-d2b6-4b12-97e2-e2db5ec105b5 admin admin] PATH_INFO: `/v3/projects/908ab39670b048ed93ff2a44f99caac3/users/88f2d4bf82844ed693bc93c6799cfe87/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:08.458296 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36298b40-d2b6-4b12-97e2-e2db5ec105b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908ab39670b048ed93ff2a44f99caac3, user_id=88f2d4bf82844ed693bc93c6799cfe87, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:08.460926 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36298b40-d2b6-4b12-97e2-e2db5ec105b5 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:08.471407 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1419/2827] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:53:08 2022] PUT /identity/v3/projects/908ab39670b048ed93ff2a44f99caac3/users/88f2d4bf82844ed693bc93c6799cfe87/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:08.483767 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc405f9-6831-4be5-b27f-51a01ac542da None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:08.484056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc405f9-6831-4be5-b27f-51a01ac542da None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:08.484332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc405f9-6831-4be5-b27f-51a01ac542da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:08.514406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-ccc405f9-6831-4be5-b27f-51a01ac542da None None] MFA Rules not processed for user `88f2d4bf82844ed693bc93c6799cfe87`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:08.515886 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-ccc405f9-6831-4be5-b27f-51a01ac542da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:08.522775 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:08.593247 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1409/2828] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:08.604697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36298b40-d2b6-4b12-97e2-e2db5ec105b5 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:08.606902 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-36298b40-d2b6-4b12-97e2-e2db5ec105b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:08.686004 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36298b40-d2b6-4b12-97e2-e2db5ec105b5 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:08.689646 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107dfc3-7aef-4ee4-8106-08363601967b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:08.690246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107dfc3-7aef-4ee4-8106-08363601967b service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:08.690530 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107dfc3-7aef-4ee4-8106-08363601967b service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:08.690806 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107dfc3-7aef-4ee4-8106-08363601967b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:08.700270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107dfc3-7aef-4ee4-8106-08363601967b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:08.701747 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107dfc3-7aef-4ee4-8106-08363601967b service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:08.711218 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1420/2829] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:08.902984 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc405f9-6831-4be5-b27f-51a01ac542da None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:08.912703 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc405f9-6831-4be5-b27f-51a01ac542da None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:08.916226 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca6b65-4100-4b1b-bf60-55c71b39d04e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:08.916815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca6b65-4100-4b1b-bf60-55c71b39d04e service cinder] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:08.917090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca6b65-4100-4b1b-bf60-55c71b39d04e service cinder] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:08.917689 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca6b65-4100-4b1b-bf60-55c71b39d04e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:08.974393 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca6b65-4100-4b1b-bf60-55c71b39d04e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:08.975733 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca6b65-4100-4b1b-bf60-55c71b39d04e service cinder] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:08.985423 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1410/2830] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:09.733345 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107dfc3-7aef-4ee4-8106-08363601967b service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:09.734914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-3107dfc3-7aef-4ee4-8106-08363601967b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:09.740438 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:09.794559 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107dfc3-7aef-4ee4-8106-08363601967b service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:09.798376 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1689a94-0b07-48e7-a7fe-aa5dadf4f96c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:09.799072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1689a94-0b07-48e7-a7fe-aa5dadf4f96c service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:09.799352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1689a94-0b07-48e7-a7fe-aa5dadf4f96c service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:09.799624 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1689a94-0b07-48e7-a7fe-aa5dadf4f96c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:09.801632 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-b1689a94-0b07-48e7-a7fe-aa5dadf4f96c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:09.872595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1689a94-0b07-48e7-a7fe-aa5dadf4f96c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:09.874047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1689a94-0b07-48e7-a7fe-aa5dadf4f96c service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:09.885210 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1421/2831] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:11.071814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca6b65-4100-4b1b-bf60-55c71b39d04e service cinder] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:11.073576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2aca6b65-4100-4b1b-bf60-55c71b39d04e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:11.087085 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca6b65-4100-4b1b-bf60-55c71b39d04e service cinder] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:11.090813 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbee9e-551c-4416-92b9-f6b69d41d210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:11.091433 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbee9e-551c-4416-92b9-f6b69d41d210 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:11.091734 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbee9e-551c-4416-92b9-f6b69d41d210 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:11.091998 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbee9e-551c-4416-92b9-f6b69d41d210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:11.093930 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cbcbee9e-551c-4416-92b9-f6b69d41d210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:11.109865 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbee9e-551c-4416-92b9-f6b69d41d210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:11.111291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbee9e-551c-4416-92b9-f6b69d41d210 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:11.123340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1411/2832] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:12.379434 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1689a94-0b07-48e7-a7fe-aa5dadf4f96c service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:12.445748 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1689a94-0b07-48e7-a7fe-aa5dadf4f96c service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:12.450252 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c144cf-c64b-41f5-b9b9-52acc6ec3523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:12.450871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c144cf-c64b-41f5-b9b9-52acc6ec3523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:12.451142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c144cf-c64b-41f5-b9b9-52acc6ec3523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:12.451412 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c144cf-c64b-41f5-b9b9-52acc6ec3523 admin admin] PATH_INFO: `/v3/users/8c1c104ed6a448b19aa58445e2819b20` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:12.452522 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c144cf-c64b-41f5-b9b9-52acc6ec3523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1c104ed6a448b19aa58445e2819b20)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:12.454447 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c144cf-c64b-41f5-b9b9-52acc6ec3523 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:12.609071 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:12.610619 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7c144cf-c64b-41f5-b9b9-52acc6ec3523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1c104ed6a448b19aa58445e2819b20'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:12.622411 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7c144cf-c64b-41f5-b9b9-52acc6ec3523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1c104ed6a448b19aa58445e2819b20'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:12.693774 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7c144cf-c64b-41f5-b9b9-52acc6ec3523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1c104ed6a448b19aa58445e2819b20'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:12.700823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7c144cf-c64b-41f5-b9b9-52acc6ec3523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1c104ed6a448b19aa58445e2819b20'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:12.701512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7c144cf-c64b-41f5-b9b9-52acc6ec3523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1c104ed6a448b19aa58445e2819b20'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:12.707973 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1422/2833] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:53:12 2022] DELETE /identity/v3/users/8c1c104ed6a448b19aa58445e2819b20 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:12.712177 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68db46-a1ad-4806-a43c-17ae4be19545 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:12.712671 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68db46-a1ad-4806-a43c-17ae4be19545 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:12.712774 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68db46-a1ad-4806-a43c-17ae4be19545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:12.733422 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-af68db46-a1ad-4806-a43c-17ae4be19545 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:12.734625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-af68db46-a1ad-4806-a43c-17ae4be19545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:12.793506 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1412/2834] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:12.803118 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c144cf-c64b-41f5-b9b9-52acc6ec3523 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:12.804566 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-f7c144cf-c64b-41f5-b9b9-52acc6ec3523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:12.865553 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c144cf-c64b-41f5-b9b9-52acc6ec3523 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:12.869129 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bba0f-7996-4400-b591-130a4c76b788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:12.869745 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bba0f-7996-4400-b591-130a4c76b788 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:12.870024 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bba0f-7996-4400-b591-130a4c76b788 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:12.870295 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bba0f-7996-4400-b591-130a4c76b788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:12.879541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bba0f-7996-4400-b591-130a4c76b788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:12.880970 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bba0f-7996-4400-b591-130a4c76b788 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:12.893207 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1423/2835] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:13.289717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68db46-a1ad-4806-a43c-17ae4be19545 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:13.293694 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-af68db46-a1ad-4806-a43c-17ae4be19545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:13.304008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68db46-a1ad-4806-a43c-17ae4be19545 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:13.309412 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:13.310216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:13.310525 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:13.310800 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] PATH_INFO: `/v3/projects/ea72e119051645b5986568fb0addccae` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:13.312059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea72e119051645b5986568fb0addccae)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:13.313881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:13.339612 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:13.431293 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea72e119051645b5986568fb0addccae', 'request_id': 'req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:13.500125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea72e119051645b5986568fb0addccae', 'request_id': 'req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:13.506323 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea72e119051645b5986568fb0addccae', 'request_id': 'req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:13.518690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] The token cache is being invalidate because project ea72e119051645b5986568fb0addccae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:53:13.519018 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:13.519697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:13.521222 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1413/2836] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:53:13 2022] DELETE /identity/v3/projects/ea72e119051645b5986568fb0addccae => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:13.525353 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bba0f-7996-4400-b591-130a4c76b788 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:13.535696 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bba0f-7996-4400-b591-130a4c76b788 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:13.595161 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785a654-2c50-49d9-96f1-f8f9cf339d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:13.596134 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785a654-2c50-49d9-96f1-f8f9cf339d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:13.596523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785a654-2c50-49d9-96f1-f8f9cf339d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:13.596802 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785a654-2c50-49d9-96f1-f8f9cf339d9f admin admin] PATH_INFO: `/v3/users/88f2d4bf82844ed693bc93c6799cfe87` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:13.597962 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785a654-2c50-49d9-96f1-f8f9cf339d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f2d4bf82844ed693bc93c6799cfe87)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:13.599909 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785a654-2c50-49d9-96f1-f8f9cf339d9f admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:13.753871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4785a654-2c50-49d9-96f1-f8f9cf339d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f2d4bf82844ed693bc93c6799cfe87'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:13.765918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4785a654-2c50-49d9-96f1-f8f9cf339d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f2d4bf82844ed693bc93c6799cfe87'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:13.768572 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:13.842261 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4785a654-2c50-49d9-96f1-f8f9cf339d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f2d4bf82844ed693bc93c6799cfe87'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:13.849782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4785a654-2c50-49d9-96f1-f8f9cf339d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f2d4bf82844ed693bc93c6799cfe87'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:13.850420 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4785a654-2c50-49d9-96f1-f8f9cf339d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f2d4bf82844ed693bc93c6799cfe87'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:13.857840 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1424/2837] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:53:13 2022] DELETE /identity/v3/users/88f2d4bf82844ed693bc93c6799cfe87 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:14.267656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:14.269330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:14.283652 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b5a29-d2b4-4dcf-bec8-8a8d13705265 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:14.341135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:14.341787 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:14.342065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:14.342334 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd admin admin] PATH_INFO: `/v3/projects/908ab39670b048ed93ff2a44f99caac3` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:14.343488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=908ab39670b048ed93ff2a44f99caac3)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:14.345349 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:14.471506 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908ab39670b048ed93ff2a44f99caac3', 'request_id': 'req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:14.534065 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908ab39670b048ed93ff2a44f99caac3', 'request_id': 'req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:14.539918 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908ab39670b048ed93ff2a44f99caac3', 'request_id': 'req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:14.552571 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd admin admin] The token cache is being invalidate because project 908ab39670b048ed93ff2a44f99caac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:53:14.552896 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:14.553573 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-3b30c109-cc10-4f0a-a9e6-25c9bf53d6cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:14.555038 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1414/2838] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:53:14 2022] DELETE /identity/v3/projects/908ab39670b048ed93ff2a44f99caac3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:14.561665 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688b02f-9fc6-4eb7-9692-bf4ae9482d62 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:14.562191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688b02f-9fc6-4eb7-9692-bf4ae9482d62 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:14.562191 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688b02f-9fc6-4eb7-9692-bf4ae9482d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:14.581631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-6688b02f-9fc6-4eb7-9692-bf4ae9482d62 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:14.582820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-6688b02f-9fc6-4eb7-9692-bf4ae9482d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:14.645361 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1425/2839] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:14.653187 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e890b2-eb45-4480-911b-2be03d9fc4e7 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:14.653519 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e890b2-eb45-4480-911b-2be03d9fc4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:14.653791 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e890b2-eb45-4480-911b-2be03d9fc4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:14.674790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-80e890b2-eb45-4480-911b-2be03d9fc4e7 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:14.676034 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-80e890b2-eb45-4480-911b-2be03d9fc4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:14.684717 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1415/2840] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:14.688979 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688b02f-9fc6-4eb7-9692-bf4ae9482d62 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:14.702429 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688b02f-9fc6-4eb7-9692-bf4ae9482d62 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:14.707162 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56733a33-69a3-4cdf-ae10-e1be689c12ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:14.707692 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56733a33-69a3-4cdf-ae10-e1be689c12ae admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:14.708009 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56733a33-69a3-4cdf-ae10-e1be689c12ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:14.708287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56733a33-69a3-4cdf-ae10-e1be689c12ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:14.708941 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56733a33-69a3-4cdf-ae10-e1be689c12ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81645) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:53:14.709273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56733a33-69a3-4cdf-ae10-e1be689c12ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:14.710892 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56733a33-69a3-4cdf-ae10-e1be689c12ae admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:14.723575 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1426/2841] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:53:14.727880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e890b2-eb45-4480-911b-2be03d9fc4e7 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:14.738905 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e890b2-eb45-4480-911b-2be03d9fc4e7 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:14.743789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb0493-f79f-4c38-b0c6-5c51caa208db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:14.744396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0493-f79f-4c38-b0c6-5c51caa208db admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:14.744669 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0493-f79f-4c38-b0c6-5c51caa208db admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:14.744944 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0493-f79f-4c38-b0c6-5c51caa208db admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:14.745727 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb0493-f79f-4c38-b0c6-5c51caa208db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:14.748814 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb0493-f79f-4c38-b0c6-5c51caa208db admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:14.821653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1416/2842] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:53:14 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:53:14.825963 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56733a33-69a3-4cdf-ae10-e1be689c12ae admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:14.836281 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56733a33-69a3-4cdf-ae10-e1be689c12ae admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:14.895525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9087fd4-dd71-4d44-b056-00c9b05d0c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:14.896052 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087fd4-dd71-4d44-b056-00c9b05d0c4a admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:14.896332 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087fd4-dd71-4d44-b056-00c9b05d0c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:14.896607 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087fd4-dd71-4d44-b056-00c9b05d0c4a admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:14.897289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9087fd4-dd71-4d44-b056-00c9b05d0c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:14.899203 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9087fd4-dd71-4d44-b056-00c9b05d0c4a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:14.956934 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1427/2843] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:53:14 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:53:14.961228 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb0493-f79f-4c38-b0c6-5c51caa208db admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:14.972350 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb0493-f79f-4c38-b0c6-5c51caa208db admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:14.977330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d21e01-70cb-4911-8a19-2968d6e3d45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:14.977959 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d21e01-70cb-4911-8a19-2968d6e3d45c admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:14.978286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d21e01-70cb-4911-8a19-2968d6e3d45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:14.978564 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d21e01-70cb-4911-8a19-2968d6e3d45c admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:14.979236 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d21e01-70cb-4911-8a19-2968d6e3d45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:14.981489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d21e01-70cb-4911-8a19-2968d6e3d45c admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:14.991395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1417/2844] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:53:14.995263 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9087fd4-dd71-4d44-b056-00c9b05d0c4a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:15.005340 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9087fd4-dd71-4d44-b056-00c9b05d0c4a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:15.009872 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777c78b-93d3-4fa9-ae3f-993f69747908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:15.010450 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777c78b-93d3-4fa9-ae3f-993f69747908 admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:15.010726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777c78b-93d3-4fa9-ae3f-993f69747908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:15.010993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777c78b-93d3-4fa9-ae3f-993f69747908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:15.011666 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777c78b-93d3-4fa9-ae3f-993f69747908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:15.013247 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777c78b-93d3-4fa9-ae3f-993f69747908 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:15.023591 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1428/2845] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:53:15.027982 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d21e01-70cb-4911-8a19-2968d6e3d45c admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:15.033119 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:15.038396 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d21e01-70cb-4911-8a19-2968d6e3d45c admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:15.046660 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061fd0f-8c56-4dc2-b714-a9c491990775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:15.047378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061fd0f-8c56-4dc2-b714-a9c491990775 admin admin] REQUEST_METHOD: `PUT` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:15.047662 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061fd0f-8c56-4dc2-b714-a9c491990775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:15.047940 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061fd0f-8c56-4dc2-b714-a9c491990775 admin admin] PATH_INFO: `/v3/projects/6bb8658d18c845a0a29a4def54189482/users/0349bba3eaf1465d908b64d15999bc95/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:15.063479 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061fd0f-8c56-4dc2-b714-a9c491990775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bb8658d18c845a0a29a4def54189482, user_id=0349bba3eaf1465d908b64d15999bc95, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:15.066479 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061fd0f-8c56-4dc2-b714-a9c491990775 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:15.111367 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1418/2846] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:53:15 2022] PUT /identity/v3/projects/6bb8658d18c845a0a29a4def54189482/users/0349bba3eaf1465d908b64d15999bc95/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:53:15.121759 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fdd1b-6d63-42d4-8d10-c14a68c630b9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:15.122045 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fdd1b-6d63-42d4-8d10-c14a68c630b9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:15.122318 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154fdd1b-6d63-42d4-8d10-c14a68c630b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:15.149935 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-154fdd1b-6d63-42d4-8d10-c14a68c630b9 None None] MFA Rules not processed for user `0349bba3eaf1465d908b64d15999bc95`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:15.151070 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-154fdd1b-6d63-42d4-8d10-c14a68c630b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:15.191074 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:15.216524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1429/2847] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:15.221000 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061fd0f-8c56-4dc2-b714-a9c491990775 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:15.283195 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061fd0f-8c56-4dc2-b714-a9c491990775 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:15.287972 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384a1de-5751-4e79-a358-c7a0ab8731df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:15.288572 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384a1de-5751-4e79-a358-c7a0ab8731df admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:15.288848 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384a1de-5751-4e79-a358-c7a0ab8731df admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:15.289125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384a1de-5751-4e79-a358-c7a0ab8731df admin admin] PATH_INFO: `/v3/projects` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:15.289786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384a1de-5751-4e79-a358-c7a0ab8731df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:15.291697 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384a1de-5751-4e79-a358-c7a0ab8731df admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:15.369109 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1419/2848] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:53:15 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:53:15.373306 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fdd1b-6d63-42d4-8d10-c14a68c630b9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:15.384277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154fdd1b-6d63-42d4-8d10-c14a68c630b9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:15.440292 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19425c70-8477-4a40-8ac0-5506ad25eee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:15.440820 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19425c70-8477-4a40-8ac0-5506ad25eee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:15.441101 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19425c70-8477-4a40-8ac0-5506ad25eee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:15.441405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19425c70-8477-4a40-8ac0-5506ad25eee2 admin admin] PATH_INFO: `/v3/users` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:15.442055 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19425c70-8477-4a40-8ac0-5506ad25eee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:15.443961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19425c70-8477-4a40-8ac0-5506ad25eee2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:15.510612 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1430/2849] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:53:15 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:53:15.515211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384a1de-5751-4e79-a358-c7a0ab8731df admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:15.525552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384a1de-5751-4e79-a358-c7a0ab8731df admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:15.530287 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81d099-db9d-4e27-bc1d-30660bbec592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:15.530885 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81d099-db9d-4e27-bc1d-30660bbec592 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:15.531165 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81d099-db9d-4e27-bc1d-30660bbec592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:15.531437 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81d099-db9d-4e27-bc1d-30660bbec592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:15.532079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81d099-db9d-4e27-bc1d-30660bbec592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:15.533700 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81d099-db9d-4e27-bc1d-30660bbec592 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:15.544929 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1420/2850] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:53:15.549042 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19425c70-8477-4a40-8ac0-5506ad25eee2 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:15.559771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19425c70-8477-4a40-8ac0-5506ad25eee2 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:15.564541 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9525fc-283d-4cdf-af95-c9ef4e52d91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:15.565278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9525fc-283d-4cdf-af95-c9ef4e52d91a admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:15.565562 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9525fc-283d-4cdf-af95-c9ef4e52d91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:15.565836 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9525fc-283d-4cdf-af95-c9ef4e52d91a admin admin] PATH_INFO: `/v3/projects/6326f2f9cd024601acb25afdfc7490b8/users/870f375a193d4a0db71a542925a13cab/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:15.581726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9525fc-283d-4cdf-af95-c9ef4e52d91a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6326f2f9cd024601acb25afdfc7490b8, user_id=870f375a193d4a0db71a542925a13cab, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:15.584511 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9525fc-283d-4cdf-af95-c9ef4e52d91a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:15.665283 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1431/2851] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:53:15 2022] PUT /identity/v3/projects/6326f2f9cd024601acb25afdfc7490b8/users/870f375a193d4a0db71a542925a13cab/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:15.670023 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81d099-db9d-4e27-bc1d-30660bbec592 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:15.680036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81d099-db9d-4e27-bc1d-30660bbec592 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:15.737294 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade8eda-2fcb-400d-ac7b-97a9ff185421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:15.737824 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8eda-2fcb-400d-ac7b-97a9ff185421 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:15.738107 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8eda-2fcb-400d-ac7b-97a9ff185421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:15.738379 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8eda-2fcb-400d-ac7b-97a9ff185421 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:15.739018 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade8eda-2fcb-400d-ac7b-97a9ff185421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:15.740598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade8eda-2fcb-400d-ac7b-97a9ff185421 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:15.750893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1421/2852] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:53:15.755142 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9525fc-283d-4cdf-af95-c9ef4e52d91a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:15.768426 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9525fc-283d-4cdf-af95-c9ef4e52d91a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:15.773124 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad195b-77fe-4544-8050-8e84a365bfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:15.773801 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad195b-77fe-4544-8050-8e84a365bfff admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:15.774084 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad195b-77fe-4544-8050-8e84a365bfff admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:15.774363 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad195b-77fe-4544-8050-8e84a365bfff admin admin] PATH_INFO: `/v3/projects/6326f2f9cd024601acb25afdfc7490b8/users/870f375a193d4a0db71a542925a13cab/roles/1896db68dc754d5293037ab100ce46d9` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:15.776286 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad195b-77fe-4544-8050-8e84a365bfff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6326f2f9cd024601acb25afdfc7490b8, user_id=870f375a193d4a0db71a542925a13cab, role_id=1896db68dc754d5293037ab100ce46d9)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:15.778990 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad195b-77fe-4544-8050-8e84a365bfff admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:15.789090 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1432/2853] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:53:15 2022] PUT /identity/v3/projects/6326f2f9cd024601acb25afdfc7490b8/users/870f375a193d4a0db71a542925a13cab/roles/1896db68dc754d5293037ab100ce46d9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:15.801015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbec9d-dbdb-43e0-b587-a4b38156c10f None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:15.801340 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbec9d-dbdb-43e0-b587-a4b38156c10f None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:15.801620 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbec9d-dbdb-43e0-b587-a4b38156c10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:15.832036 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-d3cbec9d-dbdb-43e0-b587-a4b38156c10f None None] MFA Rules not processed for user `870f375a193d4a0db71a542925a13cab`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:15.833272 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-d3cbec9d-dbdb-43e0-b587-a4b38156c10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:15.873490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:15.904512 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1422/2854] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:15.915538 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad195b-77fe-4544-8050-8e84a365bfff admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:15.917340 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-73ad195b-77fe-4544-8050-8e84a365bfff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:15.977609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad195b-77fe-4544-8050-8e84a365bfff admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:15.981777 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ada40e-c2da-420c-8f92-e51f1cda1b76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:15.982372 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ada40e-c2da-420c-8f92-e51f1cda1b76 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:15.982649 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ada40e-c2da-420c-8f92-e51f1cda1b76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:15.982919 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ada40e-c2da-420c-8f92-e51f1cda1b76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:15.992226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ada40e-c2da-420c-8f92-e51f1cda1b76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:15.993627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ada40e-c2da-420c-8f92-e51f1cda1b76 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:16.003845 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1433/2855] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:18.756682 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbec9d-dbdb-43e0-b587-a4b38156c10f None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:18.821116 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbec9d-dbdb-43e0-b587-a4b38156c10f None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:18.826332 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ea9b9-1d3e-499c-a2fb-c649ae28cbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:18.826953 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ea9b9-1d3e-499c-a2fb-c649ae28cbfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:18.827230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ea9b9-1d3e-499c-a2fb-c649ae28cbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:18.827499 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ea9b9-1d3e-499c-a2fb-c649ae28cbfa admin admin] PATH_INFO: `/v3/users/0349bba3eaf1465d908b64d15999bc95` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:18.828610 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ea9b9-1d3e-499c-a2fb-c649ae28cbfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0349bba3eaf1465d908b64d15999bc95)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:18.830566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ea9b9-1d3e-499c-a2fb-c649ae28cbfa admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:18.992673 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c5ea9b9-1d3e-499c-a2fb-c649ae28cbfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0349bba3eaf1465d908b64d15999bc95'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:18.993364 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c5ea9b9-1d3e-499c-a2fb-c649ae28cbfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0349bba3eaf1465d908b64d15999bc95'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:19.005310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c5ea9b9-1d3e-499c-a2fb-c649ae28cbfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0349bba3eaf1465d908b64d15999bc95'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:19.012092 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c5ea9b9-1d3e-499c-a2fb-c649ae28cbfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0349bba3eaf1465d908b64d15999bc95'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:19.012754 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-2c5ea9b9-1d3e-499c-a2fb-c649ae28cbfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0349bba3eaf1465d908b64d15999bc95'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:19.077434 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1423/2856] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:53:18 2022] DELETE /identity/v3/users/0349bba3eaf1465d908b64d15999bc95 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:19.081895 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae0979-885b-4192-93d8-5fda765c2075 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:19.082392 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae0979-885b-4192-93d8-5fda765c2075 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:19.082503 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae0979-885b-4192-93d8-5fda765c2075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:19.102186 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-40ae0979-885b-4192-93d8-5fda765c2075 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:19.103394 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-40ae0979-885b-4192-93d8-5fda765c2075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:19.134644 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:19.164763 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1434/2857] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:19.175108 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ea9b9-1d3e-499c-a2fb-c649ae28cbfa admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:19.177330 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-2c5ea9b9-1d3e-499c-a2fb-c649ae28cbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:19.234825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ea9b9-1d3e-499c-a2fb-c649ae28cbfa admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:19.238500 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ccf62-c9b9-474b-b83d-b8be29bb8542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:19.239099 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ccf62-c9b9-474b-b83d-b8be29bb8542 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:19.239378 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ccf62-c9b9-474b-b83d-b8be29bb8542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:19.239649 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ccf62-c9b9-474b-b83d-b8be29bb8542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:19.246542 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:19.249768 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ccf62-c9b9-474b-b83d-b8be29bb8542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:19.251181 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ccf62-c9b9-474b-b83d-b8be29bb8542 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:19.260782 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1424/2858] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:19.678899 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae0979-885b-4192-93d8-5fda765c2075 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:19.680318 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-40ae0979-885b-4192-93d8-5fda765c2075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:19.695098 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae0979-885b-4192-93d8-5fda765c2075 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:19.700672 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:19.705330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:19.705330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:19.705330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] PATH_INFO: `/v3/projects/6bb8658d18c845a0a29a4def54189482` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:19.705330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bb8658d18c845a0a29a4def54189482)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:19.706443 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:19.848196 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bb8658d18c845a0a29a4def54189482', 'request_id': 'req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:19.922494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bb8658d18c845a0a29a4def54189482', 'request_id': 'req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:19.928721 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bb8658d18c845a0a29a4def54189482', 'request_id': 'req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:19.939880 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] The token cache is being invalidate because project 6bb8658d18c845a0a29a4def54189482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:53:19.942943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:19.942943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:19.942943 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1435/2859] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:53:19 2022] DELETE /identity/v3/projects/6bb8658d18c845a0a29a4def54189482 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:19.946333 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ccf62-c9b9-474b-b83d-b8be29bb8542 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:19.957110 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ccf62-c9b9-474b-b83d-b8be29bb8542 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:20.015589 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436f2d6-1a32-45f0-b6e4-2862ef16bbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:20.016211 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436f2d6-1a32-45f0-b6e4-2862ef16bbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:20.016488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436f2d6-1a32-45f0-b6e4-2862ef16bbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:20.016757 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436f2d6-1a32-45f0-b6e4-2862ef16bbe0 admin admin] PATH_INFO: `/v3/users/870f375a193d4a0db71a542925a13cab` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:20.017882 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436f2d6-1a32-45f0-b6e4-2862ef16bbe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870f375a193d4a0db71a542925a13cab)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:20.019974 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436f2d6-1a32-45f0-b6e4-2862ef16bbe0 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:20.245857 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c436f2d6-1a32-45f0-b6e4-2862ef16bbe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870f375a193d4a0db71a542925a13cab'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:20.246509 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c436f2d6-1a32-45f0-b6e4-2862ef16bbe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870f375a193d4a0db71a542925a13cab'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:20.259395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c436f2d6-1a32-45f0-b6e4-2862ef16bbe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870f375a193d4a0db71a542925a13cab'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:20.266890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c436f2d6-1a32-45f0-b6e4-2862ef16bbe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870f375a193d4a0db71a542925a13cab'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:20.267600 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-c436f2d6-1a32-45f0-b6e4-2862ef16bbe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870f375a193d4a0db71a542925a13cab'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:20.339789 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1425/2860] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:53:19 2022] DELETE /identity/v3/users/870f375a193d4a0db71a542925a13cab => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:20.947187 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:20.950273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:20.964096 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501fadd-4677-4fc4-a0e5-2f575e56b4d0 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:21.035232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2133280-fc58-4a71-98d2-f77276f995ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:21.035910 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2133280-fc58-4a71-98d2-f77276f995ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:21.036232 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2133280-fc58-4a71-98d2-f77276f995ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:21.036550 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2133280-fc58-4a71-98d2-f77276f995ce admin admin] PATH_INFO: `/v3/projects/6326f2f9cd024601acb25afdfc7490b8` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:21.037807 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2133280-fc58-4a71-98d2-f77276f995ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=6326f2f9cd024601acb25afdfc7490b8)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:21.039756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2133280-fc58-4a71-98d2-f77276f995ce admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:21.146163 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e2133280-fc58-4a71-98d2-f77276f995ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6326f2f9cd024601acb25afdfc7490b8', 'request_id': 'req-e2133280-fc58-4a71-98d2-f77276f995ce'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:21.196524 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e2133280-fc58-4a71-98d2-f77276f995ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6326f2f9cd024601acb25afdfc7490b8', 'request_id': 'req-e2133280-fc58-4a71-98d2-f77276f995ce'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:21.200608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:21.203864 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e2133280-fc58-4a71-98d2-f77276f995ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6326f2f9cd024601acb25afdfc7490b8', 'request_id': 'req-e2133280-fc58-4a71-98d2-f77276f995ce'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:21.214940 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e2133280-fc58-4a71-98d2-f77276f995ce admin admin] The token cache is being invalidate because project 6326f2f9cd024601acb25afdfc7490b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:53:21.215227 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e2133280-fc58-4a71-98d2-f77276f995ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:21.215858 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e2133280-fc58-4a71-98d2-f77276f995ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:21.217983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1436/2861] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:53:20 2022] DELETE /identity/v3/projects/6326f2f9cd024601acb25afdfc7490b8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:53:21.222886 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4175b-dc3a-40bb-b3f4-c24c32237a73 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:21.223384 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4175b-dc3a-40bb-b3f4-c24c32237a73 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:21.223489 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4175b-dc3a-40bb-b3f4-c24c32237a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:21.243909 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-a6f4175b-dc3a-40bb-b3f4-c24c32237a73 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:21.245058 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-a6f4175b-dc3a-40bb-b3f4-c24c32237a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:21.306137 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1426/2862] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:21.314952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3071af1-0634-40c9-a92e-4b851bd3c031 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:21.315267 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3071af1-0634-40c9-a92e-4b851bd3c031 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:21.315567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3071af1-0634-40c9-a92e-4b851bd3c031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:21.335514 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-c3071af1-0634-40c9-a92e-4b851bd3c031 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:21.336702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-c3071af1-0634-40c9-a92e-4b851bd3c031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:21.344452 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1437/2863] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:21.348509 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4175b-dc3a-40bb-b3f4-c24c32237a73 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:21.358318 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4175b-dc3a-40bb-b3f4-c24c32237a73 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:21.362845 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae18c6-d401-4535-a0a5-676c2c16a62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:21.363464 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae18c6-d401-4535-a0a5-676c2c16a62d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:21.363743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae18c6-d401-4535-a0a5-676c2c16a62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:21.364027 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae18c6-d401-4535-a0a5-676c2c16a62d admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:21.364666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae18c6-d401-4535-a0a5-676c2c16a62d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:53:21.364967 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae18c6-d401-4535-a0a5-676c2c16a62d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:21.366592 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae18c6-d401-4535-a0a5-676c2c16a62d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:21.379071 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1427/2864] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:53:21.383113 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3071af1-0634-40c9-a92e-4b851bd3c031 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:21.393136 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3071af1-0634-40c9-a92e-4b851bd3c031 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:21.397709 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f47ee-b770-476f-a8d9-72d25366a27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:21.398293 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f47ee-b770-476f-a8d9-72d25366a27c admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:21.398568 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f47ee-b770-476f-a8d9-72d25366a27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:21.398838 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f47ee-b770-476f-a8d9-72d25366a27c admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:21.399469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f47ee-b770-476f-a8d9-72d25366a27c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:21.401355 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f47ee-b770-476f-a8d9-72d25366a27c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:21.484059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1438/2865] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:53:21 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:53:21.488183 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae18c6-d401-4535-a0a5-676c2c16a62d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:21.493370 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:21.500593 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae18c6-d401-4535-a0a5-676c2c16a62d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:21.556825 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b2311-96ce-467d-8227-c39c2350fc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:21.557465 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b2311-96ce-467d-8227-c39c2350fc0a admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:21.557890 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b2311-96ce-467d-8227-c39c2350fc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:21.558159 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b2311-96ce-467d-8227-c39c2350fc0a admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:21.558799 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b2311-96ce-467d-8227-c39c2350fc0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:21.560777 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b2311-96ce-467d-8227-c39c2350fc0a admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:21.615144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1428/2866] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:53:21 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:53:21.619278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f47ee-b770-476f-a8d9-72d25366a27c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:21.630635 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f47ee-b770-476f-a8d9-72d25366a27c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:21.635246 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa8c89-5487-4cfe-a783-eb1b10d3fa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:21.635913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa8c89-5487-4cfe-a783-eb1b10d3fa5c admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:21.636193 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa8c89-5487-4cfe-a783-eb1b10d3fa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:21.636464 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa8c89-5487-4cfe-a783-eb1b10d3fa5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:21.637107 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa8c89-5487-4cfe-a783-eb1b10d3fa5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:21.638735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa8c89-5487-4cfe-a783-eb1b10d3fa5c admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:21.648748 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1439/2867] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:53:21.652729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b2311-96ce-467d-8227-c39c2350fc0a admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:21.662893 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b2311-96ce-467d-8227-c39c2350fc0a admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:21.667795 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9b6e6-d2c2-4534-8232-72fe99cfe4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:21.668380 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9b6e6-d2c2-4534-8232-72fe99cfe4fa admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:21.668656 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9b6e6-d2c2-4534-8232-72fe99cfe4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:21.668943 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9b6e6-d2c2-4534-8232-72fe99cfe4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:21.669641 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9b6e6-d2c2-4534-8232-72fe99cfe4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:21.671938 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9b6e6-d2c2-4534-8232-72fe99cfe4fa admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:21.681867 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1429/2868] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:53:21.686637 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa8c89-5487-4cfe-a783-eb1b10d3fa5c admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:21.696567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa8c89-5487-4cfe-a783-eb1b10d3fa5c admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:21.701095 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1ac6d-ff69-4e5a-bd7a-433914144701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:21.702011 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1ac6d-ff69-4e5a-bd7a-433914144701 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:21.702339 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1ac6d-ff69-4e5a-bd7a-433914144701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:21.702611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1ac6d-ff69-4e5a-bd7a-433914144701 admin admin] PATH_INFO: `/v3/projects/2548226bc5404a9e8030d2b4d2c0da7b/users/b444a5e84d9447f2a5aa516e5b0d5072/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:21.716794 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1ac6d-ff69-4e5a-bd7a-433914144701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2548226bc5404a9e8030d2b4d2c0da7b, user_id=b444a5e84d9447f2a5aa516e5b0d5072, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:21.719590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1ac6d-ff69-4e5a-bd7a-433914144701 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:21.803718 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1440/2869] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:53:21 2022] PUT /identity/v3/projects/2548226bc5404a9e8030d2b4d2c0da7b/users/b444a5e84d9447f2a5aa516e5b0d5072/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:21.870690 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e36537-1f90-4a63-8c45-4669b4192e03 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:21.870980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e36537-1f90-4a63-8c45-4669b4192e03 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:21.871259 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e36537-1f90-4a63-8c45-4669b4192e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:21.900537 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-e9e36537-1f90-4a63-8c45-4669b4192e03 None None] MFA Rules not processed for user `b444a5e84d9447f2a5aa516e5b0d5072`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:21.901781 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e9e36537-1f90-4a63-8c45-4669b4192e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:21.969631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1430/2870] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:21.982304 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1ac6d-ff69-4e5a-bd7a-433914144701 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:21.985590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-abf1ac6d-ff69-4e5a-bd7a-433914144701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:22.044041 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1ac6d-ff69-4e5a-bd7a-433914144701 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:22.048421 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb9363-f4b3-4cee-b132-c0485127fb6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:22.049020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb9363-f4b3-4cee-b132-c0485127fb6f service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:22.049347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb9363-f4b3-4cee-b132-c0485127fb6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:22.049627 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb9363-f4b3-4cee-b132-c0485127fb6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:22.058419 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb9363-f4b3-4cee-b132-c0485127fb6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:22.063471 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb9363-f4b3-4cee-b132-c0485127fb6f service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:22.069296 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1441/2871] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:24.714392 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b9a29-d1d7-4d62-bc8d-8c9fbde94e98 None None] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:24.715005 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b9a29-d1d7-4d62-bc8d-8c9fbde94e98 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:24.715123 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b9a29-d1d7-4d62-bc8d-8c9fbde94e98 None None] PATH_INFO: `/` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:24.716414 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1431/2872] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 31 04:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:53:24.722827 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae8ac8-edc4-4f7f-ae6f-78cb2c1ddfb5 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:24.723358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae8ac8-edc4-4f7f-ae6f-78cb2c1ddfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:24.723471 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae8ac8-edc4-4f7f-ae6f-78cb2c1ddfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:24.767876 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-8cae8ac8-edc4-4f7f-ae6f-78cb2c1ddfb5 None None] MFA Rules not processed for user `2c63e7e4105b41d1abfe58bf13c6125d`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:24.769079 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8cae8ac8-edc4-4f7f-ae6f-78cb2c1ddfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:24.821367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1442/2873] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 31 04:53:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:24.833407 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b9a29-d1d7-4d62-bc8d-8c9fbde94e98 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:24.835017 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-971b9a29-d1d7-4d62-bc8d-8c9fbde94e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:24.848818 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b9a29-d1d7-4d62-bc8d-8c9fbde94e98 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:24.852278 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cccd1-d3ce-4652-9b49-68a676969bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:24.852857 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cccd1-d3ce-4652-9b49-68a676969bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:24.853130 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cccd1-d3ce-4652-9b49-68a676969bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:24.853444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cccd1-d3ce-4652-9b49-68a676969bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:24.860262 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cccd1-d3ce-4652-9b49-68a676969bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:24.862657 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cccd1-d3ce-4652-9b49-68a676969bd5 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:24.870566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1432/2874] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:24.954550 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df42cb5-962e-4328-ba47-78b2ac28a884 None None] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:24.954842 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df42cb5-962e-4328-ba47-78b2ac28a884 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:24.955175 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df42cb5-962e-4328-ba47-78b2ac28a884 None None] PATH_INFO: `/` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:24.956589 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1443/2875] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 31 04:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:53:24.961974 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e564e5f-2721-481d-8502-b787aa29d126 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:24.962257 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e564e5f-2721-481d-8502-b787aa29d126 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:24.962527 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e564e5f-2721-481d-8502-b787aa29d126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:25.001864 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8e564e5f-2721-481d-8502-b787aa29d126 None None] MFA Rules not processed for user `4877b72a6cea410dbb31a35c7acbd5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:25.003227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8e564e5f-2721-481d-8502-b787aa29d126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:25.043399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:25.070478 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1433/2876] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 31 04:53:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:25.081278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df42cb5-962e-4328-ba47-78b2ac28a884 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:25.092314 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df42cb5-962e-4328-ba47-78b2ac28a884 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:25.096272 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b559d55-d881-40c6-95bc-29de7ae135bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:25.096936 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b559d55-d881-40c6-95bc-29de7ae135bd service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:25.097225 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b559d55-d881-40c6-95bc-29de7ae135bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:25.097512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b559d55-d881-40c6-95bc-29de7ae135bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:25.107344 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b559d55-d881-40c6-95bc-29de7ae135bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:25.108756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b559d55-d881-40c6-95bc-29de7ae135bd service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:25.120156 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1444/2877] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:35.088046 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=11 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:35.115506 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=1,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:36.637266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e564e5f-2721-481d-8502-b787aa29d126 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:36.700532 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e564e5f-2721-481d-8502-b787aa29d126 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:36.705008 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808a528-199c-4fdb-bf6f-c81186d00f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:36.705853 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808a528-199c-4fdb-bf6f-c81186d00f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:36.706208 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808a528-199c-4fdb-bf6f-c81186d00f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:36.706482 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808a528-199c-4fdb-bf6f-c81186d00f43 admin admin] PATH_INFO: `/v3/users/b444a5e84d9447f2a5aa516e5b0d5072` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:36.707594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808a528-199c-4fdb-bf6f-c81186d00f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b444a5e84d9447f2a5aa516e5b0d5072)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:36.709517 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808a528-199c-4fdb-bf6f-c81186d00f43 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:36.877845 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b808a528-199c-4fdb-bf6f-c81186d00f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b444a5e84d9447f2a5aa516e5b0d5072'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:36.878602 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b808a528-199c-4fdb-bf6f-c81186d00f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b444a5e84d9447f2a5aa516e5b0d5072'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:36.890762 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b808a528-199c-4fdb-bf6f-c81186d00f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b444a5e84d9447f2a5aa516e5b0d5072'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:36.897613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b808a528-199c-4fdb-bf6f-c81186d00f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b444a5e84d9447f2a5aa516e5b0d5072'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:36.898282 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-b808a528-199c-4fdb-bf6f-c81186d00f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b444a5e84d9447f2a5aa516e5b0d5072'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:36.949576 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1434/2878] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:53:36 2022] DELETE /identity/v3/users/b444a5e84d9447f2a5aa516e5b0d5072 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:36.954196 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dbe09-7bb8-46a0-ab38-e961cd8898b9 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:36.954697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dbe09-7bb8-46a0-ab38-e961cd8898b9 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:36.954813 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dbe09-7bb8-46a0-ab38-e961cd8898b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:36.973961 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-bf8dbe09-7bb8-46a0-ab38-e961cd8898b9 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:36.975147 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bf8dbe09-7bb8-46a0-ab38-e961cd8898b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:37.033002 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1445/2879] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:37.043720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808a528-199c-4fdb-bf6f-c81186d00f43 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:37.045125 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-b808a528-199c-4fdb-bf6f-c81186d00f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:37.102385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808a528-199c-4fdb-bf6f-c81186d00f43 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:37.106179 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4c66c-26d4-4ce5-aa47-1f8a6d79a2cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:37.106786 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4c66c-26d4-4ce5-aa47-1f8a6d79a2cf service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:37.107068 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4c66c-26d4-4ce5-aa47-1f8a6d79a2cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:37.107347 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4c66c-26d4-4ce5-aa47-1f8a6d79a2cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:37.116913 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4c66c-26d4-4ce5-aa47-1f8a6d79a2cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:37.118476 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4c66c-26d4-4ce5-aa47-1f8a6d79a2cf service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:37.127843 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1435/2880] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:37.506966 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dbe09-7bb8-46a0-ab38-e961cd8898b9 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:37.508444 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-bf8dbe09-7bb8-46a0-ab38-e961cd8898b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:37.521826 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dbe09-7bb8-46a0-ab38-e961cd8898b9 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:37.526689 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd83cef-58a4-470d-973e-fa74da0edb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:37.527302 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83cef-58a4-470d-973e-fa74da0edb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:37.527581 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83cef-58a4-470d-973e-fa74da0edb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:37.527855 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83cef-58a4-470d-973e-fa74da0edb08 admin admin] PATH_INFO: `/v3/projects/2548226bc5404a9e8030d2b4d2c0da7b` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:37.528983 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd83cef-58a4-470d-973e-fa74da0edb08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2548226bc5404a9e8030d2b4d2c0da7b)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:37.531020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd83cef-58a4-470d-973e-fa74da0edb08 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:37.637249 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7dd83cef-58a4-470d-973e-fa74da0edb08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2548226bc5404a9e8030d2b4d2c0da7b', 'request_id': 'req-7dd83cef-58a4-470d-973e-fa74da0edb08'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:37.704534 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7dd83cef-58a4-470d-973e-fa74da0edb08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2548226bc5404a9e8030d2b4d2c0da7b', 'request_id': 'req-7dd83cef-58a4-470d-973e-fa74da0edb08'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:37.711397 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7dd83cef-58a4-470d-973e-fa74da0edb08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2548226bc5404a9e8030d2b4d2c0da7b', 'request_id': 'req-7dd83cef-58a4-470d-973e-fa74da0edb08'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:37.722856 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7dd83cef-58a4-470d-973e-fa74da0edb08 admin admin] The token cache is being invalidate because project 2548226bc5404a9e8030d2b4d2c0da7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:53:37.723139 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7dd83cef-58a4-470d-973e-fa74da0edb08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:37.723756 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-7dd83cef-58a4-470d-973e-fa74da0edb08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:37.725284 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1446/2881] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:53:37 2022] DELETE /identity/v3/projects/2548226bc5404a9e8030d2b4d2c0da7b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:37.730215 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7db81-ec67-4848-a92e-1e021c82099e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:37.730748 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7db81-ec67-4848-a92e-1e021c82099e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:37.730971 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7db81-ec67-4848-a92e-1e021c82099e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:37.750321 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3eb7db81-ec67-4848-a92e-1e021c82099e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:37.751526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3eb7db81-ec67-4848-a92e-1e021c82099e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:37.769549 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:37.811121 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1436/2882] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:37.819621 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7152fa-84d5-4849-aa00-da077266d0de None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:37.819913 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7152fa-84d5-4849-aa00-da077266d0de None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:37.820190 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7152fa-84d5-4849-aa00-da077266d0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:37.840453 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-df7152fa-84d5-4849-aa00-da077266d0de None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:37.841670 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-df7152fa-84d5-4849-aa00-da077266d0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:37.849479 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1447/2883] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:37.854236 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7db81-ec67-4848-a92e-1e021c82099e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:37.864718 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7db81-ec67-4848-a92e-1e021c82099e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:37.869385 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed149690-d6f7-47b6-a102-d28e0cae0866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:37.869984 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149690-d6f7-47b6-a102-d28e0cae0866 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:37.870266 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149690-d6f7-47b6-a102-d28e0cae0866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:37.870540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149690-d6f7-47b6-a102-d28e0cae0866 admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:37.871214 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed149690-d6f7-47b6-a102-d28e0cae0866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:53:37.871521 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed149690-d6f7-47b6-a102-d28e0cae0866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:37.873115 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed149690-d6f7-47b6-a102-d28e0cae0866 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:37.885951 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1437/2884] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:53:37.890195 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7152fa-84d5-4849-aa00-da077266d0de None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:37.899971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7152fa-84d5-4849-aa00-da077266d0de None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:37.904685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455a8ae-069c-46d2-8804-af22d5014ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:37.905325 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455a8ae-069c-46d2-8804-af22d5014ebe admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:37.905609 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455a8ae-069c-46d2-8804-af22d5014ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:37.905884 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455a8ae-069c-46d2-8804-af22d5014ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:37.906530 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455a8ae-069c-46d2-8804-af22d5014ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:37.908408 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455a8ae-069c-46d2-8804-af22d5014ebe admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:37.986379 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1448/2885] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:53:37 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:53:37.990910 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed149690-d6f7-47b6-a102-d28e0cae0866 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:38.001018 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed149690-d6f7-47b6-a102-d28e0cae0866 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:38.059346 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b76de-9a8d-4711-8090-9d78e025cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:38.059955 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b76de-9a8d-4711-8090-9d78e025cc40 admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:38.060230 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b76de-9a8d-4711-8090-9d78e025cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:38.060520 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b76de-9a8d-4711-8090-9d78e025cc40 admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:38.061162 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b76de-9a8d-4711-8090-9d78e025cc40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:38.063109 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b76de-9a8d-4711-8090-9d78e025cc40 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:38.134081 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1438/2886] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:53:37 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:53:38.138158 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455a8ae-069c-46d2-8804-af22d5014ebe admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:38.148842 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455a8ae-069c-46d2-8804-af22d5014ebe admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:38.153610 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759c250-306f-482c-be1a-9f66e67aab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:38.154196 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759c250-306f-482c-be1a-9f66e67aab8d admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:38.154477 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759c250-306f-482c-be1a-9f66e67aab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:38.154750 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759c250-306f-482c-be1a-9f66e67aab8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:38.155387 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759c250-306f-482c-be1a-9f66e67aab8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:38.156975 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759c250-306f-482c-be1a-9f66e67aab8d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:38.167135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1449/2887] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:53:38.171547 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b76de-9a8d-4711-8090-9d78e025cc40 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:38.185470 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b76de-9a8d-4711-8090-9d78e025cc40 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:38.190839 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4467f7-30f5-41fb-9868-f7ee0f15cbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:38.191510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4467f7-30f5-41fb-9868-f7ee0f15cbac admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:38.191788 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4467f7-30f5-41fb-9868-f7ee0f15cbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:38.192056 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4467f7-30f5-41fb-9868-f7ee0f15cbac admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:38.192692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4467f7-30f5-41fb-9868-f7ee0f15cbac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:38.194310 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4467f7-30f5-41fb-9868-f7ee0f15cbac admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:38.205163 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1439/2888] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:53:38.209707 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759c250-306f-482c-be1a-9f66e67aab8d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:38.219638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759c250-306f-482c-be1a-9f66e67aab8d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:38.225044 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13364632-2310-4bb3-afe3-a73f5e869c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:38.225717 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13364632-2310-4bb3-afe3-a73f5e869c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:38.225997 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13364632-2310-4bb3-afe3-a73f5e869c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:38.226271 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13364632-2310-4bb3-afe3-a73f5e869c66 admin admin] PATH_INFO: `/v3/projects/c0f1b63c9d4a41ffab3f44c8f7b86107/users/bd05804a3e3343ed845106d4a1c530be/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:38.241558 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13364632-2310-4bb3-afe3-a73f5e869c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0f1b63c9d4a41ffab3f44c8f7b86107, user_id=bd05804a3e3343ed845106d4a1c530be, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:38.244125 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13364632-2310-4bb3-afe3-a73f5e869c66 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:38.316330 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1450/2889] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:53:38 2022] PUT /identity/v3/projects/c0f1b63c9d4a41ffab3f44c8f7b86107/users/bd05804a3e3343ed845106d4a1c530be/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:38.326454 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789ceb5-e7fb-42f5-8771-7053067791f8 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:38.326733 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789ceb5-e7fb-42f5-8771-7053067791f8 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:38.327026 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789ceb5-e7fb-42f5-8771-7053067791f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:38.355352 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-8789ceb5-e7fb-42f5-8771-7053067791f8 None None] MFA Rules not processed for user `bd05804a3e3343ed845106d4a1c530be`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:38.356670 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8789ceb5-e7fb-42f5-8771-7053067791f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:38.420062 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1440/2890] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:38.431651 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13364632-2310-4bb3-afe3-a73f5e869c66 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:38.433403 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-13364632-2310-4bb3-afe3-a73f5e869c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:38.454746 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:38.493726 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13364632-2310-4bb3-afe3-a73f5e869c66 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:38.497465 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3549894-4170-4908-81a8-6702eef0a8c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:38.498063 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3549894-4170-4908-81a8-6702eef0a8c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:38.498340 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3549894-4170-4908-81a8-6702eef0a8c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:38.498611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3549894-4170-4908-81a8-6702eef0a8c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:38.507341 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3549894-4170-4908-81a8-6702eef0a8c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:38.508757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3549894-4170-4908-81a8-6702eef0a8c8 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:38.517322 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1451/2891] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:38.544331 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789ceb5-e7fb-42f5-8771-7053067791f8 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:38.563729 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:38.609706 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789ceb5-e7fb-42f5-8771-7053067791f8 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:38.614623 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69acec5-fb58-48b0-87d3-be11ea567261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:38.615243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69acec5-fb58-48b0-87d3-be11ea567261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:38.615522 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69acec5-fb58-48b0-87d3-be11ea567261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:38.615793 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69acec5-fb58-48b0-87d3-be11ea567261 admin admin] PATH_INFO: `/v3/users/bd05804a3e3343ed845106d4a1c530be` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:38.616917 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69acec5-fb58-48b0-87d3-be11ea567261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd05804a3e3343ed845106d4a1c530be)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:38.619225 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69acec5-fb58-48b0-87d3-be11ea567261 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:38.816063 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e69acec5-fb58-48b0-87d3-be11ea567261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd05804a3e3343ed845106d4a1c530be'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:38.816827 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e69acec5-fb58-48b0-87d3-be11ea567261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd05804a3e3343ed845106d4a1c530be'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:38.828659 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e69acec5-fb58-48b0-87d3-be11ea567261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd05804a3e3343ed845106d4a1c530be'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:38.836063 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e69acec5-fb58-48b0-87d3-be11ea567261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd05804a3e3343ed845106d4a1c530be'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:38.836730 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-e69acec5-fb58-48b0-87d3-be11ea567261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd05804a3e3343ed845106d4a1c530be'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:38.916220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1441/2892] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:53:38 2022] DELETE /identity/v3/users/bd05804a3e3343ed845106d4a1c530be => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:53:38.920977 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf969-7a7e-4929-8ae4-36182d200bcf None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:38.921287 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf969-7a7e-4929-8ae4-36182d200bcf None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:38.921569 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf969-7a7e-4929-8ae4-36182d200bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:38.940362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ef9bf969-7a7e-4929-8ae4-36182d200bcf None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:38.942326 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ef9bf969-7a7e-4929-8ae4-36182d200bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:38.999595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1452/2893] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:39.009666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69acec5-fb58-48b0-87d3-be11ea567261 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:39.011069 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-e69acec5-fb58-48b0-87d3-be11ea567261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:39.068834 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69acec5-fb58-48b0-87d3-be11ea567261 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:39.072475 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcf781-e578-4f5c-a78a-09fa8000f237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:39.073086 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcf781-e578-4f5c-a78a-09fa8000f237 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:39.073395 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcf781-e578-4f5c-a78a-09fa8000f237 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:39.073673 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcf781-e578-4f5c-a78a-09fa8000f237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:39.083609 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcf781-e578-4f5c-a78a-09fa8000f237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:39.085024 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcf781-e578-4f5c-a78a-09fa8000f237 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:39.094490 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1442/2894] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:39.489888 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bf969-7a7e-4929-8ae4-36182d200bcf None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:39.491303 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ef9bf969-7a7e-4929-8ae4-36182d200bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:39.504782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bf969-7a7e-4929-8ae4-36182d200bcf None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:39.509317 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7378b97-bb8f-4566-a0ee-007a2a6055d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:39.509963 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7378b97-bb8f-4566-a0ee-007a2a6055d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:39.510240 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7378b97-bb8f-4566-a0ee-007a2a6055d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:39.510512 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7378b97-bb8f-4566-a0ee-007a2a6055d2 admin admin] PATH_INFO: `/v3/projects/c0f1b63c9d4a41ffab3f44c8f7b86107` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:39.511705 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7378b97-bb8f-4566-a0ee-007a2a6055d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0f1b63c9d4a41ffab3f44c8f7b86107)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:39.513702 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7378b97-bb8f-4566-a0ee-007a2a6055d2 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:39.629409 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7378b97-bb8f-4566-a0ee-007a2a6055d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0f1b63c9d4a41ffab3f44c8f7b86107', 'request_id': 'req-f7378b97-bb8f-4566-a0ee-007a2a6055d2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:39.693428 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7378b97-bb8f-4566-a0ee-007a2a6055d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0f1b63c9d4a41ffab3f44c8f7b86107', 'request_id': 'req-f7378b97-bb8f-4566-a0ee-007a2a6055d2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:39.699964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7378b97-bb8f-4566-a0ee-007a2a6055d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0f1b63c9d4a41ffab3f44c8f7b86107', 'request_id': 'req-f7378b97-bb8f-4566-a0ee-007a2a6055d2'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:39.712067 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7378b97-bb8f-4566-a0ee-007a2a6055d2 admin admin] The token cache is being invalidate because project c0f1b63c9d4a41ffab3f44c8f7b86107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81645) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:53:39.712357 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7378b97-bb8f-4566-a0ee-007a2a6055d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:39.712989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-f7378b97-bb8f-4566-a0ee-007a2a6055d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:53:39.714606 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1453/2895] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:53:39 2022] DELETE /identity/v3/projects/c0f1b63c9d4a41ffab3f44c8f7b86107 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:53:39.719433 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53f024-d0ef-40e9-ac88-42b25c10d54e None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:39.719720 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53f024-d0ef-40e9-ac88-42b25c10d54e None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:39.720013 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53f024-d0ef-40e9-ac88-42b25c10d54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:39.741314 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3c53f024-d0ef-40e9-ac88-42b25c10d54e None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:39.742523 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3c53f024-d0ef-40e9-ac88-42b25c10d54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:39.777863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:39.804015 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1443/2896] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:39.812914 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64029c-09ce-49ef-9d3b-bcfe4bc0bd6d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:39.813427 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64029c-09ce-49ef-9d3b-bcfe4bc0bd6d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:39.813710 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64029c-09ce-49ef-9d3b-bcfe4bc0bd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:39.834494 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-ee64029c-09ce-49ef-9d3b-bcfe4bc0bd6d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:39.836104 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-ee64029c-09ce-49ef-9d3b-bcfe4bc0bd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:39.843735 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1454/2897] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:39.848078 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53f024-d0ef-40e9-ac88-42b25c10d54e None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:39.858578 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53f024-d0ef-40e9-ac88-42b25c10d54e None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:39.863423 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca91f63-9efc-483b-ac9c-0e7256879c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:39.864017 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca91f63-9efc-483b-ac9c-0e7256879c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:39.864291 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca91f63-9efc-483b-ac9c-0e7256879c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:39.864560 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca91f63-9efc-483b-ac9c-0e7256879c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:39.865220 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca91f63-9efc-483b-ac9c-0e7256879c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81644) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:53:39.865529 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca91f63-9efc-483b-ac9c-0e7256879c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:39.867101 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca91f63-9efc-483b-ac9c-0e7256879c1d admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:39.879148 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1444/2898] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 31 04:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:53:39.883398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64029c-09ce-49ef-9d3b-bcfe4bc0bd6d None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:39.892515 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64029c-09ce-49ef-9d3b-bcfe4bc0bd6d None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:39.898166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125857fd-4504-4e7c-8c17-0e349393711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:39.898753 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125857fd-4504-4e7c-8c17-0e349393711a admin admin] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:39.899027 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125857fd-4504-4e7c-8c17-0e349393711a admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:39.899293 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125857fd-4504-4e7c-8c17-0e349393711a admin admin] PATH_INFO: `/v3/projects` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:39.899916 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125857fd-4504-4e7c-8c17-0e349393711a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:39.901837 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125857fd-4504-4e7c-8c17-0e349393711a admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:39.974602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1455/2899] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 31 04:53:39 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:53:39.978705 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca91f63-9efc-483b-ac9c-0e7256879c1d admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:39.989006 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca91f63-9efc-483b-ac9c-0e7256879c1d admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:40.044336 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53edafe-8d4a-446b-addd-c2849f694fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:40.044941 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53edafe-8d4a-446b-addd-c2849f694fef admin admin] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:40.045237 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53edafe-8d4a-446b-addd-c2849f694fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:40.045508 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53edafe-8d4a-446b-addd-c2849f694fef admin admin] PATH_INFO: `/v3/users` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:40.046135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53edafe-8d4a-446b-addd-c2849f694fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:40.048019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53edafe-8d4a-446b-addd-c2849f694fef admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:40.117235 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1445/2900] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 31 04:53:39 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:53:40.121081 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125857fd-4504-4e7c-8c17-0e349393711a admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:40.132326 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125857fd-4504-4e7c-8c17-0e349393711a admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:40.136971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528444c3-8162-44a8-a7e0-42af9f84286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:40.137534 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528444c3-8162-44a8-a7e0-42af9f84286d admin admin] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:40.137830 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528444c3-8162-44a8-a7e0-42af9f84286d admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:40.138144 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528444c3-8162-44a8-a7e0-42af9f84286d admin admin] PATH_INFO: `/v3/roles` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:40.138782 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528444c3-8162-44a8-a7e0-42af9f84286d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:40.140367 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528444c3-8162-44a8-a7e0-42af9f84286d admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:40.150886 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1456/2901] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:53:40.155054 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53edafe-8d4a-446b-addd-c2849f694fef admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:40.165491 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53edafe-8d4a-446b-addd-c2849f694fef admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:40.170553 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3d449-c59f-4c54-a29c-7ef497d22f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:40.171143 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3d449-c59f-4c54-a29c-7ef497d22f09 admin admin] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:40.171417 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3d449-c59f-4c54-a29c-7ef497d22f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:40.171771 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3d449-c59f-4c54-a29c-7ef497d22f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:40.172386 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3d449-c59f-4c54-a29c-7ef497d22f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:40.173998 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3d449-c59f-4c54-a29c-7ef497d22f09 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:40.185151 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1446/2902] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 31 04:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:53:40.189180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528444c3-8162-44a8-a7e0-42af9f84286d admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:40.199700 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528444c3-8162-44a8-a7e0-42af9f84286d admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:40.204574 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2d662-ab9a-4d66-b91a-9fc0e4a6ce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:40.205278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2d662-ab9a-4d66-b91a-9fc0e4a6ce54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:40.205588 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2d662-ab9a-4d66-b91a-9fc0e4a6ce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:40.205863 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2d662-ab9a-4d66-b91a-9fc0e4a6ce54 admin admin] PATH_INFO: `/v3/projects/abe735d81c1b4543adf973335b5a7c9a/users/0c7df3196c2b4249bf4ea360b2975bcb/roles/64f2951b9ce444bcad20c61347224196` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:40.208407 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:40.221628 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2d662-ab9a-4d66-b91a-9fc0e4a6ce54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe735d81c1b4543adf973335b5a7c9a, user_id=0c7df3196c2b4249bf4ea360b2975bcb, role_id=64f2951b9ce444bcad20c61347224196)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:40.224563 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2d662-ab9a-4d66-b91a-9fc0e4a6ce54 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:40.282233 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1457/2903] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 31 04:53:40 2022] PUT /identity/v3/projects/abe735d81c1b4543adf973335b5a7c9a/users/0c7df3196c2b4249bf4ea360b2975bcb/roles/64f2951b9ce444bcad20c61347224196 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:53:40.287919 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67b819-1b5b-4530-943e-b2471d64ca58 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:40.288208 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67b819-1b5b-4530-943e-b2471d64ca58 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:40.288482 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67b819-1b5b-4530-943e-b2471d64ca58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:40.308173 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-3e67b819-1b5b-4530-943e-b2471d64ca58 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:40.309431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-3e67b819-1b5b-4530-943e-b2471d64ca58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:40.378009 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1447/2904] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:40.388697 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2d662-ab9a-4d66-b91a-9fc0e4a6ce54 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:40.390362 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1ec2d662-ab9a-4d66-b91a-9fc0e4a6ce54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:40.447366 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2d662-ab9a-4d66-b91a-9fc0e4a6ce54 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:40.450948 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639d489-3101-4bbb-9ec3-c02086922f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:40.451539 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639d489-3101-4bbb-9ec3-c02086922f79 service neutron] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:40.451814 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639d489-3101-4bbb-9ec3-c02086922f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:40.452082 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639d489-3101-4bbb-9ec3-c02086922f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:40.461278 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639d489-3101-4bbb-9ec3-c02086922f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:40.462694 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639d489-3101-4bbb-9ec3-c02086922f79 service neutron] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:40.471866 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1458/2905] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:41.501516 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f8ca6-162e-4bc0-b4e1-3359ffdbe052 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:41.504771 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f8ca6-162e-4bc0-b4e1-3359ffdbe052 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:41.504771 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f8ca6-162e-4bc0-b4e1-3359ffdbe052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:41.533545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-5e3f8ca6-162e-4bc0-b4e1-3359ffdbe052 None None] MFA Rules not processed for user `0c7df3196c2b4249bf4ea360b2975bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:41.534778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-5e3f8ca6-162e-4bc0-b4e1-3359ffdbe052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:41.572169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:41.604216 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1448/2906] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:41.616226 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639d489-3101-4bbb-9ec3-c02086922f79 service neutron] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:41.617699 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-5639d489-3101-4bbb-9ec3-c02086922f79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:41.700586 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639d489-3101-4bbb-9ec3-c02086922f79 service neutron] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:41.704289 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efb9bd-f02f-439d-abb2-ea0949e20ba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4455f4e327184c69aead4a7ae9737961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:41.704868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efb9bd-f02f-439d-abb2-ea0949e20ba8 service cinder] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:41.705148 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efb9bd-f02f-439d-abb2-ea0949e20ba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:41.705441 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efb9bd-f02f-439d-abb2-ea0949e20ba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:41.714460 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efb9bd-f02f-439d-abb2-ea0949e20ba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:41.715891 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efb9bd-f02f-439d-abb2-ea0949e20ba8 service cinder] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:41.724868 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1459/2907] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:43.490357 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd954c-41fa-44d0-bf5f-d6823d57e063 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:43.490900 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd954c-41fa-44d0-bf5f-d6823d57e063 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:43.490900 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd954c-41fa-44d0-bf5f-d6823d57e063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:43.510311 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-bddd954c-41fa-44d0-bf5f-d6823d57e063 None None] MFA Rules not processed for user `0c7df3196c2b4249bf4ea360b2975bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:53:43.511510 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bddd954c-41fa-44d0-bf5f-d6823d57e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:43.518302 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1449/2908] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:53:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:53:47.859405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efb9bd-f02f-439d-abb2-ea0949e20ba8 service cinder] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:53:47.861968 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-76efb9bd-f02f-439d-abb2-ea0949e20ba8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:47.952546 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efb9bd-f02f-439d-abb2-ea0949e20ba8 service cinder] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:53:47.958121 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf7453-3b8d-4781-9fe6-10d64cd3274d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:53:47.958728 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7453-3b8d-4781-9fe6-10d64cd3274d service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:53:47.959595 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7453-3b8d-4781-9fe6-10d64cd3274d service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:53:47.959951 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7453-3b8d-4781-9fe6-10d64cd3274d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:53:47.961700 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0bbf7453-3b8d-4781-9fe6-10d64cd3274d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:53:47.974297 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf7453-3b8d-4781-9fe6-10d64cd3274d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:53:47.975952 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf7453-3b8d-4781-9fe6-10d64cd3274d service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:53:47.986971 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1460/2909] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:53:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:53:53.505467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=14 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:53:57.982291 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:54:11.938227 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574dbc9-27e1-4c01-b22a-5140f9609612 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:11.938722 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574dbc9-27e1-4c01-b22a-5140f9609612 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:11.938830 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574dbc9-27e1-4c01-b22a-5140f9609612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:11.958568 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-1574dbc9-27e1-4c01-b22a-5140f9609612 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:54:11.959780 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-1574dbc9-27e1-4c01-b22a-5140f9609612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:54:11.968040 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1450/2910] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Aug 31 04:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:54:11.998071 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf7453-3b8d-4781-9fe6-10d64cd3274d service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:54:12.009927 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf7453-3b8d-4781-9fe6-10d64cd3274d service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:54:12.016414 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11307f6b-8c55-463a-b7de-2b8afaad6a6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:54:12.017000 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11307f6b-8c55-463a-b7de-2b8afaad6a6f service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:12.017311 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11307f6b-8c55-463a-b7de-2b8afaad6a6f service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:12.017590 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11307f6b-8c55-463a-b7de-2b8afaad6a6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:12.025632 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11307f6b-8c55-463a-b7de-2b8afaad6a6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:54:12.027195 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11307f6b-8c55-463a-b7de-2b8afaad6a6f service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:54:12.037017 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1461/2911] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:54:16.218737 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69dbd7-fee3-422c-9c18-2ad1dd88deec None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:16.219303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69dbd7-fee3-422c-9c18-2ad1dd88deec None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:16.219303 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69dbd7-fee3-422c-9c18-2ad1dd88deec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:16.238798 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-cd69dbd7-fee3-422c-9c18-2ad1dd88deec None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:54:16.240022 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cd69dbd7-fee3-422c-9c18-2ad1dd88deec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:54:16.247916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1451/2912] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Aug 31 04:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:54:16.270195 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11307f6b-8c55-463a-b7de-2b8afaad6a6f service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:54:16.271677 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-11307f6b-8c55-463a-b7de-2b8afaad6a6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:54:16.286560 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11307f6b-8c55-463a-b7de-2b8afaad6a6f service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:54:16.292085 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d87d8e-4e1d-4bd7-bd8e-fcdda90253e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:54:16.292676 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d87d8e-4e1d-4bd7-bd8e-fcdda90253e0 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:16.293244 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d87d8e-4e1d-4bd7-bd8e-fcdda90253e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:16.293526 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d87d8e-4e1d-4bd7-bd8e-fcdda90253e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:16.301963 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d87d8e-4e1d-4bd7-bd8e-fcdda90253e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:54:16.308014 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d87d8e-4e1d-4bd7-bd8e-fcdda90253e0 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:54:16.313662 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1462/2913] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:54:19.688431 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f9e4b-7fe3-4449-9c0d-54c3390f7594 None None] REQUEST_METHOD: `POST` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:19.689117 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f9e4b-7fe3-4449-9c0d-54c3390f7594 None None] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:19.689117 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f9e4b-7fe3-4449-9c0d-54c3390f7594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:19.708912 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.auth.core [None req-cd2f9e4b-7fe3-4449-9c0d-54c3390f7594 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81644) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:54:19.710139 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-cd2f9e4b-7fe3-4449-9c0d-54c3390f7594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:54:19.718153 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1452/2914] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Aug 31 04:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:54:19.739690 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d87d8e-4e1d-4bd7-bd8e-fcdda90253e0 service nova] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:54:19.751521 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d87d8e-4e1d-4bd7-bd8e-fcdda90253e0 service nova] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:54:19.756993 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943512a1-c93e-47aa-bde3-d646101cbbc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:54:19.757639 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943512a1-c93e-47aa-bde3-d646101cbbc9 service nova] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:19.757920 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943512a1-c93e-47aa-bde3-d646101cbbc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:19.758193 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943512a1-c93e-47aa-bde3-d646101cbbc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:19.766251 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943512a1-c93e-47aa-bde3-d646101cbbc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:54:19.767810 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943512a1-c93e-47aa-bde3-d646101cbbc9 service nova] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:54:19.777166 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1463/2915] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:54:21.399696 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f9e4b-7fe3-4449-9c0d-54c3390f7594 None None] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:54:21.413089 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f9e4b-7fe3-4449-9c0d-54c3390f7594 None None] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:54:21.423887 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be99f1-4691-43c6-a6cf-edfb7db81382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c63e7e4105b41d1abfe58bf13c6125d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:54:21.423887 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be99f1-4691-43c6-a6cf-edfb7db81382 service neutron] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:21.423887 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be99f1-4691-43c6-a6cf-edfb7db81382 service neutron] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:21.423887 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be99f1-4691-43c6-a6cf-edfb7db81382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:21.424957 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-76be99f1-4691-43c6-a6cf-edfb7db81382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:54:21.435004 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be99f1-4691-43c6-a6cf-edfb7db81382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:54:21.436418 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be99f1-4691-43c6-a6cf-edfb7db81382 service neutron] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:54:21.445090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1453/2916] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:54:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:54:22.552384 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9a887-c850-4770-ba57-c039f6af453a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:22.552918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9a887-c850-4770-ba57-c039f6af453a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:22.552918 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9a887-c850-4770-ba57-c039f6af453a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:22.572403 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fdc9a887-c850-4770-ba57-c039f6af453a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:54:22.573638 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fdc9a887-c850-4770-ba57-c039f6af453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:54:22.582352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1464/2917] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Aug 31 04:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:54:22.603583 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be99f1-4691-43c6-a6cf-edfb7db81382 service neutron] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:54:22.617114 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be99f1-4691-43c6-a6cf-edfb7db81382 service neutron] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:54:22.622571 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137dc5b-2143-4716-b100-a324c5876a4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:54:22.625964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137dc5b-2143-4716-b100-a324c5876a4f service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:22.625964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137dc5b-2143-4716-b100-a324c5876a4f service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:22.625964 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137dc5b-2143-4716-b100-a324c5876a4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:22.631980 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137dc5b-2143-4716-b100-a324c5876a4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:54:22.633649 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137dc5b-2143-4716-b100-a324c5876a4f service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:54:22.644001 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1454/2918] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:54:25.752874 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706abd5e-f952-4c6a-96c3-d1cf20e5126d None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:25.753469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706abd5e-f952-4c6a-96c3-d1cf20e5126d None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:25.753469 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706abd5e-f952-4c6a-96c3-d1cf20e5126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:25.773415 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-706abd5e-f952-4c6a-96c3-d1cf20e5126d None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:54:25.774608 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-706abd5e-f952-4c6a-96c3-d1cf20e5126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:54:25.783047 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1465/2919] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Aug 31 04:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:54:25.804077 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137dc5b-2143-4716-b100-a324c5876a4f service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:54:25.815636 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137dc5b-2143-4716-b100-a324c5876a4f service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:54:25.821467 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef1f5c-9fae-4e40-a26d-550e40db3ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:54:25.822059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef1f5c-9fae-4e40-a26d-550e40db3ae7 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:25.822406 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef1f5c-9fae-4e40-a26d-550e40db3ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:25.822684 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef1f5c-9fae-4e40-a26d-550e40db3ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:25.831557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef1f5c-9fae-4e40-a26d-550e40db3ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:54:25.833164 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef1f5c-9fae-4e40-a26d-550e40db3ae7 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:54:25.843241 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1455/2920] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:54:28.971318 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121c63e-99cd-4e9f-8354-18acb39d2e33 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:28.971834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121c63e-99cd-4e9f-8354-18acb39d2e33 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:28.971834 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121c63e-99cd-4e9f-8354-18acb39d2e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:28.990800 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-8121c63e-99cd-4e9f-8354-18acb39d2e33 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:54:28.991976 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-8121c63e-99cd-4e9f-8354-18acb39d2e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:54:29.000430 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1466/2921] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Aug 31 04:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:54:29.022778 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef1f5c-9fae-4e40-a26d-550e40db3ae7 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:54:29.034245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef1f5c-9fae-4e40-a26d-550e40db3ae7 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:54:29.039790 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d16be-fa42-4837-8b0f-dfad9a05a3a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:54:29.040320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d16be-fa42-4837-8b0f-dfad9a05a3a4 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:29.040595 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d16be-fa42-4837-8b0f-dfad9a05a3a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:29.040863 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d16be-fa42-4837-8b0f-dfad9a05a3a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:29.049135 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d16be-fa42-4837-8b0f-dfad9a05a3a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:54:29.050710 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d16be-fa42-4837-8b0f-dfad9a05a3a4 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:54:29.060557 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1456/2922] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:54:38.985655 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=27 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:54:39.056397 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=33 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:54:45.059932 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5b2c-693a-40f6-b2ea-fe19444ff060 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:45.060358 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5b2c-693a-40f6-b2ea-fe19444ff060 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:45.060471 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5b2c-693a-40f6-b2ea-fe19444ff060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:45.080260 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-310d5b2c-693a-40f6-b2ea-fe19444ff060 None None] MFA Rules not processed for user `0c7df3196c2b4249bf4ea360b2975bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:54:45.081492 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-310d5b2c-693a-40f6-b2ea-fe19444ff060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:54:45.088466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1467/2923] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 31 04:54:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:54:46.753260 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d16be-fa42-4837-8b0f-dfad9a05a3a4 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:54:46.754743 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-bb0d16be-fa42-4837-8b0f-dfad9a05a3a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:54:46.842488 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d16be-fa42-4837-8b0f-dfad9a05a3a4 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:54:46.848354 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fd2a5-a5ed-48cb-a3ca-24ed4eb0e328 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ad954bbb7749ee8861e8da98619006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:54:46.848966 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fd2a5-a5ed-48cb-a3ca-24ed4eb0e328 service placement] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:46.849275 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fd2a5-a5ed-48cb-a3ca-24ed4eb0e328 service placement] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:46.849550 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fd2a5-a5ed-48cb-a3ca-24ed4eb0e328 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:46.852094 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-c90fd2a5-a5ed-48cb-a3ca-24ed4eb0e328 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:54:46.866550 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fd2a5-a5ed-48cb-a3ca-24ed4eb0e328 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:54:46.868134 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fd2a5-a5ed-48cb-a3ca-24ed4eb0e328 service placement] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:54:46.879594 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1457/2924] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:54:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:54:55.074771 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=3 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:54:56.874338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=32 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:54:57.608019 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5b2c-693a-40f6-b2ea-fe19444ff060 None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:54:57.609654 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-310d5b2c-693a-40f6-b2ea-fe19444ff060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:54:57.625456 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5b2c-693a-40f6-b2ea-fe19444ff060 None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:54:57.630602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4099a5f-c614-43e2-85ac-84a57ffb3d5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ad954bbb7749ee8861e8da98619006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:54:57.631200 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4099a5f-c614-43e2-85ac-84a57ffb3d5b service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:57.631483 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4099a5f-c614-43e2-85ac-84a57ffb3d5b service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:57.631760 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4099a5f-c614-43e2-85ac-84a57ffb3d5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:57.633525 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e4099a5f-c614-43e2-85ac-84a57ffb3d5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:54:57.645480 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4099a5f-c614-43e2-85ac-84a57ffb3d5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:54:57.647072 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4099a5f-c614-43e2-85ac-84a57ffb3d5b service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:54:57.658405 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1468/2925] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:54:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:54:57.952598 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fd2a5-a5ed-48cb-a3ca-24ed4eb0e328 service placement] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:54:57.968118 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fd2a5-a5ed-48cb-a3ca-24ed4eb0e328 service placement] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:54:57.986539 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc039209-72c6-4de1-95db-be2c15c1286d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:54:57.987286 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc039209-72c6-4de1-95db-be2c15c1286d service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:54:57.987631 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc039209-72c6-4de1-95db-be2c15c1286d service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:54:57.988079 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc039209-72c6-4de1-95db-be2c15c1286d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:54:57.989983 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fc039209-72c6-4de1-95db-be2c15c1286d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:54:58.003559 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc039209-72c6-4de1-95db-be2c15c1286d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:54:58.005693 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc039209-72c6-4de1-95db-be2c15c1286d service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:54:58.023043 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1458/2926] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:54:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:55:01.634305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4099a5f-c614-43e2-85ac-84a57ffb3d5b service placement] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:55:01.634305 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-e4099a5f-c614-43e2-85ac-84a57ffb3d5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:55:01.653661 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4099a5f-c614-43e2-85ac-84a57ffb3d5b service placement] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:55:01.659658 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe89200-0952-438d-9d3e-cf8013f32e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:55:01.660352 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe89200-0952-438d-9d3e-cf8013f32e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:01.660823 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe89200-0952-438d-9d3e-cf8013f32e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:01.661174 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe89200-0952-438d-9d3e-cf8013f32e00 admin admin] PATH_INFO: `/v3/users/6a1fc0e72561448c851d03f5ccfaf7fd` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:01.662414 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe89200-0952-438d-9d3e-cf8013f32e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1fc0e72561448c851d03f5ccfaf7fd)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:55:01.664478 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe89200-0952-438d-9d3e-cf8013f32e00 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:55:01.871442 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-afe89200-0952-438d-9d3e-cf8013f32e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1fc0e72561448c851d03f5ccfaf7fd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:01.884420 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-afe89200-0952-438d-9d3e-cf8013f32e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1fc0e72561448c851d03f5ccfaf7fd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:01.955750 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-afe89200-0952-438d-9d3e-cf8013f32e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1fc0e72561448c851d03f5ccfaf7fd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:01.963721 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-afe89200-0952-438d-9d3e-cf8013f32e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1fc0e72561448c851d03f5ccfaf7fd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:01.964425 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-afe89200-0952-438d-9d3e-cf8013f32e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1fc0e72561448c851d03f5ccfaf7fd'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:01.970347 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1469/2927] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:55:01 2022] DELETE /identity/v3/users/6a1fc0e72561448c851d03f5ccfaf7fd => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:55:02.224426 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc039209-72c6-4de1-95db-be2c15c1286d service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:55:02.235552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc039209-72c6-4de1-95db-be2c15c1286d service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:55:02.296432 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:55:02.297090 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:02.297368 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:02.297647 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] PATH_INFO: `/v3/projects/e8f329c37dae4eee847a5b09d63a108c` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:02.298815 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f329c37dae4eee847a5b09d63a108c)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:55:02.301552 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:55:02.444358 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f329c37dae4eee847a5b09d63a108c', 'request_id': 'req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:02.536692 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f329c37dae4eee847a5b09d63a108c', 'request_id': 'req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:02.543503 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f329c37dae4eee847a5b09d63a108c', 'request_id': 'req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:02.555590 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] The token cache is being invalidate because project e8f329c37dae4eee847a5b09d63a108c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:55:02.555881 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:02.556540 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:02.558052 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1459/2928] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:55:02 2022] DELETE /identity/v3/projects/e8f329c37dae4eee847a5b09d63a108c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:55:02.562020 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe89200-0952-438d-9d3e-cf8013f32e00 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:55:02.563398 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-afe89200-0952-438d-9d3e-cf8013f32e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:55:02.577013 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe89200-0952-438d-9d3e-cf8013f32e00 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:55:02.633611 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aac6f9-a29d-497e-aab8-a7d6fd123957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:55:02.634250 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aac6f9-a29d-497e-aab8-a7d6fd123957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:02.634523 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aac6f9-a29d-497e-aab8-a7d6fd123957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:02.635085 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aac6f9-a29d-497e-aab8-a7d6fd123957 admin admin] PATH_INFO: `/v3/users/ec42b6be1f404f80b96725dd8660642e` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:02.635923 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aac6f9-a29d-497e-aab8-a7d6fd123957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec42b6be1f404f80b96725dd8660642e)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:55:02.637966 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aac6f9-a29d-497e-aab8-a7d6fd123957 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:55:02.849059 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e5aac6f9-a29d-497e-aab8-a7d6fd123957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec42b6be1f404f80b96725dd8660642e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:02.859384 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:55:02.861633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e5aac6f9-a29d-497e-aab8-a7d6fd123957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec42b6be1f404f80b96725dd8660642e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:02.932237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e5aac6f9-a29d-497e-aab8-a7d6fd123957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec42b6be1f404f80b96725dd8660642e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:02.939633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e5aac6f9-a29d-497e-aab8-a7d6fd123957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec42b6be1f404f80b96725dd8660642e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:02.940273 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-e5aac6f9-a29d-497e-aab8-a7d6fd123957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec42b6be1f404f80b96725dd8660642e'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:02.947135 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1470/2929] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:55:02 2022] DELETE /identity/v3/users/ec42b6be1f404f80b96725dd8660642e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:55:03.167854 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:55:03.169587 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:55:03.183176 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a1df1-cd7a-4d45-89b6-0cf38ad6a3f4 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:55:03.240880 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:55:03.241666 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:03.241942 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:03.242210 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] PATH_INFO: `/v3/projects/ee36af96d386490aaa4012f70614c896` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:03.243325 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee36af96d386490aaa4012f70614c896)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:55:03.245221 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:55:03.265832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:55:03.417043 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee36af96d386490aaa4012f70614c896', 'request_id': 'req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:03.508308 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee36af96d386490aaa4012f70614c896', 'request_id': 'req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:03.514584 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee36af96d386490aaa4012f70614c896', 'request_id': 'req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:03.527019 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] The token cache is being invalidate because project ee36af96d386490aaa4012f70614c896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:55:03.527438 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:03.527975 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:03.529723 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1460/2930] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:55:03 2022] DELETE /identity/v3/projects/ee36af96d386490aaa4012f70614c896 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:55:04.325602 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658a255-77a4-479d-9402-2ef49e6c629a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:04.326149 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658a255-77a4-479d-9402-2ef49e6c629a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:04.326149 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658a255-77a4-479d-9402-2ef49e6c629a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:04.345237 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-1658a255-77a4-479d-9402-2ef49e6c629a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:55:04.346424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-1658a255-77a4-479d-9402-2ef49e6c629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:55:04.404481 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1471/2931] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Aug 31 04:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:55:04.423399 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:55:04.424899 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:55:04.501243 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c6ce4-4d3f-4424-be2a-cfbf638d3bb3 admin admin] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:55:04.507109 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcaffd-4671-4ce0-8a60-567e12026269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:55:04.507724 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcaffd-4671-4ce0-8a60-567e12026269 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:04.507990 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcaffd-4671-4ce0-8a60-567e12026269 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:04.508263 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcaffd-4671-4ce0-8a60-567e12026269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:04.516338 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcaffd-4671-4ce0-8a60-567e12026269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:55:04.517932 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcaffd-4671-4ce0-8a60-567e12026269 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:55:04.528468 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1461/2932] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:55:07.843399 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65d618-1f10-4f15-a434-5f9d7b508baa None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:07.843964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65d618-1f10-4f15-a434-5f9d7b508baa None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:07.843964 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65d618-1f10-4f15-a434-5f9d7b508baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:07.863339 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-0e65d618-1f10-4f15-a434-5f9d7b508baa None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:55:07.864535 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-0e65d618-1f10-4f15-a434-5f9d7b508baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:55:07.872377 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1472/2933] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Aug 31 04:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:55:07.892023 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcaffd-4671-4ce0-8a60-567e12026269 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:55:07.893444 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.fernet_utils [None req-fefcaffd-4671-4ce0-8a60-567e12026269 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81644) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:55:07.909097 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcaffd-4671-4ce0-8a60-567e12026269 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:55:07.914702 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b86f76-30e6-44ba-ae50-cc3f1fdef1e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:55:07.915341 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b86f76-30e6-44ba-ae50-cc3f1fdef1e1 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:07.915637 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b86f76-30e6-44ba-ae50-cc3f1fdef1e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:07.915884 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b86f76-30e6-44ba-ae50-cc3f1fdef1e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:07.924141 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b86f76-30e6-44ba-ae50-cc3f1fdef1e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:55:07.925811 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b86f76-30e6-44ba-ae50-cc3f1fdef1e1 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:55:07.935197 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1462/2934] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:55:10.697473 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ca86-6ce9-4b29-bc03-51fe31047653 None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:10.697989 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ca86-6ce9-4b29-bc03-51fe31047653 None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:10.698092 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ca86-6ce9-4b29-bc03-51fe31047653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:10.718986 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-fc98ca86-6ce9-4b29-bc03-51fe31047653 None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:55:10.720180 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-fc98ca86-6ce9-4b29-bc03-51fe31047653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:55:10.728493 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1473/2935] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Aug 31 04:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:55:10.750861 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b86f76-30e6-44ba-ae50-cc3f1fdef1e1 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:55:10.762411 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b86f76-30e6-44ba-ae50-cc3f1fdef1e1 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:55:10.767916 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04554839-dd65-4386-ada7-9bbcf714a357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:55:10.768513 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04554839-dd65-4386-ada7-9bbcf714a357 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:10.768791 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04554839-dd65-4386-ada7-9bbcf714a357 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:10.769059 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04554839-dd65-4386-ada7-9bbcf714a357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:10.777832 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04554839-dd65-4386-ada7-9bbcf714a357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:55:10.779313 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04554839-dd65-4386-ada7-9bbcf714a357 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:55:10.789175 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1463/2936] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:55:13.939077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60863924-e405-4d4b-a245-7efc466d1f7a None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:13.939077 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60863924-e405-4d4b-a245-7efc466d1f7a None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:13.939571 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60863924-e405-4d4b-a245-7efc466d1f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:13.959552 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-60863924-e405-4d4b-a245-7efc466d1f7a None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:55:13.960757 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-60863924-e405-4d4b-a245-7efc466d1f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:55:13.968517 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1474/2937] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Aug 31 04:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:55:13.993349 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04554839-dd65-4386-ada7-9bbcf714a357 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:55:14.005248 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04554839-dd65-4386-ada7-9bbcf714a357 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:55:14.010625 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce4257-c0a0-4677-af8a-91a4ad0f2dd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:55:14.015272 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce4257-c0a0-4677-af8a-91a4ad0f2dd2 service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:14.015272 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce4257-c0a0-4677-af8a-91a4ad0f2dd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:14.015272 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce4257-c0a0-4677-af8a-91a4ad0f2dd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:14.020945 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce4257-c0a0-4677-af8a-91a4ad0f2dd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:55:14.022613 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce4257-c0a0-4677-af8a-91a4ad0f2dd2 service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:55:14.032001 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1464/2938] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:55:17.308567 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c36a2d-fd1e-48b9-a84f-a7b198a6dfaf None None] REQUEST_METHOD: `POST` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:17.309120 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c36a2d-fd1e-48b9-a84f-a7b198a6dfaf None None] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:17.309120 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c36a2d-fd1e-48b9-a84f-a7b198a6dfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:17.329001 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.auth.core [None req-18c36a2d-fd1e-48b9-a84f-a7b198a6dfaf None None] MFA Rules not processed for user `f8d87aca886c4c2eb2651db46e0ae180`. Rule list: `[]` (Enabled: `True`). {{(pid=81645) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:55:17.330270 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-18c36a2d-fd1e-48b9-a84f-a7b198a6dfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:55:17.338038 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1475/2939] 10.222.0.33 () {58 vars in 1016 bytes} [Wed Aug 31 04:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:55:17.363926 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce4257-c0a0-4677-af8a-91a4ad0f2dd2 service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:55:17.375481 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce4257-c0a0-4677-af8a-91a4ad0f2dd2 service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:55:17.382144 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f791bf-ff18-401c-93da-689489a474fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4877b72a6cea410dbb31a35c7acbd5f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:55:17.382772 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f791bf-ff18-401c-93da-689489a474fb service nova] REQUEST_METHOD: `GET` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:17.383051 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f791bf-ff18-401c-93da-689489a474fb service nova] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:17.383320 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f791bf-ff18-401c-93da-689489a474fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:17.391869 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f791bf-ff18-401c-93da-689489a474fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:55:17.393526 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f791bf-ff18-401c-93da-689489a474fb service nova] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:55:17.403566 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1465/2940] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:55:27.323881 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:DELETE=2,keystone:SELECT=46,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:55:27.399169 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:55:49.170466 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c36a2d-fd1e-48b9-a84f-a7b198a6dfaf None None] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:55:49.171988 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-18c36a2d-fd1e-48b9-a84f-a7b198a6dfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:55:49.185277 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c36a2d-fd1e-48b9-a84f-a7b198a6dfaf None None] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:55:49.189966 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268c1bd-3bd9-4333-ab10-6bce780cd963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:55:49.190586 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268c1bd-3bd9-4333-ab10-6bce780cd963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:49.190860 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268c1bd-3bd9-4333-ab10-6bce780cd963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:49.191132 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268c1bd-3bd9-4333-ab10-6bce780cd963 admin admin] PATH_INFO: `/v3/users/0c7df3196c2b4249bf4ea360b2975bcb` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:49.192228 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268c1bd-3bd9-4333-ab10-6bce780cd963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c7df3196c2b4249bf4ea360b2975bcb)` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:55:49.194871 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268c1bd-3bd9-4333-ab10-6bce780cd963 admin admin] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:55:49.385593 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4268c1bd-3bd9-4333-ab10-6bce780cd963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c7df3196c2b4249bf4ea360b2975bcb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:49.397685 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4268c1bd-3bd9-4333-ab10-6bce780cd963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c7df3196c2b4249bf4ea360b2975bcb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:49.468099 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4268c1bd-3bd9-4333-ab10-6bce780cd963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c7df3196c2b4249bf4ea360b2975bcb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:49.475631 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4268c1bd-3bd9-4333-ab10-6bce780cd963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c7df3196c2b4249bf4ea360b2975bcb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:49.476266 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.notifications [None req-4268c1bd-3bd9-4333-ab10-6bce780cd963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c7df3196c2b4249bf4ea360b2975bcb'} {{(pid=81645) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:49.482202 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1476/2941] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 31 04:55:49 2022] DELETE /identity/v3/users/0c7df3196c2b4249bf4ea360b2975bcb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:55:49.728498 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f791bf-ff18-401c-93da-689489a474fb service nova] Authenticating user token {{(pid=81644) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:55:49.738619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f791bf-ff18-401c-93da-689489a474fb service nova] Validating token access rules against request {{(pid=81644) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:55:49.798245 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d87aca886c4c2eb2651db46e0ae180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c036297280a949b589ef447a76452691', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81644) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:55:49.798873 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:55:49.799152 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:55:49.799423 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310 admin admin] PATH_INFO: `/v3/projects/abe735d81c1b4543adf973335b5a7c9a` {{(pid=81644) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:55:49.800545 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe735d81c1b4543adf973335b5a7c9a)` {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:55:49.802466 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310 admin admin] RBAC: Authorization granted {{(pid=81644) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:55:49.915479 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe735d81c1b4543adf973335b5a7c9a', 'request_id': 'req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:49.986940 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe735d81c1b4543adf973335b5a7c9a', 'request_id': 'req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:49.992628 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe735d81c1b4543adf973335b5a7c9a', 'request_id': 'req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310'} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:50.003590 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310 admin admin] The token cache is being invalidate because project abe735d81c1b4543adf973335b5a7c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81644) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:55:50.003874 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:50.004619 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG keystone.notifications [None req-6c0a2d66-a891-4c85-9b24-fdfc3a4d4310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81644) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:55:50.006742 dv-cinder-855307-1-smb devstack@keystone.service[81644]: [pid: 81644|app: 0|req: 1466/2942] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 31 04:55:49 2022] DELETE /identity/v3/projects/abe735d81c1b4543adf973335b5a7c9a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:55:59.478751 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:56:00.000653 dv-cinder-855307-1-smb devstack@keystone.service[81644]: DEBUG dbcounter [-] [81644] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:57:18.727320 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268c1bd-3bd9-4333-ab10-6bce780cd963 admin admin] Authenticating user token {{(pid=81645) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:57:18.729908 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-4268c1bd-3bd9-4333-ab10-6bce780cd963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:57:18.800470 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268c1bd-3bd9-4333-ab10-6bce780cd963 admin admin] Validating token access rules against request {{(pid=81645) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:57:18.860999 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a5525-5f65-4fae-acd7-d36579f1c382 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ad954bbb7749ee8861e8da98619006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff768fb064ce4d53b2e46ea611d3d103', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81645) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:57:18.861633 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a5525-5f65-4fae-acd7-d36579f1c382 service placement] REQUEST_METHOD: `GET` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:57:18.861912 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a5525-5f65-4fae-acd7-d36579f1c382 service placement] SCRIPT_NAME: `/identity` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:57:18.862182 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a5525-5f65-4fae-acd7-d36579f1c382 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81645) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:57:18.863890 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.fernet_utils [None req-909a5525-5f65-4fae-acd7-d36579f1c382 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81645) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:57:18.875424 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a5525-5f65-4fae-acd7-d36579f1c382 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:57:18.876985 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a5525-5f65-4fae-acd7-d36579f1c382 service placement] RBAC: Authorization granted {{(pid=81645) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:57:18.887725 dv-cinder-855307-1-smb devstack@keystone.service[81645]: [pid: 81645|app: 0|req: 1477/2943] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 31 04:57:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:57:28.882596 dv-cinder-855307-1-smb devstack@keystone.service[81645]: DEBUG dbcounter [-] [81645] Writing DB stats keystone:SELECT=58 {{(pid=81645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}